misc/py-litellm 1.106.2 FreeBSD
Call all LLM APIs using the OpenAI format
- System
- FreeBSD
- Repository
- FreeBSD ports
- Maintainer
- [email protected]
- Last update
- Commit
a054dba81a- License
- MIT
- Categories
- misc, python
Description
Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.]
LiteLLM manages:
- Translate inputs to provider's completion, embedding, and image_generation endpoints
- Consistent output, text responses will always be available at ['choices'][0]['message']['content']
- Retry/fallback logic across multiple deployments (e.g. Azure/OpenAI)
- Router
- Track spend & set budgets per project OpenAI Proxy Server
In the other systems
| System | Port | Version |
|---|---|---|
| FreeBSD | misc/py-litellm | 1.106.2 |
| DragonFly | misc/py-litellm | 1.65.0 |
Install
Binary package:
pkg install py312-litellm
From the ports tree:
cd /usr/ports/misc/py-litellm/ && make install clean
To depend on this port in another port's Makefile:
RUN_DEPENDS= py312-litellm>0:misc/py-litellm
Packages
The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.
| Repository | aarch64 | amd64 | armv6 | armv7 | i386 |
|---|---|---|---|---|---|
| FreeBSD:14:latest | - | - | - | 1.76.0 | - |
| FreeBSD:14:quarterly | - | - | n/a | 1.73.6 | - |
| FreeBSD:15:latest | - | 1.105.1 | n/a | 1.75.8 | 1.76.0 |
| FreeBSD:15:quarterly | - | 1.102.1 | n/a | n/a | n/a |
| FreeBSD:16:latest | - | 1.105.1 | n/a | n/a | n/a |
| FreeBSD:16:quarterly | n/a | n/a | n/a | n/a | n/a |
Dependencies
As this port's Makefile names them.
Build 1
${PYTHON_PKGNAMEPREFIX}maturin>=1.15.0: devel/py-maturin
Library 1
libonig.so: devel/oniguruma
Runtime 19
${PYTHON_PKGNAMEPREFIX}fastuuid>=0.14.0<1.0: devel/py-fastuuid${PYTHON_PKGNAMEPREFIX}filelock>=3.16.1<5.0: sysutils/py-filelock${PYTHON_PKGNAMEPREFIX}httpx>=0.28.0<1.0: www/py-httpx${PYTHON_PKGNAMEPREFIX}openai>=2.20.0<4.0.0: misc/py-openai${PYTHON_PKGNAMEPREFIX}python-dotenv>=1.0.0<2.0: www/py-python-dotenv${PYTHON_PKGNAMEPREFIX}pyyaml>=6.0.3<7.0: devel/py-pyyaml${PYTHON_PKGNAMEPREFIX}packaging>=24.0: devel/py-packaging${PYTHON_PKGNAMEPREFIX}importlib-metadata>=8.0.0<10.0: devel/py-importlib-metadata${PYTHON_PKGNAMEPREFIX}tiktoken>=0.8.0<1.0: textproc/py-tiktoken${PYTHON_PKGNAMEPREFIX}tokenizers>=0.21.0<1.0: textproc/py-tokenizers${PYTHON_PKGNAMEPREFIX}huggingface-hub>=0.34.0<3.0: misc/py-huggingface-hub${PYTHON_PKGNAMEPREFIX}click>=8.0.0<9.0: devel/py-click${PYTHON_PKGNAMEPREFIX}Jinja2>=3.1.6<4.0: devel/py-Jinja2${PYTHON_PKGNAMEPREFIX}aiohttp>=3.14.2<4.0: www/py-aiohttp${PYTHON_PKGNAMEPREFIX}pydantic2>=2.11.0<3.0.0: devel/py-pydantic2${PYTHON_PKGNAMEPREFIX}pydantic-settings>=2.14.1<3.0: devel/py-pydantic-settings${PYTHON_PKGNAMEPREFIX}jsonschema>=4.0.0<5.0: devel/py-jsonschema${PYTHON_PKGNAMEPREFIX}boto3>=1.43.1<2.0: www/py-boto3${PYTHON_PKGNAMEPREFIX}typing-extensions>=4.13.0<5.0: devel/py-typing-extensions
The full lists below include those, and their dependencies in turn.
Build dependencies 30
- archivers/brotli
- archivers/liblz4
- archivers/zstd
- devel/cmake-core
- devel/gettext-runtime
- devel/jsoncpp
- devel/libffi
- devel/libunistring
- devel/libuv
- devel/oniguruma
- devel/pkgconf
- devel/py-build
- devel/py-installer
- devel/py-maturin
- devel/py-packaging
- devel/py-pyproject-hooks
- devel/readline
- dns/libidn2
- dns/libpsl
- ftp/curl
- lang/python312
- lang/python315
- lang/rust
- math/mpdecimal
- ports-mgmt/pkg
- print/indexinfo
- security/libssh2
- security/rhash
- textproc/expat2
- www/libnghttp2
Run dependencies 389
- accessibility/at-spi2-core
- accessibility/speech-dispatcher
- archivers/brotli
- archivers/libdeflate
- archivers/liblz4
- archivers/lzo2
- archivers/py-brotli
- archivers/py-zopfli
- archivers/zopfli
- archivers/zstd
- audio/alsa-lib
- audio/alsa-plugins
- audio/ebur128
- audio/espeak-ng
- audio/flac
- audio/jack
- audio/lame
- audio/libogg
- audio/libsamplerate
- audio/libsndfile
- audio/libsoxr
- audio/libvorbis
- audio/mpg123
- audio/opus
- audio/pcaudiolib
- audio/pulseaudio
- audio/py-SoundFile
- audio/sndio
- audio/speex
- audio/speexdsp
- audio/webrtc-audio-processing
- converters/fribidi
- converters/libiconv
- databases/gdbm
- databases/hiredis
- databases/postgresql18-client
- databases/py-hiredis
- databases/py-prisma
- databases/py-psycopg
- databases/py-psycopg-c
- databases/py-psycopg-pool
- databases/py-redis
- databases/py-redisvl
- databases/py-sqlite3
- databases/sqlite3
- devel/abseil
- devel/binutils
- devel/dbus
- devel/dbus-glib
- devel/dconf
- devel/desktop-file-utils
- devel/dotconf
- devel/gettext-runtime
- devel/glib20
- devel/gobject-introspection
- devel/gsettings-desktop-schemas
- devel/icu
- devel/json-glib
- devel/jsoncpp
- devel/libdaemon
- devel/libdatrie
- devel/libedit
- devel/libepoll-shim
- devel/libev
- devel/libevdev
- devel/libevent
- devel/libffi
- devel/libgudev
- devel/libgusb
- devel/libinotify
- devel/libltdl
- devel/libpci
- devel/libpciaccess
- devel/libsysinfo
- devel/libthai
- devel/libudev-devd
- devel/libunwind
- devel/libuv
- devel/llvm12
- devel/nspr
- devel/oniguruma
- devel/orc
- devel/pcre2
- devel/py-Jinja2
- devel/py-aiosignal
- devel/py-annotated-doc
- devel/py-annotated-types
- devel/py-anyio
- devel/py-apscheduler
- devel/py-async_generator
- devel/py-attrs
- devel/py-azure-core
- devel/py-azure-identity
- devel/py-azure-storage-blob
- devel/py-babel
- devel/py-backoff
- devel/py-blinker
- devel/py-botocore
- devel/py-cffi
- devel/py-click
The first 100 are listed.
Configuration
Options name: misc_litellm
| Option | Default | Description |
|---|---|---|
| DOCS | off | Build and/or install documentation |
| PROXY | on | Enable LiteLLM proxy server support |
- USES
- cargo python shebangfix
- Service scripts
- none
Files
distinfo 684
| File | Size | SHA256 |
|---|---|---|
| litellm-1.106.2.tar.gz | 2.1431422e+07 | 9f0e770cb007c8c6e78917ad7b5c4f059f7bdc4a3606f854831780ea53fd9e2d |
| rust/crates/adler2-2.0.1.crate | 13366 | 320119579fcad9c21884f5c4861d16174d0e06250625266f50fe6898340abefa |
| rust/crates/ahash-0.8.12.crate | 43413 | 5a15f179cd60c4584b8a8c596927aadc462e27f2ca70c04e0071964a73ba7a75 |
| rust/crates/aho-corasick-1.1.5.crate | 184315 | c982642fa9e8606056828ee9a8505737230110bb1099153c79efe865c59d12ba |
| rust/crates/alloca-0.4.0.crate | 4257 | e5a7d05ea6aea7e9e64d25b9156ba2fee3fdd659e34e41063cd2fc7cd020d7f4 |
| rust/crates/allocator-api2-0.2.21.crate | 63622 | 683d7910e743518b0e34f1186f92494becacb047c7b6bf616c96772180fef923 |
| rust/crates/android_system_properties-0.1.6.crate | 5625 | ae221649c9976a6f6c56ae1facf410f3ddb33cc661c4b7b61020a912d4237fbc |
| rust/crates/anes-0.1.6.crate | 23857 | 4b46cbb362ab8752921c97e041f5e366ee6297bd428a31275b9fcf1e380f7299 |
| rust/crates/anstyle-1.0.14.crate | 17787 | 940b3a0ca603d1eade50a4846a2afffd5ef57a9feac2c0e2ec2e14f9ead76000 |
| rust/crates/anyhow-1.0.104.crate | 48819 | 330a5ed07fa54e4702c9d6c4174f74427fc0ef6e214bbd677ae50a5099946470 |
| rust/crates/arbitrary-1.4.2.crate | 38307 | c3d036a3c4ab069c7b410a2ce876bd74808d2d0888a82667669f8e783a898bf1 |
| rust/crates/arc-swap-1.9.2.crate | 81495 | c049c0be4daef0b145cb3555416b3b8ef5b7888a38aea1a3a155801fe7b0810b |
| rust/crates/arcstr-1.2.0.crate | 32237 | 03918c3dbd7701a85c6b9887732e2921175f26c350b4563841d0958c21d57e6d |
| rust/crates/askama-0.16.1.crate | 49194 | 6024d73179f43f15ccd2b881bfea6fee7f3a46ec53f33b52210dea749ebebaa4 |
| rust/crates/askama_derive-0.16.1.crate | 106621 | 071ee5ebf2138e3ad180e0aacf6940c2cab5e6d8333741d9925c7bee2b153f39 |
| rust/crates/askama_macros-0.16.1.crate | 8485 | 643e1c7cbb6aec1d920332fe51a7c0d8219e273dcb8602db03f5263e4d16487b |
| rust/crates/askama_parser-0.16.1.crate | 73706 | 2c5ae75772275d268b03ab8bdccdd12117b6169ee23256942b34e46c9f476583 |
| rust/crates/asn1-rs-0.7.2.crate | 93179 | b7f43a50ac4fdca5df8e885c21b835997f0a1cdee65494a6847694a98652d9d8 |
| rust/crates/asn1-rs-derive-0.6.0.crate | 11337 | 3109e49b1e4909e9db6515a30c633684d68cdeaa252f215214cb4fa1a5bfee2c |
| rust/crates/asn1-rs-impl-0.2.0.crate | 2261 | 7b18050c2cd6fe86c3a76584ef5e0baf286d038cda203eb6223df2cc413565f7 |
Master sites 1
- PYPI
Commit history 28
The latest 5 of 28 in the history this site was built from.