BSD Portsmisc/py-litellm 1.65.0 DragonFly
Call all LLM APIs using the OpenAI format
- System
- DragonFly
- Repository
- DPorts
- Maintainer
- [email protected] (as in FreeBSD)
- License
- MIT
- Categories
- misc, python
- Package size
- 6335.3 KiB, 34067.6 KiB installed
Description
Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.]
LiteLLM manages:
- Translate inputs to provider's completion, embedding, and image_generation endpoints
- Consistent output, text responses will always be available at ['choices'][0]['message']['content']
- Retry/fallback logic across multiple deployments (e.g. Azure/OpenAI)
- Router
- Track spend & set budgets per project OpenAI Proxy Server
In the other systems
| System | Port | Version |
|---|---|---|
| DragonFly | misc/py-litellm | 1.65.0 |
| FreeBSD | misc/py-litellm | 1.106.2 |
| HardenedBSD | misc/py-litellm | 1.102.1 |
| GhostBSD | misc/py-litellm | 1.101.0 |
Install
Binary package:
pkg install py311-litellmFrom DPorts:
cd /usr/dports/misc/py-litellm && make install cleanDependencies
Run dependencies 12
No port depends on this one.