BSD Ports

misc/py-litellm 1.106.2 FreeBSD

Call all LLM APIs using the OpenAI format

System
FreeBSD
Repository
FreeBSD ports
Maintainer
[email protected]
Last update
Commit
a054dba81a
License
MIT
Categories
misc, python

Description

Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.]

LiteLLM manages:

  • Translate inputs to provider's completion, embedding, and image_generation endpoints
  • Consistent output, text responses will always be available at ['choices'][0]['message']['content']
  • Retry/fallback logic across multiple deployments (e.g. Azure/OpenAI)
    • Router
  • Track spend & set budgets per project OpenAI Proxy Server

In the other systems

SystemPortVersion
FreeBSDmisc/py-litellm1.106.2
DragonFlymisc/py-litellm1.65.0

Install

Binary package:

pkg install py312-litellm

From the ports tree:

cd /usr/ports/misc/py-litellm/ && make install clean

To depend on this port in another port's Makefile:

RUN_DEPENDS=	py312-litellm>0:misc/py-litellm

Packages

The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.

Repositoryaarch64amd64armv6armv7i386
FreeBSD:14:latest---1.76.0-
FreeBSD:14:quarterly--n/a1.73.6-
FreeBSD:15:latest-1.105.1n/a1.75.81.76.0
FreeBSD:15:quarterly-1.102.1n/an/an/a
FreeBSD:16:latest-1.105.1n/an/an/a
FreeBSD:16:quarterlyn/an/an/an/an/a

Dependencies

As this port's Makefile names them.

Build 1

Library 1

Runtime 19

The full lists below include those, and their dependencies in turn.

Build dependencies 30
Run dependencies 389

The first 100 are listed.

Configuration

Options name: misc_litellm

OptionDefaultDescription
DOCSoffBuild and/or install documentation
PROXYonEnable LiteLLM proxy server support
USES
cargo python shebangfix
Service scripts
none

Files

distinfo 684
FileSizeSHA256
litellm-1.106.2.tar.gz2.1431422e+079f0e770cb007c8c6e78917ad7b5c4f059f7bdc4a3606f854831780ea53fd9e2d
rust/crates/adler2-2.0.1.crate13366320119579fcad9c21884f5c4861d16174d0e06250625266f50fe6898340abefa
rust/crates/ahash-0.8.12.crate434135a15f179cd60c4584b8a8c596927aadc462e27f2ca70c04e0071964a73ba7a75
rust/crates/aho-corasick-1.1.5.crate184315c982642fa9e8606056828ee9a8505737230110bb1099153c79efe865c59d12ba
rust/crates/alloca-0.4.0.crate4257e5a7d05ea6aea7e9e64d25b9156ba2fee3fdd659e34e41063cd2fc7cd020d7f4
rust/crates/allocator-api2-0.2.21.crate63622683d7910e743518b0e34f1186f92494becacb047c7b6bf616c96772180fef923
rust/crates/android_system_properties-0.1.6.crate5625ae221649c9976a6f6c56ae1facf410f3ddb33cc661c4b7b61020a912d4237fbc
rust/crates/anes-0.1.6.crate238574b46cbb362ab8752921c97e041f5e366ee6297bd428a31275b9fcf1e380f7299
rust/crates/anstyle-1.0.14.crate17787940b3a0ca603d1eade50a4846a2afffd5ef57a9feac2c0e2ec2e14f9ead76000
rust/crates/anyhow-1.0.104.crate48819330a5ed07fa54e4702c9d6c4174f74427fc0ef6e214bbd677ae50a5099946470
rust/crates/arbitrary-1.4.2.crate38307c3d036a3c4ab069c7b410a2ce876bd74808d2d0888a82667669f8e783a898bf1
rust/crates/arc-swap-1.9.2.crate81495c049c0be4daef0b145cb3555416b3b8ef5b7888a38aea1a3a155801fe7b0810b
rust/crates/arcstr-1.2.0.crate3223703918c3dbd7701a85c6b9887732e2921175f26c350b4563841d0958c21d57e6d
rust/crates/askama-0.16.1.crate491946024d73179f43f15ccd2b881bfea6fee7f3a46ec53f33b52210dea749ebebaa4
rust/crates/askama_derive-0.16.1.crate106621071ee5ebf2138e3ad180e0aacf6940c2cab5e6d8333741d9925c7bee2b153f39
rust/crates/askama_macros-0.16.1.crate8485643e1c7cbb6aec1d920332fe51a7c0d8219e273dcb8602db03f5263e4d16487b
rust/crates/askama_parser-0.16.1.crate737062c5ae75772275d268b03ab8bdccdd12117b6169ee23256942b34e46c9f476583
rust/crates/asn1-rs-0.7.2.crate93179b7f43a50ac4fdca5df8e885c21b835997f0a1cdee65494a6847694a98652d9d8
rust/crates/asn1-rs-derive-0.6.0.crate113373109e49b1e4909e9db6515a30c633684d68cdeaa252f215214cb4fa1a5bfee2c
rust/crates/asn1-rs-impl-0.2.0.crate22617b18050c2cd6fe86c3a76584ef5e0baf286d038cda203eb6223df2cc413565f7
Master sites 1
  • PYPI

Commit history 28

DateCommitCreditsLog message
a054dba81a Hiroki Tagato misc/py-litellm: Update to 1.106.2
Changelog: - https://github.com/BerriAI/litellm/releases/tag/v1.106.1 - https://github.com/BerriAI/litellm/releases/tag/v1.106.2 Reported by: portscout
981eb19cb7 Hiroki Tagato misc/py-litellm: Update to 1.106.0
Changelog: https://github.com/BerriAI/litellm/releases/tag/v1.106.0 Reported by: portscout
6241e0ad28 Hiroki Tagato misc/py-litellm: Update to 1.105.1
Changelog: https://github.com/BerriAI/litellm/releases/tag/v1.105.1 Reported by: portscout
9c878207a1 Mikael Urankar lang/rust: Bump revisions after 1.99.0
PR: 299016
b9a6a34c51 Hiroki Tagato misc/py-litellm: Relax upper limit of dependency (py-huggingface-hub)

The latest 5 of 28 in the history this site was built from.