misc/py-llama-cpp-python 0.3.36_1 FreeBSD
Python bindings for the llama.cpp library
- System
- FreeBSD
- Repository
- FreeBSD ports
- Maintainer
- [email protected]
- Last update
- Commit
fc2d9770b2- License
- MIT
- Categories
- misc
- Package size
- 5423.5 KiB, 49374.5 KiB installed
Description
llama-cpp-python is the Python bindings for the llama.cpp library/
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.
Install
Binary package:
pkg install py312-llama-cpp-python
From the ports tree:
cd /usr/ports/misc/py-llama-cpp-python/ && make install clean
To depend on this port in another port's Makefile:
RUN_DEPENDS= py312-llama-cpp-python>0:misc/py-llama-cpp-python
Packages
The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.
| Repository | aarch64 | amd64 | armv6 | armv7 | i386 |
|---|---|---|---|---|---|
| FreeBSD:14:latest | 0.3.35_1 | 0.3.36 | - | 0.3.2 | - |
| FreeBSD:14:quarterly | 0.3.35_1 | 0.3.35_1 | n/a | 0.3.2 | - |
| FreeBSD:15:latest | 0.3.36 | 0.3.36_1 | n/a | 0.3.2 | 0.3.2 |
| FreeBSD:15:quarterly | 0.3.35_1 | 0.3.35_1 | n/a | n/a | n/a |
| FreeBSD:16:latest | 0.3.35_1 | 0.3.36_1 | n/a | n/a | n/a |
| FreeBSD:16:quarterly | n/a | n/a | n/a | n/a | n/a |
Dependencies
As this port's Makefile names them.
Build 2
${PYTHON_PKGNAMEPREFIX}scikit-build-core>=0.9.2: devel/py-scikit-build-corecmake: devel/cmake-core
Library 1
libggml.so: misc/ggml
Runtime 10
${PYTHON_PKGNAMEPREFIX}diskcache>=5.6.1: devel/py-diskcache${PYTHON_PKGNAMEPREFIX}Jinja2>=2.11.3: devel/py-Jinja2${PYTHON_PKGNAMEPREFIX}numpy>=1.20.0: math/py-numpy${PYTHON_PKGNAMEPREFIX}typing-extensions>=4.5.0: devel/py-typing-extensions${PYTHON_PKGNAMEPREFIX}fastapi>=0.100.0: www/py-fastapi${PYTHON_PKGNAMEPREFIX}pydantic-settings>=2.0.1: devel/py-pydantic-settings${PYTHON_PKGNAMEPREFIX}sse-starlette>=1.6.1: www/py-sse-starlette${PYTHON_PKGNAMEPREFIX}starlette-context>=0.3.6: www/py-starlette-context${PYTHON_PKGNAMEPREFIX}uvicorn>=0.22.0: www/py-uvicorn${PYTHON_PKGNAMEPREFIX}pyyaml>=5.1: devel/py-pyyaml
Test 4
${PYTHON_PKGNAMEPREFIX}httpx>=0.24.1: www/py-httpx${PYTHON_PKGNAMEPREFIX}huggingface-hub>=0.23.0: misc/py-huggingface-hub${PYTHON_PKGNAMEPREFIX}scipy>=1.10: science/py-scipy${PYTHON_PKGNAMEPREFIX}setuptools>0: devel/py-setuptools
The full lists below include those, and their dependencies in turn.
Build dependencies 36
- archivers/liblz4
- archivers/zstd
- devel/cmake-core
- devel/gettext-runtime
- devel/jsoncpp
- devel/libepoll-shim
- devel/libffi
- devel/libunistring
- devel/libuv
- devel/py-build
- devel/py-installer
- devel/py-packaging
- devel/py-pathspec
- devel/py-pyproject-hooks
- devel/py-scikit-build-core
- devel/readline
- dns/libidn2
- graphics/vulkan-loader
- graphics/wayland
- lang/python312
- lang/python315
- math/mpdecimal
- misc/ggml
- ports-mgmt/pkg
- print/indexinfo
- security/rhash
- textproc/expat2
- textproc/libxml2
- x11/libX11
- x11/libXau
- x11/libXdmcp
- x11/libXext
- x11/libXrandr
- x11/libXrender
- x11/libxcb
- x11/xorgproto
Run dependencies 74
- archivers/liblz4
- archivers/zstd
- databases/py-sqlite3
- databases/py-sqlparse
- databases/sqlite3
- devel/binutils
- devel/gettext-runtime
- devel/libedit
- devel/libepoll-shim
- devel/libffi
- devel/py-Jinja2
- devel/py-annotated-doc
- devel/py-annotated-types
- devel/py-anyio
- devel/py-babel
- devel/py-click
- devel/py-diskcache
- devel/py-opentelemetry-api
- devel/py-pydantic-core
- devel/py-pydantic-settings
- devel/py-pydantic2
- devel/py-pyyaml
- devel/py-typing-extensions
- devel/py-typing-inspection
- devel/readline
- dns/py-idna
- graphics/vulkan-loader
- graphics/wayland
- lang/gcc14
- lang/python312
- lang/python315
- lang/tcl86
- math/gmp
- math/libtommath
- math/mpc
- math/mpdecimal
- math/mpfr
- math/openblas
- math/py-numpy
- misc/ggml
- net/py-h11
- net/py-socksio
- print/indexinfo
- security/py-certifi
- security/py-itsdangerous
- security/py-truststore
- textproc/expat2
- textproc/libxml2
- textproc/libyaml
- textproc/py-markupsafe
- www/py-asgiref
- www/py-django52
- www/py-fastapi
- www/py-h2
- www/py-hpack
- www/py-httpcore
- www/py-httpcore2
- www/py-httpx
- www/py-httpx2
- www/py-hyperframe
- www/py-python-dotenv
- www/py-python-multipart
- www/py-sse-starlette
- www/py-starlette
- www/py-starlette-context
- www/py-uvicorn
- x11/libX11
- x11/libXau
- x11/libXdmcp
- x11/libXext
- x11/libXrandr
- x11/libXrender
- x11/libxcb
- x11/xorgproto
No port depends on this one.
Configuration
No options to configure.
- USES
- python shebangfix ssl
- Service scripts
- none
Files
distinfo 2
| File | Size | SHA256 |
|---|---|---|
| abetlen-llama-cpp-python-v0.3.36_GH0.tar.gz | 429428 | c699ad11119d7489560b89da22be47daf887cf6033c552a8a3a6714b3b4170e3 |
| ggml-org-llama.cpp-0c1e57098bba43ac29e6e3b677cdceebdd22334f_GH0.tar.gz | 3.771568e+07 | 6a85ec945b57789c875e1af90e66109fbf136a3c79802d5ca0333b043e10407f |