misc/py-vllm 0.20.2_1 FreeBSD

High-throughput and memory-efficient LLM inference engine

System: FreeBSD
Repository: FreeBSD ports
Maintainer: [email protected]
Last update: 2026-09-17
Commit: 0c4806a527
License: APACHE20
Categories: misc, python

Description

vLLM is a fast and easy-to-use library for LLM inference and serving. It provides high-throughput and memory-efficient inference for large language models (LLMs) using state-of-the-art serving technologies including:

PagedAttention for efficient KV cache memory management
Continuous batching of incoming requests
Optimized CUDA kernels (on supported platforms)
Hugging Face model compatibility
Various decoding algorithms including parallel sampling and beam search
OpenAI-compatible API server

On FreeBSD, vLLM runs in CPU/empty device mode (VLLM_TARGET_DEVICE=empty), providing pure Python inference without GPU acceleration.

Install

Binary package:

pkg install py312-vllm

From the ports tree:

cd /usr/ports/misc/py-vllm/ && make install clean

To depend on this port in another port's Makefile:

RUN_DEPENDS=	py312-vllm>0:misc/py-vllm

Packages

The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.

Repository

aarch64

amd64

armv6

armv7

i386

FreeBSD:14:latest

0.20.2_1

FreeBSD:14:quarterly

0.20.2_1

n/a

FreeBSD:15:latest

0.20.2_1

n/a

FreeBSD:15:quarterly

0.20.2_1

n/a

FreeBSD:16:latest

n/a

FreeBSD:16:quarterly

n/a

Dependencies

As this port's Makefile names them.

Build 8

${LOCALBASE}/llvm19/bin/clang : devel/llvm19
${PYTHON_PKGNAMEPREFIX}Jinja2>=3.1.6 : devel/py-Jinja2
${PYTHON_PKGNAMEPREFIX}ninja>=1.13 : devel/py-ninja
${PYTHON_PKGNAMEPREFIX}packaging>=24.2 : devel/py-packaging
${PYTHON_PKGNAMEPREFIX}pytorch>=2.11.0 : misc/py-pytorch
${PYTHON_PKGNAMEPREFIX}setuptools>=63.0 : devel/py-setuptools
${PYTHON_PKGNAMEPREFIX}setuptools-scm>=8.0 : devel/py-setuptools-scm
${PYTHON_PKGNAMEPREFIX}wheel>0 : devel/py-wheel

Library 2

libabsl_status.so : devel/abseil
libprotobuf.so : devel/protobuf

Runtime 62

${PYTHON_PKGNAMEPREFIX}aiohttp>=3.13.3 : www/py-aiohttp
${PYTHON_PKGNAMEPREFIX}anthropic>=0.71.0 : misc/py-anthropic
${PYTHON_PKGNAMEPREFIX}blake3>0 : security/py-blake3
${PYTHON_PKGNAMEPREFIX}cachetools>0 : devel/py-cachetools
${PYTHON_PKGNAMEPREFIX}cbor2>0 : devel/py-cbor2
${PYTHON_PKGNAMEPREFIX}cloudpickle>0 : devel/py-cloudpickle
${PYTHON_PKGNAMEPREFIX}compressed-tensors>=0.15.0.1 : misc/py-compressed-tensors
${PYTHON_PKGNAMEPREFIX}depyf>=0.20.0 : devel/py-depyf
${PYTHON_PKGNAMEPREFIX}diskcache>=5.6.3 : devel/py-diskcache
${PYTHON_PKGNAMEPREFIX}einops>0 : misc/py-einops
${PYTHON_PKGNAMEPREFIX}fastapi>=0.115.0 : www/py-fastapi
${PYTHON_PKGNAMEPREFIX}filelock>=3.16.1 : sysutils/py-filelock
${PYTHON_PKGNAMEPREFIX}gguf>=0.17.0 : misc/py-gguf
${PYTHON_PKGNAMEPREFIX}ijson>0 : devel/py-ijson
${PYTHON_PKGNAMEPREFIX}Jinja2>=3.1.6 : devel/py-Jinja2
${PYTHON_PKGNAMEPREFIX}lark>=1.2.2 : devel/py-lark
${PYTHON_PKGNAMEPREFIX}llguidance>=1.3.0 : textproc/py-llguidance
${PYTHON_PKGNAMEPREFIX}lm-format-enforcer>=0.11.3 : misc/py-lm-format-enforcer
${PYTHON_PKGNAMEPREFIX}mcp>0 : misc/py-mcp
${PYTHON_PKGNAMEPREFIX}mistral-common>=1.11.0 : misc/py-mistral-common
${PYTHON_PKGNAMEPREFIX}model-hosting-container-standards>=0.1.13 : misc/py-model-hosting-container-standards
${PYTHON_PKGNAMEPREFIX}msgspec>0 : devel/py-msgspec
${PYTHON_PKGNAMEPREFIX}ninja>=1.13 : devel/py-ninja
${PYTHON_PKGNAMEPREFIX}numba>=0.65.0 : devel/py-numba
${PYTHON_PKGNAMEPREFIX}numpy>=1.25 : math/py-numpy
${PYTHON_PKGNAMEPREFIX}openai>=2.0.0 : misc/py-openai
${PYTHON_PKGNAMEPREFIX}openai-harmony>=0.0.3 : misc/py-openai-harmony
${PYTHON_PKGNAMEPREFIX}opentelemetry-api>=1.27.0 : devel/py-opentelemetry-api
${PYTHON_PKGNAMEPREFIX}opentelemetry-exporter-otlp>=1.27.0 : devel/py-opentelemetry-exporter-otlp
${PYTHON_PKGNAMEPREFIX}opentelemetry-sdk>=1.27.0 : devel/py-opentelemetry-sdk
${PYTHON_PKGNAMEPREFIX}opentelemetry-semantic-conventions-ai>=0.4.1 : devel/py-opentelemetry-semantic-conventions-ai
${PYTHON_PKGNAMEPREFIX}opencv-python-headless>=4.13.0 : graphics/py-opencv-python-headless
${PYTHON_PKGNAMEPREFIX}outlines-core>=0.2.14 : textproc/py-outlines-core
${PYTHON_PKGNAMEPREFIX}partial-json-parser>0 : textproc/py-partial-json-parser
${PYTHON_PKGNAMEPREFIX}pillow>=10.0.0 : graphics/py-pillow
${PYTHON_PKGNAMEPREFIX}prometheus-client>=0.18.0 : net-mgmt/py-prometheus-client
${PYTHON_PKGNAMEPREFIX}prometheus-fastapi-instrumentator>=7.0.0 : www/py-prometheus-fastapi-instrumentator
${PYTHON_PKGNAMEPREFIX}protobuf>=5.29.6 : devel/py-protobuf
${PYTHON_PKGNAMEPREFIX}psutil>=5.9.0 : sysutils/py-psutil
${PYTHON_PKGNAMEPREFIX}py-cpuinfo2>0 : sysutils/py-py-cpuinfo2
${PYTHON_PKGNAMEPREFIX}pybase64>0 : devel/py-pybase64
${PYTHON_PKGNAMEPREFIX}pydantic2>=2.12.0 : devel/py-pydantic2
${PYTHON_PKGNAMEPREFIX}python-json-logger>0 : devel/py-python-json-logger
${PYTHON_PKGNAMEPREFIX}pytorch>=2.11.0 : misc/py-pytorch
${PYTHON_PKGNAMEPREFIX}pyyaml>0 : devel/py-pyyaml
${PYTHON_PKGNAMEPREFIX}pyzmq>=25.0.0 : net/py-pyzmq
${PYTHON_PKGNAMEPREFIX}regex>0 : textproc/py-regex
${PYTHON_PKGNAMEPREFIX}requests>=2.26.0 : www/py-requests
${PYTHON_PKGNAMEPREFIX}sentencepiece>0 : textproc/py-sentencepiece
${PYTHON_PKGNAMEPREFIX}setproctitle>0 : devel/py-setproctitle
${PYTHON_PKGNAMEPREFIX}setuptools>=63.0 : devel/py-setuptools
${PYTHON_PKGNAMEPREFIX}six>=1.16.0 : devel/py-six
${PYTHON_PKGNAMEPREFIX}tiktoken>=0.6.0 : textproc/py-tiktoken
${PYTHON_PKGNAMEPREFIX}tokenizers>=0.21.1 : textproc/py-tokenizers
${PYTHON_PKGNAMEPREFIX}torchaudio>=0 : audio/py-torchaudio
${PYTHON_PKGNAMEPREFIX}torchvision>=0 : misc/py-torchvision
${PYTHON_PKGNAMEPREFIX}tqdm>=4.0 : misc/py-tqdm
${PYTHON_PKGNAMEPREFIX}transformers>=4.56.0 : misc/py-transformers
${PYTHON_PKGNAMEPREFIX}typing-extensions>=4.10 : devel/py-typing-extensions
${PYTHON_PKGNAMEPREFIX}uvloop>=0.20.0 : devel/py-uvloop
${PYTHON_PKGNAMEPREFIX}watchfiles>0 : devel/py-watchfiles
${PYTHON_PKGNAMEPREFIX}xgrammar>=0.1.32 : misc/py-xgrammar

Test 5

${PYTHON_PKGNAMEPREFIX}datasets>=4.8.2 : misc/py-datasets
${PYTHON_PKGNAMEPREFIX}evaluate>=0.4.6 : misc/py-evaluate
${PYTHON_PKGNAMEPREFIX}multiprocess>=0.70.19 : devel/py-multiprocess
${PYTHON_PKGNAMEPREFIX}pytest-asyncio>=1.3.0 : devel/py-pytest-asyncio
${PYTHON_PKGNAMEPREFIX}tblib>=3.2.2 : devel/py-tblib

The full lists below include those, and their dependencies in turn.

Build dependencies 215

The first 100 are listed.

Run dependencies 553

The first 100 are listed.

Required by 1

graphics/py-olmocr

Configuration

No options to configure.

USES: cmake:indirect python
Service scripts: none

Files

distinfo 2

File

Size

SHA256

vllm-0.20.2.tar.gz

3.3526607e+07

58809377798c5335c6e2fe30092abda54d9200b5b8a717b3735a63f5daa0e383

v3.10.tar.gz

1.3507701e+07

ba5834a1fdbb6d1c1b1c065dfd789438e7aa42c03fc52d92c02af85d78d1c75c

Master sites 2

PYPI
https://github.com/uxlfoundation/oneDNN/archive/refs/tags/:onednn_src

Commit history 2

Date Commit Credits Log message

2026-09-17 0c4806a527 Yuri Victorovich misc/py-vllm: fix build with the latest pytorch

2026-09-16 9845f5db55 Yuri Victorovich sysutils/py-py-cpuinfo: remove in favor of sysutils/py-py-cpuinfo2