BSD Portsai/py-transformers 5.3.0_2 MidnightBSD
State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow
- System
- MidnightBSD
- Repository
- mports
- Maintainer
- [email protected]
- Port added
- Last update
- Commit
b807d69740- License
- Apache-2.0
- Categories
- ai, python
Description
Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training.
It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers.
Install
Binary package:
mport install ${PYTHON_PKGNAMEPREFIX}transformersFrom mports:
cd /usr/mports/ai/py-transformers && make install cleanTo depend on this port in another port's Makefile:
RUN_DEPENDS= ${PYTHON_PKGNAMEPREFIX}transformers>0:ai/py-transformersDependencies
As this port's Makefile names them.
Build 1
${PYTHON_PKGNAMEPREFIX}wheel>0: devel/py-wheel
Runtime 32
${PYTHON_PKGNAMEPREFIX}filelock>0: sysutils/py-filelock${PYTHON_PKGNAMEPREFIX}huggingface-hub>=1.3.0: ai/py-huggingface-hub${PYTHON_PKGNAMEPREFIX}numpy>=1.16: math/py-numpy${PYTHON_PKGNAMEPREFIX}packaging>=20.0: devel/py-packaging${PYTHON_PKGNAMEPREFIX}pyyaml>=5.1: devel/py-pyyaml${PYTHON_PKGNAMEPREFIX}regex>=2019.12.17: textproc/py-regex${PYTHON_PKGNAMEPREFIX}requests>0: www/py-requests${PYTHON_PKGNAMEPREFIX}safetensors>=0.4.3: ai/py-safetensors${PYTHON_PKGNAMEPREFIX}tokenizers>=0.22: textproc/py-tokenizers${PYTHON_PKGNAMEPREFIX}tqdm>=4.27: misc/py-tqdm${PYTHON_PKGNAMEPREFIX}typer>0: devel/py-typer${PYTHON_PKGNAMEPREFIX}pytorch>=2.1: ai/py-pytorch${PYTHON_PKGNAMEPREFIX}pillow>0: graphics/py-pillow${PYTHON_PKGNAMEPREFIX}torchvision>0: ai/py-torchvision${PYTHON_PKGNAMEPREFIX}librosa>0: audio/py-librosa${PYTHON_PKGNAMEPREFIX}torchaudio>0: ai/py-torchaudio${PYTHON_PKGNAMEPREFIX}fastapi>0: www/py-fastapi${PYTHON_PKGNAMEPREFIX}openai>0: ai/py-openai${PYTHON_PKGNAMEPREFIX}pydantic2>0: devel/py-pydantic2${PYTHON_PKGNAMEPREFIX}starlette>0: www/py-starlette${PYTHON_PKGNAMEPREFIX}uvicorn>0: www/py-uvicorn${PYTHON_PKGNAMEPREFIX}accelerate>=0.26.0: ai/py-accelerate${PYTHON_PKGNAMEPREFIX}blobfile>=0: net/py-blobfile${PYTHON_PKGNAMEPREFIX}codecarbon>=2.8.1: ai/py-codecarbon${PYTHON_PKGNAMEPREFIX}ftfy>=0: textproc/py-ftfy${PYTHON_PKGNAMEPREFIX}NATTEN>=0.14.6: ai/py-NATTEN${PYTHON_PKGNAMEPREFIX}num2words>=0: devel/py-num2words${PYTHON_PKGNAMEPREFIX}optuna>=0: ai/py-optuna${PYTHON_PKGNAMEPREFIX}sagemaker>=2.31.0: ai/py-sagemaker${PYTHON_PKGNAMEPREFIX}sentencepiece>=0.1.91: textproc/py-sentencepiece${PYTHON_PKGNAMEPREFIX}tiktoken>=0: textproc/py-tiktoken${PYTHON_PKGNAMEPREFIX}timm>=1.0.19: ai/py-timm
Test 1
${PYTHON_PKGNAMEPREFIX}parameterized>0: devel/py-parameterized
Build dependencies 1
Run dependencies 32
- ai/py-NATTEN
- ai/py-accelerate
- ai/py-codecarbon
- ai/py-huggingface-hub
- ai/py-openai
- ai/py-optuna
- ai/py-pytorch
- ai/py-safetensors
- ai/py-sagemaker
- ai/py-timm
- ai/py-torchaudio
- ai/py-torchvision
- audio/py-librosa
- devel/py-num2words
- devel/py-packaging
- devel/py-pydantic2
- devel/py-pyyaml
- devel/py-typer
- graphics/py-pillow
- math/py-numpy
- misc/py-tqdm
- net/py-blobfile
- sysutils/py-filelock
- textproc/py-ftfy
- textproc/py-regex
- textproc/py-sentencepiece
- textproc/py-tiktoken
- textproc/py-tokenizers
- www/py-fastapi
- www/py-requests
- www/py-starlette
- www/py-uvicorn
No port depends on this one.
Configuration
No options to configure.
- USES
- python
- Service scripts
- none
Files
distinfo 1
| File | Size | SHA256 |
|---|---|---|
| transformers-5.3.0.tar.gz | 8.830831e+06 | 009555b364029da9e2946d41f1c5de9f15e6b1df46b189b7293f33a161b9c557 |
Master sites 1
- PYPI
Commit history 1
| Date | Commit | Credits | Log message |
|---|---|---|---|
b807d69740 |
Lucas Holt | Add LangChain AI ports and dependencies AI-Assisted-by: OpenAI Codex <[email protected]>
Signed-off-by: Lucas Holt <[email protected]> |