misc/py-datasets 5.1.0 FreeBSD

HuggingFace community-driven open-source library of datasets

System: FreeBSD
Repository: FreeBSD ports
Maintainer: [email protected]
Last update: 2026-10-15
Commit: 19f4c0fde1
License: MIT
Categories: misc, python
Package size: 937.1 KiB, 6735.4 KiB installed

Description

Datasets is a library for easily accessing and sharing datasets for Audio, Computer Vision, and Natural Language Processing (NLP) tasks.

Load a dataset in a single line of code, and use our powerful data processing methods to quickly get your dataset ready for training in a deep learning model. Backed by the Apache Arrow format, process large datasets with zero-copy reads without any memory constraints for optimal speed and efficiency. We also feature a deep integration with the Hugging Face Hub, allowing you to easily load and share a dataset with the wider machine learning community.

Install

Binary package:

pkg install py312-datasets

From the ports tree:

cd /usr/ports/misc/py-datasets/ && make install clean

To depend on this port in another port's Makefile:

RUN_DEPENDS=	py312-datasets>0:misc/py-datasets

Packages

The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.

Repository	aarch64	amd64	armv6	armv7	i386
FreeBSD:14:latest	5.0.1	5.0.1	-	-	-
FreeBSD:14:quarterly	5.0.1	5.0.1	n/a	-	-
FreeBSD:15:latest	5.0.1	5.1.0	n/a	-	-
FreeBSD:15:quarterly	5.0.1	5.0.1	n/a	n/a	n/a
FreeBSD:16:latest	-	5.1.0	n/a	n/a	n/a
FreeBSD:16:quarterly	n/a	n/a	n/a	n/a	n/a

Dependencies

As this port's Makefile names them.

Build 2

${PYTHON_PKGNAMEPREFIX}pyproject-hooks>0 : devel/py-pyproject-hooks
${PYTHON_PKGNAMEPREFIX}wheel>0 : devel/py-wheel

Runtime 15

${PYTHON_PKGNAMEPREFIX}aiohttp>0 : www/py-aiohttp
${PYTHON_PKGNAMEPREFIX}dill>0.3.0 : devel/py-dill
${PYTHON_PKGNAMEPREFIX}filelock>0 : sysutils/py-filelock
${PYTHON_PKGNAMEPREFIX}fsspec>=2023.1.0 : filesystems/py-fsspec
${PYTHON_PKGNAMEPREFIX}huggingface-hub>=1.31.0 : misc/py-huggingface-hub
${PYTHON_PKGNAMEPREFIX}multiprocess>0 : devel/py-multiprocess
${PYTHON_PKGNAMEPREFIX}numpy>=1.17 : math/py-numpy
${PYTHON_PKGNAMEPREFIX}packaging>0 : devel/py-packaging
${PYTHON_PKGNAMEPREFIX}pandas>0 : math/py-pandas
${PYTHON_PKGNAMEPREFIX}pyarrow>=24.0.0 : databases/py-pyarrow
${PYTHON_PKGNAMEPREFIX}pyyaml>=5.1 : devel/py-pyyaml
${PYTHON_PKGNAMEPREFIX}tqdm>=4.66.3 : misc/py-tqdm
${PYTHON_PKGNAMEPREFIX}xxhash>0 : devel/py-xxhash
${PYTHON_PKGNAMEPREFIX}torchcodec>=0.6.0 : multimedia/py-torchcodec
${PYTHON_PKGNAMEPREFIX}pytorch>=2.8.0 : misc/py-pytorch

Test 18

${PYTHON_PKGNAMEPREFIX}absl-py>=0 : devel/py-absl-py
${PYTHON_PKGNAMEPREFIX}elasticsearch>0 : textproc/py-elasticsearch
${PYTHON_PKGNAMEPREFIX}faiss>=1.6.4 : math/py-faiss
${PYTHON_PKGNAMEPREFIX}jax>=0.3.14 : math/py-jax
${PYTHON_PKGNAMEPREFIX}jiwer>0 : misc/py-jiwer
${PYTHON_PKGNAMEPREFIX}joblib>=1.3.0 : devel/py-joblib
${PYTHON_PKGNAMEPREFIX}lz4>=0 : archivers/py-lz4
${PYTHON_PKGNAMEPREFIX}polars>=0.20.0 : misc/py-polars
${PYTHON_PKGNAMEPREFIX}protobuf>=4.0.0 : devel/py-protobuf
${PYTHON_PKGNAMEPREFIX}pytest-datadir>=0 : devel/py-pytest-datadir
${PYTHON_PKGNAMEPREFIX}pytest-xdist>=0 : devel/py-pytest-xdist
${PYTHON_PKGNAMEPREFIX}pytest>=0 : devel/py-pytest
${PYTHON_PKGNAMEPREFIX}pytorch>=2.0.0 : misc/py-pytorch
${PYTHON_PKGNAMEPREFIX}rarfile>=4.0 : archivers/py-rarfile
${PYTHON_PKGNAMEPREFIX}s3fs>=2021.11.1 : filesystems/py-s3fs
${PYTHON_PKGNAMEPREFIX}tiktoken>=0 : textproc/py-tiktoken
${PYTHON_PKGNAMEPREFIX}typing-extensions>=4.6.1 : devel/py-typing-extensions
${PYTHON_PKGNAMEPREFIX}zstandard>=0 : archivers/py-zstandard

The full lists below include those, and their dependencies in turn.

Build dependencies 16

Run dependencies 312

The first 100 are listed.

Required by 4

Configuration

No options to configure.

USES: python
Service scripts: none

Files

distinfo 1

File

Size

SHA256

datasets-5.1.0.tar.gz

687306

1561347daa8841b51351ef2ad1647b4ee4af406852c0f7bd1df587ac1ca7888e

Master sites 1

PYPI

Commit history 2

Date Commit Credits Log message

2026-10-15 19f4c0fde1 Yuri Victorovich misc/py-datasets: update 5.0.1 → 5.1.0

2026-07-30 149dc78e01 Yuri Victorovich misc/py-datasets: update 5.0.0 → 5.0.1