BSD Portsai/py-datasets 5.0.0_1 MidnightBSD
HuggingFace community-driven open-source library of datasets
- System
- MidnightBSD
- Repository
- mports
- Maintainer
- [email protected]
- Last update
- Commit
d31e6c7450- License
- mit
- Categories
- ai, python
Description
Datasets is a library for easily accessing and sharing datasets for Audio, Computer Vision, and Natural Language Processing (NLP) tasks.
Load a dataset in a single line of code, and use our powerful data processing methods to quickly get your dataset ready for training in a deep learning model. Backed by the Apache Arrow format, process large datasets with zero-copy reads without any memory constraints for optimal speed and efficiency. We also feature a deep integration with the Hugging Face Hub, allowing you to easily load and share a dataset with the wider machine learning community.
Install
Binary package:
mport install ${PYTHON_PKGNAMEPREFIX}datasetsFrom mports:
cd /usr/mports/ai/py-datasets && make install cleanTo depend on this port in another port's Makefile:
RUN_DEPENDS= ${PYTHON_PKGNAMEPREFIX}datasets>0:ai/py-datasetsDependencies
As this port's Makefile names them.
Build 2
${PYTHON_PKGNAMEPREFIX}pyproject-hooks>0: devel/py-pyproject-hooks${PYTHON_PKGNAMEPREFIX}wheel>0: devel/py-wheel
Runtime 17
${PYTHON_PKGNAMEPREFIX}aiohttp>0: www/py-aiohttp${PYTHON_PKGNAMEPREFIX}dill>0.3.0: devel/py-dill${PYTHON_PKGNAMEPREFIX}filelock>0: sysutils/py-filelock${PYTHON_PKGNAMEPREFIX}fsspec>=2023.1.0: filesystems/py-fsspec${PYTHON_PKGNAMEPREFIX}httpx>0: www/py-httpx${PYTHON_PKGNAMEPREFIX}huggingface-hub>=0.25.0: ai/py-huggingface-hub${PYTHON_PKGNAMEPREFIX}multiprocess>0: devel/py-multiprocess${PYTHON_PKGNAMEPREFIX}numpy>=1.17: math/py-numpy${PYTHON_PKGNAMEPREFIX}packaging>0: devel/py-packaging${PYTHON_PKGNAMEPREFIX}pandas>0: math/py-pandas${PYTHON_PKGNAMEPREFIX}pyarrow>=21.0.0: databases/py-pyarrow${PYTHON_PKGNAMEPREFIX}pyyaml>=5.1: devel/py-pyyaml${PYTHON_PKGNAMEPREFIX}requests>=2.32.2: www/py-requests${PYTHON_PKGNAMEPREFIX}tqdm>=4.66.3: misc/py-tqdm${PYTHON_PKGNAMEPREFIX}xxhash>0: devel/py-xxhash${PYTHON_PKGNAMEPREFIX}torchcodec>=0.6.0: multimedia/py-torchcodec${PYTHON_PKGNAMEPREFIX}pytorch>=2.8.0: ai/py-pytorch
Test 18
${PYTHON_PKGNAMEPREFIX}absl-py>=0: devel/py-absl-py${PYTHON_PKGNAMEPREFIX}elasticsearch>0: textproc/py-elasticsearch${PYTHON_PKGNAMEPREFIX}faiss>=1.6.4: math/py-faiss${PYTHON_PKGNAMEPREFIX}jax>=0.3.14: math/py-jax${PYTHON_PKGNAMEPREFIX}jiwer>0: misc/py-jiwer${PYTHON_PKGNAMEPREFIX}joblib>=1.3.0: devel/py-joblib${PYTHON_PKGNAMEPREFIX}lz4>=0: archivers/py-lz4${PYTHON_PKGNAMEPREFIX}polars>=0.20.0: misc/py-polars${PYTHON_PKGNAMEPREFIX}protobuf>=4.0.0: devel/py-protobuf${PYTHON_PKGNAMEPREFIX}pytest-datadir>=0: devel/py-pytest-datadir${PYTHON_PKGNAMEPREFIX}pytest-xdist>=0: devel/py-pytest-xdist${PYTHON_PKGNAMEPREFIX}pytest>=0: devel/py-pytest${PYTHON_PKGNAMEPREFIX}pytorch>=2.0.0: ai/py-pytorch${PYTHON_PKGNAMEPREFIX}rarfile>=4.0: archivers/py-rarfile${PYTHON_PKGNAMEPREFIX}s3fs>=2021.11.1: filesystems/py-s3fs${PYTHON_PKGNAMEPREFIX}tiktoken>=0: textproc/py-tiktoken${PYTHON_PKGNAMEPREFIX}typing-extensions>=4.6.1: devel/py-typing-extensions${PYTHON_PKGNAMEPREFIX}zstandard>=0: archivers/py-zstandard
Build dependencies 2
Run dependencies 17
Required by 1
Configuration
No options to configure.
- USES
- python
- Service scripts
- none
Files
distinfo 1
| File | Size | SHA256 |
|---|---|---|
| datasets-5.0.0.tar.gz | 631708 | 83dbbbdb07a33b82192b8c419deb18739b138ee2ce1a322d55ce6b100954ec1a |
Master sites 1
- PYPI