BSD Portstextproc/py-tokenizer 3.6.4 FreeBSD
Tokenizer for Icelandic text
- System
- FreeBSD
- Repository
- FreeBSD ports
- Maintainer
- [email protected]
- Last update
- Commit
164723428a- License
- MIT
- Categories
- textproc, python
- Package size
- 128.9 KiB, 648.8 KiB installed
Description
Tokenizer: A tokenizer for Icelandic text
Tokenization is a necessary first step in many natural language processing tasks, such as word counting, parsing, spell checking, corpus generation, and statistical analysis of text.
Install
Binary package:
pkg install py312-tokenizerFrom the ports tree:
cd /usr/ports/textproc/py-tokenizer/ && make install cleanTo depend on this port in another port's Makefile:
RUN_DEPENDS= py312-tokenizer>0:textproc/py-tokenizerPackages
The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.
| Repository | aarch64 | amd64 | armv6 | armv7 | i386 |
|---|---|---|---|---|---|
| FreeBSD:14:latest | 3.6.4 | 3.6.4 | - | 3.5.0_1 | 3.6.4 |
| FreeBSD:14:quarterly | 3.6.4 | 3.6.4 | n/a | - | 3.6.4 |
| FreeBSD:15:latest | 3.6.4 | 3.6.4 | n/a | - | 3.5.0_1 |
| FreeBSD:15:quarterly | 3.6.4 | 3.6.4 | n/a | n/a | n/a |
| FreeBSD:16:latest | 3.6.4 | 3.6.4 | n/a | n/a | n/a |
| FreeBSD:16:quarterly | n/a | n/a | n/a | n/a | n/a |
Dependencies
As this port's Makefile names them.
Build 1
${PYTHON_PKGNAMEPREFIX}wheel>0: devel/py-wheel
The full lists below include those, and their dependencies in turn.
Build dependencies 16
Run dependencies 7
No port depends on this one.
Configuration
No options to configure.
- USES
- python
- Service scripts
- none
Files
distinfo 1
| File | Size | SHA256 |
|---|---|---|
| tokenizer-3.6.4.tar.gz | 135242 | 1bc7423853e0d2e1430ffdff2c1a4048db3aedd480480c7542ecd2ff8d5fcf58 |
Master sites 1
- PYPI