textproc/ucto 0.37 FreeBSD
Advanced rule-based (regular-expression) and unicode-aware tokenizer
- System
- FreeBSD
- Repository
- FreeBSD ports
- Maintainer
- [email protected]
- Last update
- Commit
27db5d1e1f- License
- APACHE20
- Categories
- textproc
- Package size
- 175.4 KiB, 686.1 KiB installed
Description
Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation.
Ucto comes with tokenisation rules for several languages and can be easily extended to suit other languages. It has been incorporated for tokenizing Dutch text in Frog, our Dutch morpho-syntactic processor.
In the other systems
| System | Port | Version |
|---|---|---|
| FreeBSD | textproc/ucto | 0.37 |
| DragonFly | textproc/ucto | 0.35_1 |
Install
Binary package:
pkg install ucto
From the ports tree:
cd /usr/ports/textproc/ucto/ && make install clean
To depend on this port in another port's Makefile:
RUN_DEPENDS= ucto>0:textproc/ucto
LIB_DEPENDS= libucto.so:textproc/ucto
Packages
The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.
| Repository | aarch64 | amd64 | armv6 | armv7 | i386 |
|---|---|---|---|---|---|
| FreeBSD:14:latest | 0.37 | 0.37 | 0.25_2 | 0.35_2 | 0.37 |
| FreeBSD:14:quarterly | 0.37 | 0.37 | n/a | 0.35_2 | 0.37 |
| FreeBSD:15:latest | 0.37 | 0.37 | n/a | 0.35_2 | 0.35_2 |
| FreeBSD:15:quarterly | 0.37 | 0.37 | n/a | n/a | n/a |
| FreeBSD:16:latest | 0.37 | 0.37 | n/a | n/a | n/a |
| FreeBSD:16:quarterly | n/a | n/a | n/a | n/a | n/a |
Dependencies
As this port's Makefile names them.
Build 1
uctodata>0: textproc/uctodata
Library 4
libexttextcat-2.0.so: textproc/libexttextcatlibfolia.so: textproc/libfolialibicuio.so: devel/iculibticcutils.so: devel/ticcutils
Runtime 1
uctodata>0: textproc/uctodata
The full lists below include those, and their dependencies in turn.
Build dependencies 12
Run dependencies 9
No port depends on this one.
Configuration
No options to configure.
- USES
- compiler:c++11-lang gmake gnome libedit libtool pathfix pkgconfig readline
- Service scripts
- none
Files
Manual pages 1
- ucto(1)
pkg-plist 12
- bin/ucto
- include/ucto/my_textcat.h
- include/ucto/setting.h
- include/ucto/tokenize.h
- lib/libucto.so
- lib/libucto.so.6
- lib/libucto.so.6.0.0
- libdata/pkgconfig/ucto.pc
- share/man/man1/ucto.1.gz
- share/ucto/textcat.cfg
- share/ucto/textcat_alt.cfg
- share/ucto/textcat_normal.cfg
distinfo 1
| File | Size | SHA256 |
|---|---|---|
| ucto-0.37.tar.gz | 546728 | 5cb678fc2b8c340c29e5bcc49849a2df47c2a2435a4f7b642e5f274377c02e16 |
Master sites 1
- https://github.com/LanguageMachines/ucto/releases/download/v0.37/