BSD Ports

textproc/ucto 0.37 FreeBSD

Advanced rule-based (regular-expression) and unicode-aware tokenizer

System
FreeBSD
Repository
FreeBSD ports
Maintainer
[email protected]
Last update
Commit
27db5d1e1f
License
APACHE20
Categories
textproc
Package size
175.4 KiB, 686.1 KiB installed

Description

Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation.

Ucto comes with tokenisation rules for several languages and can be easily extended to suit other languages. It has been incorporated for tokenizing Dutch text in Frog, our Dutch morpho-syntactic processor.

In the other systems

SystemPortVersion
FreeBSDtextproc/ucto0.37
DragonFlytextproc/ucto0.35_1

Install

Binary package:

pkg install ucto

From the ports tree:

cd /usr/ports/textproc/ucto/ && make install clean

To depend on this port in another port's Makefile:

RUN_DEPENDS=	ucto>0:textproc/ucto
LIB_DEPENDS=	libucto.so:textproc/ucto

Packages

The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.

Repositoryaarch64amd64armv6armv7i386
FreeBSD:14:latest0.370.370.25_20.35_20.37
FreeBSD:14:quarterly0.370.37n/a0.35_20.37
FreeBSD:15:latest0.370.37n/a0.35_20.35_2
FreeBSD:15:quarterly0.370.37n/an/an/a
FreeBSD:16:latest0.370.37n/an/an/a
FreeBSD:16:quarterlyn/an/an/an/an/a

Dependencies

As this port's Makefile names them.

Build 1

Library 4

Runtime 1

The full lists below include those, and their dependencies in turn.

Build dependencies 12
Run dependencies 9

No port depends on this one.

Configuration

No options to configure.

USES
compiler:c++11-lang gmake gnome libedit libtool pathfix pkgconfig readline
Service scripts
none

Files

Manual pages 1
  • ucto(1)
pkg-plist 12
  • bin/ucto
  • include/ucto/my_textcat.h
  • include/ucto/setting.h
  • include/ucto/tokenize.h
  • lib/libucto.so
  • lib/libucto.so.6
  • lib/libucto.so.6.0.0
  • libdata/pkgconfig/ucto.pc
  • share/man/man1/ucto.1.gz
  • share/ucto/textcat.cfg
  • share/ucto/textcat_alt.cfg
  • share/ucto/textcat_normal.cfg
distinfo 1
FileSizeSHA256
ucto-0.37.tar.gz5467285cb678fc2b8c340c29e5bcc49849a2df47c2a2435a4f7b642e5f274377c02e16
Master sites 1
  • https://github.com/LanguageMachines/ucto/releases/download/v0.37/

Commit history 1

DateCommitCreditsLog message
27db5d1e1f Yuri Victorovich textproc/ucto: update 0.36 → 0.37