BSD Ports

textproc/py-tiktoken 0.9.0_1 DragonFly

Fast BPE tokeniser for use with OpenAI's models

System
DragonFly
Repository
DPorts
Maintainer
[email protected] (as in FreeBSD)
License
MIT
Categories
python, textproc
Package size
726.2 KiB, 2798.1 KiB installed

Description

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

In the other systems

SystemPortVersion
DragonFlytextproc/py-tiktoken0.9.0_1
FreeBSDtextproc/py-tiktoken0.14.0_2
OpenBSDtextproc/py-tiktoken0.13.0
MidnightBSDtextproc/py-tiktoken0.12.0_6

Install

Binary package:

pkg install py311-tiktoken

From DPorts:

cd /usr/dports/textproc/py-tiktoken && make install clean

Dependencies

Run dependencies 3
Required by 1