BSD Ports

py312-tokenizers in 6 systems

Fast state-of-the-art tokenizers optimized for research and production

py312-tokenizers is packaged for FreeBSD, OpenBSD, DragonFly, MidnightBSD, HardenedBSD and GhostBSD. The newest version among them is 0.23.3, as upstream numbers it: the revision each tree adds (_1 and ,1 in FreeBSD's family, p0 in OpenBSD, nb2 in pkgsrc) is left out when versions are compared.

SystemPortVersionVulnerabilitiesStatusMaintainerLast update
FreeBSDtextproc/py-tokenizers0.23.3_1 newestnone known-[email protected]2026-10-14
OpenBSDtextproc/py-tokenizers0.23.1p0 behind since 2026-09-04no data-The OpenBSD ports mailing-list <[email protected]>2026-10-15
DragonFlytextproc/py-tokenizers0.23.2_1 behind since 2026-10-11none known-[email protected]-
MidnightBSDtextproc/py-tokenizers0.23.3_1 newestno data-[email protected]2026-11-18
HardenedBSDtextproc/py-tokenizers0.23.3_1 newestno data-[email protected]-
GhostBSDtextproc/py-tokenizers0.23.3_1 newestno data-[email protected]-

“No data” means the system has no list of vulnerabilities per port that this site reads (OpenBSD and MidnightBSD), not that the port has none. A status is what the port's Makefile declares (DEPRECATED, BROKEN, EXPIRATION_DATE), read in the trees whose Makefiles this site reads: FreeBSD's and MidnightBSD's. A row without a link is a derivative's port that is FreeBSD's, listed on FreeBSD's page.