CVE and update status of the FreeBSD ports tree3,864 unaddressed CVEs in 671 portsAll times are CET
Port details

textproc/py-tokenizer 3.6.4

Tokenizer for Icelandic text

Port info

Maintainer
otis@FreeBSD.org
Packages
latest: 3.6.4
Upstream
Higher version available: 3.7.0
Last update
to 3.6.4 · 164723428a
Quarterly
2026Q4: 3.6.4
WWW
https://github.com/mideind/Tokenizer
Links
cgit · VuXML

Install

Package
# pkg install py312-tokenizer
installs 3.6.4 from latest; from quarterly (2026Q4) 3.6.4
Port
# cd /usr/ports/textproc/py-tokenizer && make install clean
Size
129 KiB download · 649 KiB installed
Depends on
lang/python312 3.12.15
License
MIT

Packages by version and architecture

latest

FreeBSD versionamd64aarch64i386
FreeBSD 163.6.43.6.4–
FreeBSD 153.6.43.6.4–
FreeBSD 143.6.43.6.43.6.4

quarterly (2026Q4)

FreeBSD versionamd64aarch64i386
FreeBSD 153.6.43.6.4–
FreeBSD 143.6.43.6.43.6.4

version as in the ports tree (latest) or the most common one (quarterly) · different version · ✗ not built · – no packages for this platform. Package sets that have not been rebuilt for 60 days are left out.

Unaddressed and VuXML only (0)

No unaddressed CVE and nothing reported by pkg audit for the packaged version 3.6.4.

Fixed (0)

No VuXML entries for this package.

Problem reports (0) · open in Bugzilla, most recently changed first

None.

Commits (5)

Juraj Lutter (otis) · 3.6.4
textproc/py-tokenizer: Fix build

Reported by:	pkg-fallout
164723428a
Juraj Lutter (otis) · 3.6.4
textproc/py-tokenizer: Update to 3.6.4
123b41dfb7
Juraj Lutter (otis) · 3.5.2
textproc/py-tokenizer: Update to 3.5.2

Release notes:	https://github.com/mideind/Tokenizer/releases/tag/v3.5.2
af0161411a
Juraj Lutter (otis) · 3.5.0_1
textproc/py-tokenizer: Correct pkg-descr

A text for different package has slipped through and made it
to pkg-descr of this package.

Put the correct description instead.
2d8be352aa
Juraj Lutter (otis) · 3.5.0
textproc/py-tokenizer: Add new port

Add textproc/py-tokenizer, a tokenizer for Icelandic text.
6259f7882a