CVE and update status of the FreeBSD ports tree3,864 unaddressed CVEs in 671 portsAll times are CET
Port details

textproc/py-tiktoken 0.14.0_2

Fast BPE tokeniser for use with OpenAI's models

Port info

Maintainer
sunpoet@FreeBSD.org
Packages
latest: 0.14.0_2
Upstream
up to date
Last update
to 0.14.0_2 · 9c878207a1
Quarterly
2026Q4: 0.14.0_1
WWW
https://github.com/openai/tiktoken
Links
cgit · VuXML

Install

Package
# pkg install py312-tiktoken
installs 0.14.0_2 from latest; from quarterly (2026Q4) 0.14.0_1
Port
# cd /usr/ports/textproc/py-tiktoken && make install clean
# make -C /usr/ports/textproc/py-tiktoken config  # change options first
Size
840 KiB download · 2.8 MiB installed
Depends on
lang/python312 3.12.15, textproc/py-regex 2026.9.10, www/py-requests 2.34.2
License
MIT
Options
0 of 1 on in the package
Show the 1 options that are off
BLOBFILE

Packages by version and architecture

latest

FreeBSD versionamd64aarch64i386
FreeBSD 160.14.0_20.14.0_1–
FreeBSD 150.14.0_20.14.0_2–
FreeBSD 140.14.0_20.14.0_10.14.0_2

quarterly (2026Q4)

FreeBSD versionamd64aarch64i386
FreeBSD 150.14.0_10.14.0_1–
FreeBSD 140.14.0_10.14.0_10.14.0_1

version as in the ports tree (latest) or the most common one (quarterly) · different version · ✗ not built · – no packages for this platform. Package sets that have not been rebuilt for 60 days are left out.

Unaddressed and VuXML only (0)

No unaddressed CVE and nothing reported by pkg audit for the packaged version 0.14.0_2.

Fixed (0)

No VuXML entries for this package.

Problem reports (0) · open in Bugzilla, most recently changed first

None.

Commits (41)

Mikael Urankar (mikael) · 0.14.0_2
lang/rust: Bump revisions after 1.99.0

PR:		299016
9c878207a1
Mikael Urankar (mikael) · 0.14.0_1
lang/rust: Bump revisions after 1.98.1

PR:		298139
7316461925
Po-Chuan Hsieh (sunpoet) · 0.14.0
textproc/py-tiktoken: Update to 0.14.0

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
1029869395
Mikael Urankar (mikael) · 0.13.0_2
lang/rust: Bump revisions after 1.97.1

PR:		296645
9c892d2601
Mikael Urankar (mikael) · 0.13.0_1
lang/rust: Bump revisions after 1.96.0

PR:		295694
e29b5eeec3
Po-Chuan Hsieh (sunpoet) · 0.13.0
textproc/py-tiktoken: Update to 0.13.0

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
5eb8865629
Mikael Urankar (mikael) · 0.12.0_5
lang/rust: Bump revisions after 1.95.0

PR:		294615
17bf498fd2
Mikael Urankar (mikael) · 0.12.0_4
lang/rust: Bump revisions after 1.94.0

PR:		293615
43f5b4a72f
Mikael Urankar (mikael) · 0.12.0_3
lang/rust: Bump revisions after 1.93.0

PR:		292360
3d631100e8
Mikael Urankar (mikael) · 0.12.0_2
lang/rust: Bump revisions after 1.92.0

PR:		291582
5e496c7707
Mikael Urankar (mikael) · 0.12.0_1
lang/rust: Bump revisions after 1.91.1

PR:		290816
d6b6027df6
Matthias Andree (mandree) · 0.12.0
*: Revise USES=python:... version range constraints

and strip all lower bounds of 3.9 or 3.10 because they are implied now.

python:3.9-X  -> python:-X
python:3.9+   -> python
python:3.10-X -> python:-X
python:3.10+  -> python
(options such as ,build preserved)
1403bb7765
Po-Chuan Hsieh (sunpoet) · 0.12.0
textproc/py-tiktoken: Update to 0.12.0

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
a88fb1ee0c
Mikael Urankar (mikael) · 0.11.0_1
lang/rust: Bump revisions after 1.90.0

PR:		289709
97b5de4ffc
Po-Chuan Hsieh (sunpoet) · 0.11.0
textproc/py-tiktoken: Update to 0.11.0

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
e901c585fb
Mikael Urankar (mikael) · 0.9.0_5
lang/rust: Bump revisions after 1.89.0

PR:		288923
b21956d7db
Mikael Urankar (mikael) · 0.9.0_4
lang/rust: Bump revisions after 1.88.0

PR:		287766
f3f7e555b0
Mikael Urankar (mikael) · 0.9.0_3
lang/rust: Bump revisions after 1.87.0

PR:		286829
3ed29b8185
Mikael Urankar (mikael) · 0.9.0_2
lang/rust: Bump revisions after 1.86.0

PR:		285840
2a5976aebe
Mikael Urankar (mikael) · 0.9.0_1
lang/rust: Bump revisions after 1.85.0

PR:		284884
cf7c4b037d
Po-Chuan Hsieh (sunpoet) · 0.9.0
textproc/py-tiktoken: Update to 0.9.0

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
4830cc4be0
Mikael Urankar (mikael) · 0.8.0_3
lang/rust: Bump revisions after 1.84.0

PR:		283962
fccaa1b326
Mikael Urankar (mikael) · 0.8.0_2
lang/rust: Bump revisions after 1.83.0

PR:		283000
1d1fd15a3e
Mikael Urankar (mikael) · 0.8.0_1
lang/rust: Bump revisions after 1.82.0

PR:		282516
ca048c2884
Po-Chuan Hsieh (sunpoet) · 0.8.0
textproc/py-tiktoken: Update to 0.8.0

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
b9ec26d293
Mikael Urankar (mikael) · 0.7.0_3
lang/rust: Bump revisions after 1.81.0

PR:		281300
89ab81d0e2
Mikael Urankar (mikael) · 0.7.0_2
*/*: remove STRIP_CMD calls in rust based ports

This is not needed after bc4fedc1fec0d359365c04d43be9e32bf101a50e

PR:		246993
Differential Revision:	https://reviews.freebsd.org/D46503
c0d07f1127
Mikael Urankar (mikael) · 0.7.0_2
lang/rust: Bump revisions after 1.80.1

PR:		280490
7a55f95425
Mikael Urankar (mikael) · 0.7.0_1
lang/rust: Bump revisions after 1.79.0

PR:		279707
21476ca8a9
Po-Chuan Hsieh (sunpoet) · 0.7.0
textproc/py-tiktoken: Update to 0.7.0

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
741835f949
Mikael Urankar (mikael) · 0.6.0_2
lang/rust: Bump revisions after 1.78.0

PR:		278834
2322b66100
Mikael Urankar (mikael) · 0.6.0_1
lang/rust: Bump revisions after 1.77.0

PR:		277786
d632fbe55e
Po-Chuan Hsieh (sunpoet) · 0.6.0
textproc/py-tiktoken: Update to 0.6.0

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
4e17347e94
Mikael Urankar (mikael) · 0.5.2_2
lang/rust: Bump revisions after 1.76.0

PR:		276920
7f5a7b0e52
Mikael Urankar (mikael) · 0.5.2_1
lang/rust: Bump revisions after 1.75.0

PR:		276033
109c3d4629
Po-Chuan Hsieh (sunpoet) · 0.5.2
textproc/py-tiktoken: Update to 0.5.2

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
d3c7291cd2
Mikael Urankar (mikael) · 0.5.1_2
lang/rust: Bump revisions after 1.74.1

PR:		275243
b2afd89fb2
Mikael Urankar (mikael) · 0.5.1_1
lang/rust: Bump revisions after 1.73.0

PR:		274499
dd10dc88a7
Po-Chuan Hsieh (sunpoet) · 0.5.1
textproc/py-tiktoken: Update to 0.5.1

Changes:	https://github.com/openai/tiktoken/releases
		https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
227e43a0b0
Mikael Urankar (mikael) · 0.4.0_1
lang/rust: Bump revisions after 1.72.0

PR:		273331
aba8da2be1
Po-Chuan Hsieh (sunpoet) · 0.4.0
textproc/py-tiktoken: Add py-tiktoken 0.4.0

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
6c34be9ab1