py314-tokenizers (python/py-tokenizers) Updated: 1 month, 2 weeks ago Add to my watchlist

Fast and Customizable Tokenizers

Tokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility. Includes BPE, WordPiece, and Unigram tokenizer implementations.

Version: 0.22.2 License: Apache-2 GitHub
Displaying statistics for 1,254 users who made submissions during: until

Statistics for selected duration

2026-Mar-30 to 2026-Apr-29


Total Installations 1
Requested Installations 0


macOS Versions

Loading Chart

Port Versions

Loading Chart



Xcode Versions

Loading Chart

CLT Versions

Loading Chart



Variants table

Variants Count


Monthly Statistics

Can remain cached for up to 24 hours










Quick Links:
MacPorts
Port Information was updated:
2 hours ago
89f00e82

Most recent build (in app's database) ran:
2 hours ago

Latest stats submission was received:
6 minutes ago