py312-tokenizers (python/py-tokenizers) Updated: 3 months ago Add to my watchlist
Fast and Customizable TokenizersTokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility. Includes BPE, WordPiece, and Unigram tokenizer implementations.
Version: 0.22.2 License: Apache-2
GitHub
Statistics for selected duration
2026-May-16 to 2026-Jun-15
No stats available for this selection.
Try changing the range of days. Alternatively visit statistics page to have an overall look at the submitted statistics.