This port has been deleted. This page will exist till another port with the name "py39-tokenizers" comes
into existence.
py39-tokenizers (python/py-tokenizers) Updated: 3 years, 1 month ago Add to my watchlist
Fast and Customizable TokenizersTokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
Version: 0.13.3 License: Apache-2Statistics for selected duration
2026-Aug-28 to 2026-Sep-27
No stats available for this selection.
Try changing the range of days. Alternatively visit statistics page to have an overall look at the submitted statistics.