py39-tokenizers (python/py-tokenizers) Updated: 3 months, 1 week ago Add to my watchlist

Fast and Customizable Tokenizers

🤗 Tokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

Version: 0.12.1 License: Apache-2 GitHub
Displaying statistics for 773 users who made submissions during: until

Statistics for selected duration

2022-Oct-31 to 2022-Nov-30

Total Installations 3
Requested Installations 1

macOS Versions

Loading Chart

Port Versions

Loading Chart

Xcode Versions

Loading Chart

CLT Versions

Loading Chart

Variants table

Variants Count

Monthly Statistics

Can remain cached for up to 24 hours