py37-tokenizers
v 0.13.3
Updated: 3 years ago
Fast and Customizable Tokenizers
Tokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
Tokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
https://github.com/huggingface/tokenizers
This port has been deleted. This page will exist till another port with the name "py37-tokenizers" comes
into existence.
| Installations |
0 |
| Requested Installations |
0 |