This port has been deleted. This page will exist till another port with the name "py39-tokenizers" comes
into existence.
py39-tokenizers (python/py-tokenizers) Updated: 2 years, 3 months ago Add to my watchlist
Fast and Customizable TokenizersTokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
Version: 0.13.3 License: Apache-2| Maintainers | No Maintainer |
| Categories | python |
| Homepage | https://github.com/huggingface/tokenizers |
| Platforms | darwin |
| Variants |
|
Subport(s) (5)
"py39-tokenizers" depends on
lib (2)
build (10)
Ports that depend on "py39-tokenizers"
run (1)Port Health:
Loading Port Health
Installations (30 days)
0
Requested Installations (30 days)
0
Livecheck error
Error: Port py39-tokenizers not found
last updated: 17 minutes ago