py312-tiktoken (python/py-tiktoken) Updated: 10 months, 1 week ago Add to my watchlist

Fast BPE tokeniser for use with OpenAI's models.
Version: 0.5.2 License: MIT GitHub
Maintainers mrdomino
Categories devel python
Homepage https://github.com/openai/tiktoken
Platforms darwin
Variants
  • universal (Build for multiple architectures)

Subport(s) (2)


"py312-tiktoken" depends on

lib (4)
build (9)
test (2)

Ports that depend on "py312-tiktoken"



Port Health:

Loading Port Health

Installations (30 days)

0

Requested Installations (30 days)

0