v 0.5.2 Updated: 10 months, 1 week ago
Fast BPE tokeniser for use with OpenAI's models.
https://github.com/openai/tiktoken