py314-tokenizers (python/py-tokenizers) Updated: 3 weeks, 1 day ago Add to my watchlist
Fast and Customizable TokenizersTokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility. Includes BPE, WordPiece, and Unigram tokenizer implementations.
Version: 0.22.2 License: Apache-2
GitHub
31 build(s) found
| Builder | Build Number | Start Time | Elapsed Time | Watcher | Build Status |
|---|---|---|---|---|---|
| 10.14 | 255688 | 2026-04-03 7:28:09 | 0:05:10 | 87735 | build successful |
| 10.15 | 231967 | 2026-04-02 20:02:25 | 0:05:17 | 76810 | build successful |
| 10.13 | 282466 | 2026-04-01 9:44:58 | 0:00:12 | 97035 | failed install-dependencies |
| 10.8 | 232846 | 2026-03-27 5:37:21 | 0:00:09 | 76520 | failed install-dependencies |
| 10.6.x86_64 | 266116 | 2026-03-26 17:12:53 | 0:00:12 | 79128 | failed install-dependencies |
| 10.10 | 325490 | 2026-03-25 23:56:01 | 0:00:10 | 105941 | failed install-dependencies |
| 10.11 | 316232 | 2026-03-25 23:54:05 | 0:00:16 | 106225 | failed install-dependencies |
| 10.11 | 316206 | 2026-03-25 22:29:03 | 0:00:11 | 106213 | failed install-dependencies |
| 10.7 | 247610 | 2026-03-25 17:32:33 | 0:00:10 | 78335 | failed install-dependencies |
| 10.7 | 247579 | 2026-03-25 16:41:34 | 0:00:08 | 78323 | failed install-dependencies |
| 10.6 | 228693 | 2026-03-25 6:12:40 | 0:00:21 | 78979 | failed install-dependencies |
| 10.9 | 333684 | 2026-03-25 3:41:00 | 0:00:14 | 105776 | failed install-dependencies |
| 10.9 | 333677 | 2026-03-25 3:32:12 | 0:00:08 | 105775 | failed install-dependencies |
| 10.12 | 326563 | 2026-03-25 0:38:59 | 0:00:08 | 105033 | failed install-dependencies |
| 10.6 | 228353 | 2026-03-24 7:00:00 | 0:00:23 | 78910 | failed install-dependencies |
| 10.6.x86_64 | 265459 | 2026-03-22 13:18:45 | 0:00:13 | 78864 | failed install-dependencies |
| 10.12 | 326033 | 2026-03-22 3:49:05 | 0:00:13 | 104859 | failed install-dependencies |
| 10.6 | 227866 | 2026-03-22 1:21:32 | 0:00:21 | 78762 | failed install-dependencies |
| 10.8 | 231299 | 2026-03-20 23:56:36 | 0:00:11 | 76115 | failed install-dependencies |
| 10.9 | 331994 | 2026-03-19 22:09:10 | 0:00:09 | 105303 | failed install-dependencies |
| 13.arm64 | 99622 | 2026-03-18 6:18:20 | 0:01:41 | 40569 | build successful |
| 10.12 | 325240 | 2026-03-18 2:42:05 | 0:00:11 | 104538 | failed install-dependencies |
| 10.6.x86_64 | 264482 | 2026-03-17 21:43:38 | 0:00:11 | 78515 | failed install-dependencies |
| 15 | 51309 | 2026-03-17 13:52:41 | 0:01:56 | 16515 | build successful |
| 14.arm64 | 72946 | 2026-03-16 23:40:32 | 0:02:00 | 28662 | build successful |
| 10.6 | 226720 | 2026-03-16 18:05:54 | 0:00:22 | 78431 | failed install-dependencies |
| 10.11 | 314794 | 2026-03-16 15:17:13 | 0:00:10 | 105768 | failed install-dependencies |
| 26.arm64 | 30015 | 2026-03-15 22:54:11 | 0:01:34 | 5444 | build successful |
| 14 | 77901 | 2026-03-15 18:49:28 | 0:01:58 | 29023 | build successful |
| 15.arm64 | 39049 | 2026-03-15 16:09:21 | 0:01:50 | 15708 | build successful |
| 11 | 203449 | 2026-03-15 16:03:30 | 0:08:13 | 66168 | build successful |