py312-tokenizers (python/py-tokenizers) Updated: 3 weeks, 1 day ago Add to my watchlist
Fast and Customizable TokenizersTokenizers provides an implementation of today's most used tokenizers, with a focus on performance and versatility. Includes BPE, WordPiece, and Unigram tokenizer implementations.
Version: 0.22.2 License: Apache-2
GitHub
31 build(s) found
| Builder | Build Number | Start Time | Elapsed Time | Watcher | Build Status |
|---|---|---|---|---|---|
| 10.14 | 255674 | 2026-04-03 7:06:48 | 0:05:10 | 87735 | build successful |
| 10.15 | 231952 | 2026-04-02 19:39:07 | 0:05:31 | 76810 | build successful |
| 10.13 | 282454 | 2026-04-01 9:35:44 | 0:00:12 | 97035 | failed install-dependencies |
| 10.8 | 232833 | 2026-03-27 5:25:21 | 0:00:09 | 76520 | failed install-dependencies |
| 10.6.x86_64 | 266104 | 2026-03-26 17:09:30 | 0:00:12 | 79128 | failed install-dependencies |
| 10.11 | 316228 | 2026-03-25 23:51:21 | 0:00:16 | 106225 | failed install-dependencies |
| 10.10 | 325475 | 2026-03-25 23:46:44 | 0:00:12 | 105941 | failed install-dependencies |
| 10.11 | 316189 | 2026-03-25 22:19:08 | 0:00:12 | 106213 | failed install-dependencies |
| 10.7 | 247600 | 2026-03-25 17:25:47 | 0:00:16 | 78335 | failed install-dependencies |
| 10.7 | 247566 | 2026-03-25 16:39:07 | 0:00:09 | 78323 | failed install-dependencies |
| 10.6 | 228688 | 2026-03-25 6:02:15 | 0:00:30 | 78979 | failed install-dependencies |
| 10.9 | 333680 | 2026-03-25 3:35:30 | 0:00:08 | 105776 | failed install-dependencies |
| 10.9 | 333664 | 2026-03-25 3:24:08 | 0:00:13 | 105775 | failed install-dependencies |
| 10.12 | 326550 | 2026-03-25 0:36:23 | 0:00:08 | 105033 | failed install-dependencies |
| 10.6 | 228348 | 2026-03-24 6:47:35 | 0:00:33 | 78910 | failed install-dependencies |
| 10.6.x86_64 | 265470 | 2026-03-22 13:21:37 | 0:00:13 | 78864 | failed install-dependencies |
| 10.12 | 326041 | 2026-03-22 3:50:21 | 0:00:10 | 104859 | failed install-dependencies |
| 10.6 | 227881 | 2026-03-22 1:33:58 | 0:00:23 | 78762 | failed install-dependencies |
| 10.8 | 231296 | 2026-03-20 23:54:51 | 0:00:19 | 76115 | failed install-dependencies |
| 10.9 | 331991 | 2026-03-19 22:07:20 | 0:00:09 | 105303 | failed install-dependencies |
| 13.arm64 | 99619 | 2026-03-18 6:13:05 | 0:01:47 | 40569 | build successful |
| 10.12 | 325236 | 2026-03-18 2:38:32 | 0:00:11 | 104538 | failed install-dependencies |
| 10.6.x86_64 | 264478 | 2026-03-17 21:40:01 | 0:00:13 | 78515 | failed install-dependencies |
| 15 | 51306 | 2026-03-17 13:47:54 | 0:01:53 | 16515 | build successful |
| 14.arm64 | 72942 | 2026-03-16 23:35:07 | 0:01:56 | 28662 | build successful |
| 10.6 | 226716 | 2026-03-16 18:01:26 | 0:00:24 | 78431 | failed install-dependencies |
| 10.11 | 314791 | 2026-03-16 15:15:13 | 0:00:08 | 105768 | failed install-dependencies |
| 26.arm64 | 30012 | 2026-03-15 22:49:20 | 0:01:49 | 5444 | build successful |
| 14 | 77898 | 2026-03-15 18:44:07 | 0:01:55 | 29023 | build successful |
| 11 | 203453 | 2026-03-15 16:26:09 | 0:06:31 | 66168 | build successful |
| 15.arm64 | 39053 | 2026-03-15 16:14:39 | 0:01:34 | 15708 | build successful |