py314-sentencepiece (python/py-sentencepiece) Updated: 3 weeks, 1 day ago Add to my watchlist
Python wrapper for sentencepieceSentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.
Version: 0.2.1 License: Apache-2
GitHub
29 build(s) found
| Builder | Build Number | Start Time | Elapsed Time | Watcher | Build Status |
|---|---|---|---|---|---|
| 10.14 | 255686 | 2026-04-03 7:26:49 | 0:00:22 | 87735 | failed install-port |
| 10.15 | 231965 | 2026-04-02 20:00:39 | 0:00:33 | 76810 | failed install-port |
| 11.arm64 | 133170 | 2026-03-30 13:02:19 | 0:00:19 | 51428 | build successful |
| 10.8 | 232845 | 2026-03-27 5:37:12 | 0:00:08 | 76520 | failed install-dependencies |
| 10.6.x86_64 | 266115 | 2026-03-26 17:12:45 | 0:00:07 | 79128 | failed install-dependencies |
| 10.7 | 247578 | 2026-03-25 16:41:27 | 0:00:06 | 78323 | failed install-dependencies |
| 10.6 | 228680 | 2026-03-25 5:37:00 | 0:00:17 | 78977 | failed install-dependencies |
| 12.arm64 | 161794 | 2026-03-24 23:58:01 | 0:00:32 | 54740 | build successful |
| 10.6 | 228341 | 2026-03-24 6:22:19 | 0:00:22 | 78909 | failed install-dependencies |
| 14 | 78740 | 2026-03-22 12:03:13 | 0:00:33 | 29226 | build successful |
| 15 | 52225 | 2026-03-21 19:25:02 | 0:00:36 | 16719 | build successful |
| 14.arm64 | 73460 | 2026-03-21 19:16:10 | 0:00:17 | 28792 | build successful |
| 13.arm64 | 100079 | 2026-03-21 19:09:40 | 0:00:22 | 40765 | build successful |
| 12 | 152510 | 2026-03-21 16:50:52 | 0:01:14 | 55013 | build successful |
| 10.13 | 280873 | 2026-03-21 16:29:40 | 0:01:13 | 96444 | build successful |
| 11 | 204256 | 2026-03-21 16:28:23 | 0:01:39 | 66433 | build successful |
| 10.15 | 230588 | 2026-03-21 16:28:02 | 0:01:16 | 76169 | failed install-port |
| 10.6 | 227677 | 2026-03-21 16:24:16 | 0:00:12 | 78713 | failed install-dependencies |
| 10.11 | 315516 | 2026-03-21 16:23:49 | 0:01:29 | 105937 | build successful |
| 10.10 | 324360 | 2026-03-21 16:20:31 | 0:01:28 | 105638 | build successful |
| 10.12 | 325863 | 2026-03-21 16:18:56 | 0:01:40 | 104794 | build successful |
| 10.14 | 253680 | 2026-03-21 16:18:14 | 0:01:20 | 87044 | failed install-port |
| 10.6.x86_64 | 265254 | 2026-03-21 16:17:50 | 0:00:13 | 78789 | failed install-dependencies |
| 10.8 | 231675 | 2026-03-21 16:17:25 | 0:00:12 | 76158 | failed install-dependencies |
| 10.9 | 332770 | 2026-03-21 16:16:10 | 0:01:43 | 105531 | build successful |
| 10.7 | 246560 | 2026-03-21 16:16:10 | 0:00:12 | 78044 | failed install-dependencies |
| 15.arm64 | 39837 | 2026-03-21 16:13:13 | 0:00:19 | 15881 | build successful |
| 26.arm64 | 30663 | 2026-03-21 16:12:28 | 0:00:27 | 5617 | build successful |
| 13 | 105101 | 2026-03-21 16:12:12 | 0:00:39 | 40688 | build successful |