py312-sentencepiece (python/py-sentencepiece) Updated: 1 week, 6 days ago Add to my watchlist
Python wrapper for sentencepieceSentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.
Version: 0.2.1 License: Apache-2
GitHub
68 build(s) found
| Builder | Build Number | Start Time | Elapsed Time | Watcher | Build Status |
|---|---|---|---|---|---|
| 10.14 | 255672 | 2026-04-03 7:04:53 | 0:00:22 | 87735 | failed install-port |
| 10.15 | 231950 | 2026-04-02 19:37:22 | 0:00:27 | 76810 | failed install-port |
| 11.arm64 | 133168 | 2026-03-30 13:01:32 | 0:00:20 | 51428 | build successful |
| 10.8 | 232832 | 2026-03-27 5:25:12 | 0:00:08 | 76520 | failed install-dependencies |
| 10.6.x86_64 | 266103 | 2026-03-26 17:09:21 | 0:00:07 | 79128 | failed install-dependencies |
| 10.7 | 247565 | 2026-03-25 16:38:57 | 0:00:07 | 78323 | failed install-dependencies |
| 10.6 | 228665 | 2026-03-25 5:28:26 | 0:00:16 | 78977 | failed install-dependencies |
| 12.arm64 | 161792 | 2026-03-24 23:56:59 | 0:00:29 | 54740 | build successful |
| 10.6 | 228329 | 2026-03-24 6:11:58 | 0:01:03 | 78909 | failed install-dependencies |
| 14 | 78738 | 2026-03-22 12:02:05 | 0:00:32 | 29226 | build successful |
| 15 | 52223 | 2026-03-21 19:23:50 | 0:00:35 | 16719 | build successful |
| 14.arm64 | 73458 | 2026-03-21 19:15:15 | 0:00:35 | 28792 | build successful |
| 13.arm64 | 100077 | 2026-03-21 19:08:55 | 0:00:21 | 40765 | build successful |
| 12 | 152508 | 2026-03-21 16:47:53 | 0:01:31 | 55013 | build successful |
| 10.13 | 280877 | 2026-03-21 16:35:52 | 0:01:00 | 96444 | build successful |
| 10.11 | 315520 | 2026-03-21 16:29:41 | 0:00:59 | 105937 | build successful |
| 10.10 | 324364 | 2026-03-21 16:27:32 | 0:01:09 | 105638 | build successful |
| 10.12 | 325867 | 2026-03-21 16:25:33 | 0:01:06 | 104794 | build successful |
| 10.15 | 230586 | 2026-03-21 16:25:14 | 0:01:27 | 76169 | failed install-port |
| 11 | 204254 | 2026-03-21 16:24:42 | 0:01:52 | 66433 | build successful |
| 10.6 | 227675 | 2026-03-21 16:23:49 | 0:00:13 | 78713 | failed install-dependencies |
| 10.9 | 332774 | 2026-03-21 16:23:41 | 0:01:13 | 105531 | build successful |
| 10.14 | 253684 | 2026-03-21 16:22:29 | 0:01:08 | 87044 | failed install-port |
| 10.6.x86_64 | 265258 | 2026-03-21 16:19:07 | 0:00:10 | 78789 | failed install-dependencies |
| 10.8 | 231679 | 2026-03-21 16:18:27 | 0:00:16 | 76158 | failed install-dependencies |
| 10.7 | 246564 | 2026-03-21 16:16:57 | 0:00:07 | 78044 | failed install-dependencies |
| 13 | 105105 | 2026-03-21 16:14:25 | 0:00:40 | 40688 | build successful |
| 15.arm64 | 39841 | 2026-03-21 16:14:22 | 0:00:17 | 15881 | build successful |
| 26.arm64 | 30667 | 2026-03-21 16:14:03 | 0:00:22 | 5617 | build successful |
| 10.14 | 250827 | 2026-02-04 20:09:44 | 0:00:33 | 86009 | failed install-port |
| 10.6.x86_64 | 260342 | 2026-02-04 18:26:46 | 0:00:07 | 77400 | failed install-dependencies |
| 10.6 | 223122 | 2026-02-04 13:42:02 | 0:00:10 | 77332 | failed install-dependencies |
| 10.15 | 227634 | 2026-02-04 10:50:50 | 0:02:32 | 75131 | failed install-port |
| 10.14 | 245909 | 2025-11-26 20:12:52 | 0:00:50 | 84089 | failed install-port |
| 10.15 | 222653 | 2025-11-26 19:48:12 | 0:01:05 | 73202 | failed install-port |
| 10.6.x86_64 | 252815 | 2025-11-26 19:44:23 | 0:00:05 | 75435 | failed install-dependencies |
| 10.6 | 215716 | 2025-11-26 19:43:56 | 0:00:07 | 75369 | failed install-dependencies |
| 26.arm64 | 5171 | 2025-09-21 23:01:20 | 0:00:23 | 249 | build successful |
| 11.arm64 | 121319 | 2025-09-11 14:28:57 | 0:00:31 | 46323 | build successful |
| 10.14 | 239608 | 2025-08-20 9:58:51 | 0:01:02 | 81515 | failed install-port |
| 10.6 | 207900 | 2025-08-19 11:08:14 | 0:00:14 | 72726 | failed install-dependencies |
| 10.6 | 207869 | 2025-08-19 10:31:23 | 0:00:15 | 72725 | failed install-dependencies |
| 10.6.x86_64 | 244575 | 2025-08-19 4:14:26 | 0:00:04 | 72787 | failed install-dependencies |
| 10.15 | 216080 | 2025-08-19 0:44:49 | 0:01:11 | 70588 | failed install-port |
| 15.arm64 | 10367 | 2025-03-09 11:53:54 | 0:00:18 | 5429 | build successful |
| 15 | 9761 | 2024-10-10 20:34:18 | 0:00:15 | 879 | build successful |
| 10.15 | 193009 | 2024-08-07 4:43:41 | 0:01:23 | 59763 | failed install-port |
| 10.14 | 216006 | 2024-08-07 3:26:52 | 0:01:00 | 70695 | failed install-port |
| 10.6 | 177177 | 2024-08-07 3:01:29 | 0:00:10 | 61705 | failed install-dependencies |
| 10.6.x86_64 | 212805 | 2024-08-07 2:40:11 | 0:00:11 | 61750 | failed install-dependencies |
| 14 | 33304 | 2024-03-23 17:24:39 | 0:01:20 | 7297 | build successful |
| 10.7 | 181923 | 2024-03-23 16:30:45 | 0:00:59 | 56220 | build successful |
| 12.arm64 | 121401 | 2024-03-23 4:04:10 | 0:00:20 | 33224 | build successful |
| 12 | 101074 | 2024-03-23 2:56:00 | 0:01:31 | 33240 | build successful |
| 10.14 | 200107 | 2024-03-23 0:58:04 | 0:01:06 | 65507 | failed install-port |
| 13.arm64 | 53654 | 2024-03-22 23:58:24 | 0:00:20 | 18855 | build successful |
| 13 | 64719 | 2024-03-22 23:46:35 | 0:01:36 | 19116 | build successful |
| 10.11 | 256053 | 2024-03-22 22:58:38 | 0:01:16 | 83913 | build successful |
| 11 | 147339 | 2024-03-22 22:58:05 | 0:01:45 | 44426 | build successful |
| 10.13 | 225393 | 2024-03-22 22:51:18 | 0:01:52 | 74756 | build successful |
| 10.15 | 176427 | 2024-03-22 22:46:52 | 0:01:18 | 54499 | failed install-port |
| 10.8 | 169241 | 2024-03-22 22:10:57 | 0:01:17 | 54281 | build successful |
| 10.12 | 265450 | 2024-03-22 22:00:43 | 0:01:09 | 82698 | build successful |
| 10.10 | 261055 | 2024-03-22 21:53:50 | 0:01:15 | 83804 | build successful |
| 10.9 | 268224 | 2024-03-22 21:38:00 | 0:01:07 | 83489 | build successful |
| 10.6 | 158277 | 2024-03-22 21:20:06 | 0:00:15 | 56443 | failed install-dependencies |
| 10.6.x86_64 | 193994 | 2024-03-22 21:19:12 | 0:00:12 | 56491 | failed install-dependencies |
| 14.arm64 | 21328 | 2024-03-22 20:49:42 | 0:00:21 | 6969 | build successful |