py-sentencepiece (python/py-sentencepiece) Updated: 7 months, 2 weeks ago Add to my watchlist
Python wrapper for sentencepieceSentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.
Version: 0.2.0 License: Apache-2
GitHub
71 build(s) found
| Builder | Build Number | Start Time | Elapsed Time | Watcher | Build Status |
|---|---|---|---|---|---|
| 14.arm64 | 21331 | 2024-03-22 20:52:28 | 0:00:10 | 6969 | build successful |
| 12 | 71835 | 2023-06-02 3:37:36 | 0:00:31 | 22051 | build successful |
| 10.11 | 224346 | 2023-06-02 2:25:09 | 0:00:47 | 72709 | build successful |
| 10.9 | 233818 | 2023-06-02 1:15:24 | 0:00:31 | 72282 | build successful |
| 10.14 | 168704 | 2023-06-02 1:13:46 | 0:00:14 | 54346 | build successful |
| 10.8 | 136401 | 2023-06-02 0:53:26 | 0:00:23 | 43068 | build successful |
| 10.6 | 121844 | 2023-06-02 0:24:37 | 0:00:30 | 45230 | build successful |
| 11 | 116354 | 2023-06-02 0:09:41 | 0:00:17 | 33259 | build successful |
| 10.10 | 227705 | 2023-06-01 23:55:10 | 0:00:30 | 72590 | build successful |
| 10.12 | 233169 | 2023-06-01 23:41:55 | 0:00:34 | 71511 | build successful |
| 10.7 | 146561 | 2023-06-01 23:32:17 | 0:00:20 | 45006 | failed install-dependencies |
| 10.6.x86_64 | 156947 | 2023-06-01 23:26:47 | 0:00:25 | 45267 | build successful |
| 13 | 35410 | 2023-06-01 22:37:44 | 0:00:18 | 7803 | build successful |
| 13.arm64 | 23792 | 2023-06-01 22:32:47 | 0:00:06 | 7645 | build successful |
| 10.6 | 121369 | 2023-05-29 17:33:03 | 0:00:22 | 45068 | build successful |
| 10.8 | 135962 | 2023-05-29 17:32:21 | 0:00:31 | 42905 | build successful |
| 10.11 | 223931 | 2023-05-29 17:32:12 | 0:00:25 | 72546 | build successful |
| 10.10 | 227253 | 2023-05-29 17:31:54 | 0:00:30 | 72423 | build successful |
| 10.12 | 232674 | 2023-05-29 17:31:42 | 0:00:29 | 71343 | build successful |
| 10.6.x86_64 | 156469 | 2023-05-29 17:31:29 | 0:00:20 | 45105 | build successful |
| 10.9 | 233357 | 2023-05-29 17:31:24 | 0:00:19 | 72120 | build successful |
| 13 | 34919 | 2023-05-29 17:30:08 | 0:00:21 | 7637 | build successful |
| 10.7 | 146092 | 2023-05-29 17:29:23 | 0:00:20 | 44843 | failed install-dependencies |
| 13 | 34115 | 2023-05-21 19:08:01 | 0:00:17 | 7360 | build successful |
| 12.arm64 | 95266 | 2023-05-21 19:07:00 | 0:00:08 | 21612 | build successful |
| 10.8 | 114321 | 2022-12-18 16:09:41 | 0:00:25 | 36366 | failed install-dependencies |
| 10.14 | 150141 | 2022-12-18 16:00:44 | 0:00:52 | 47669 | build successful |
| 10.10 | 207014 | 2022-12-18 15:52:19 | 0:00:12 | 65894 | failed install-dependencies |
| 11 | 96271 | 2022-12-18 15:48:09 | 0:00:52 | 26573 | build successful |
| 10.15 | 123922 | 2022-12-18 15:44:39 | 0:00:55 | 36661 | build successful |
| 12 | 52734 | 2022-12-18 15:37:41 | 0:00:58 | 15352 | build successful |
| 10.13 | 174499 | 2022-12-18 15:31:51 | 0:00:53 | 56902 | build successful |
| 10.6 | 98582 | 2022-12-18 15:30:40 | 0:00:23 | 38549 | failed install-dependencies |
| 10.11 | 204685 | 2022-12-18 15:29:04 | 0:00:14 | 66013 | failed install-dependencies |
| 10.6.x86_64 | 133603 | 2022-12-18 15:25:39 | 0:00:17 | 38579 | failed install-dependencies |
| 10.12 | 211848 | 2022-12-18 15:25:03 | 0:00:10 | 64818 | failed install-dependencies |
| 10.9 | 212469 | 2022-12-18 15:20:10 | 0:00:08 | 65587 | failed install-dependencies |
| 10.7 | 124942 | 2022-12-18 15:17:47 | 0:00:19 | 38325 | failed install-dependencies |
| 11.arm64 | 77506 | 2022-12-18 15:06:02 | 0:00:21 | 26538 | build successful |
| 12.arm64 | 23157 | 2021-11-21 11:11:35 | 0:00:30 | 1406 | build successful |
| 11 | 24028 | 2021-03-19 6:31:35 | 0:02:33 | 3639 | build successful |
| 10.14 | 69932 | 2020-10-23 11:19:17 | 0:02:22 | 20630 | build successful |
| 10.6.x86_64 | 37286 | 2020-10-23 11:10:05 | 0:01:34 | 11397 | build successful |
| 10.15 | 40950 | 2020-10-23 11:08:56 | 0:02:12 | 10183 | build successful |
| 10.7 | 33394 | 2020-10-23 11:02:01 | 0:01:36 | 11384 | build successful |
| 10.10 | 125790 | 2020-10-23 11:01:43 | 0:01:51 | 39002 | build successful |
| 10.8 | 28305 | 2020-10-23 11:01:41 | 0:01:47 | 9250 | build successful |
| 10.11 | 124160 | 2020-10-23 11:00:42 | 0:01:59 | 38946 | build successful |
| 10.13 | 94016 | 2020-10-23 11:00:25 | 0:02:07 | 29903 | build successful |
| 10.12 | 129386 | 2020-10-23 10:58:06 | 0:01:52 | 37944 | build successful |
| 10.9 | 129429 | 2020-10-23 10:56:01 | 0:01:19 | 38953 | build successful |
| 10.8 | 19515 | 2020-06-28 9:07:28 | 0:01:54 | 5531 | build successful |
| 10.13 | 79901 | 2020-03-24 13:41:10 | 0:02:03 | 23538 | build successful |
| 10.11 | 109475 | 2020-03-22 1:46:07 | 0:01:48 | 32231 | build successful |
| 10.7 | 18999 | 2020-03-21 23:24:42 | 0:01:34 | 4649 | build successful |
| 10.15 | 25358 | 2020-02-28 19:30:49 | 0:02:42 | 3461 | build successful |
| 10.14 | 54795 | 2020-02-28 19:24:58 | 0:02:17 | 13916 | build successful |
| 10.6.x86_64 | 20963 | 2020-02-28 19:23:38 | 0:01:45 | 4672 | build successful |
| 10.9 | 114021 | 2020-02-28 19:17:41 | 0:01:34 | 32239 | build successful |
| 10.10 | 111347 | 2020-02-28 19:17:01 | 0:01:37 | 32295 | build successful |
| 10.12 | 115342 | 2020-02-28 19:16:55 | 0:01:48 | 31229 | build successful |
| 10.15 | 6299 | 2019-11-25 3:53:50 | 0:02:49 | 907 | build successful |
| 10.6.x86_64 | 10952 | 2019-11-24 3:25:33 | 0:01:36 | 2113 | build successful |
| 10.8 | 9004 | 2019-11-22 12:48:08 | 0:01:33 | 2108 | build successful |
| 10.9 | 106498 | 2019-11-22 12:47:48 | 0:01:32 | 29713 | build successful |
| 10.7 | 10156 | 2019-11-22 12:47:48 | 0:01:29 | 2110 | build successful |
| 10.10 | 103726 | 2019-11-22 12:47:01 | 0:01:36 | 29767 | build successful |
| 10.13 | 72187 | 2019-11-22 12:46:24 | 0:02:15 | 20680 | build successful |
| 10.14 | 46866 | 2019-11-22 12:46:10 | 0:02:11 | 11400 | build successful |
| 10.11 | 102436 | 2019-11-22 12:45:29 | 0:02:10 | 29721 | build successful |
| 10.12 | 107337 | 2019-11-22 12:45:24 | 0:01:57 | 28704 | build successful |