py312-sentencepiece (python/py-sentencepiece) Updated: 8 months ago Add to my watchlist
Python wrapper for sentencepieceSentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.
Version: 0.2.0 License: Apache-2
GitHub
23 build(s) found
| Builder | Build Number | Start Time | Elapsed Time | Watcher | Build Status |
|---|---|---|---|---|---|
| 15 | 9761 | 2024-10-10 20:34:18 | 0:00:15 | 879 | build successful |
| 10.15 | 193009 | 2024-08-07 4:43:41 | 0:01:23 | 59763 | failed install-port |
| 10.14 | 216006 | 2024-08-07 3:26:52 | 0:01:00 | 70695 | failed install-port |
| 10.6 | 177177 | 2024-08-07 3:01:29 | 0:00:10 | 61705 | failed install-dependencies |
| 10.6.x86_64 | 212805 | 2024-08-07 2:40:11 | 0:00:11 | 61750 | failed install-dependencies |
| 14 | 33304 | 2024-03-23 17:24:39 | 0:01:20 | 7297 | build successful |
| 10.7 | 181923 | 2024-03-23 16:30:45 | 0:00:59 | 56220 | build successful |
| 12.arm64 | 121401 | 2024-03-23 4:04:10 | 0:00:20 | 33224 | build successful |
| 12 | 101074 | 2024-03-23 2:56:00 | 0:01:31 | 33240 | build successful |
| 10.14 | 200107 | 2024-03-23 0:58:04 | 0:01:06 | 65507 | failed install-port |
| 13.arm64 | 53654 | 2024-03-22 23:58:24 | 0:00:20 | 18855 | build successful |
| 13 | 64719 | 2024-03-22 23:46:35 | 0:01:36 | 19116 | build successful |
| 10.11 | 256053 | 2024-03-22 22:58:38 | 0:01:16 | 83913 | build successful |
| 11 | 147339 | 2024-03-22 22:58:05 | 0:01:45 | 44426 | build successful |
| 10.13 | 225393 | 2024-03-22 22:51:18 | 0:01:52 | 74756 | build successful |
| 10.15 | 176427 | 2024-03-22 22:46:52 | 0:01:18 | 54499 | failed install-port |
| 10.8 | 169241 | 2024-03-22 22:10:57 | 0:01:17 | 54281 | build successful |
| 10.12 | 265450 | 2024-03-22 22:00:43 | 0:01:09 | 82698 | build successful |
| 10.10 | 261055 | 2024-03-22 21:53:50 | 0:01:15 | 83804 | build successful |
| 10.9 | 268224 | 2024-03-22 21:38:00 | 0:01:07 | 83489 | build successful |
| 10.6 | 158277 | 2024-03-22 21:20:06 | 0:00:15 | 56443 | failed install-dependencies |
| 10.6.x86_64 | 193994 | 2024-03-22 21:19:12 | 0:00:12 | 56491 | failed install-dependencies |
| 14.arm64 | 21328 | 2024-03-22 20:49:42 | 0:00:21 | 6969 | build successful |