py310-sentencepiece (python/py-sentencepiece) Updated: 8 months, 1 week ago Add to my watchlist
Python wrapper for sentencepieceSentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.
Version: 0.2.0 License: Apache-2 GitHub110 build(s) found
Page 2 of 2 | Showing build(s) 101 to 110
Builder | Build Number | Start Time | Elapsed Time | Watcher | Build Status |
---|---|---|---|---|---|
10.10 | 226332 | 2023-05-20 22:21:22 | 0:00:28 | 72118 | failed install-port |
10.9 | 232395 | 2023-05-20 22:20:56 | 0:00:31 | 71813 | failed install-port |
10.12 | 231723 | 2023-05-20 22:20:49 | 0:00:36 | 71036 | failed install-port |
10.7 | 144996 | 2023-05-20 22:20:49 | 0:00:09 | 44534 | failed install-dependencies |
10.11 | 223036 | 2023-05-20 22:18:47 | 0:00:11 | 72238 | failed install-dependencies |
10.15 | 142441 | 2023-05-20 22:18:02 | 0:02:09 | 42869 | build successful |
12 | 70100 | 2023-05-20 22:17:19 | 0:01:51 | 21578 | build successful |
11 | 115076 | 2023-05-20 22:17:10 | 0:02:06 | 32785 | build successful |
13 | 34008 | 2023-05-20 22:17:01 | 0:01:55 | 7327 | build successful |
12.arm64 | 95128 | 2023-05-20 22:16:53 | 0:00:27 | 21579 | build successful |