py311-sentencepiece (python/py-sentencepiece) Updated: 1 year, 7 months ago Add to my watchlist

Python wrapper for sentencepiece

SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.

Version: 0.2.0 License: Apache-2 GitHub
Reset

110 build(s) found

Page 2 of 2 | Showing build(s) 101 to 110

Builder Build Number Start Time Elapsed Time Watcher Build Status
10.9 232498 2023-05-21 15:06:22 0:00:37 71835 failed install-port
10.11 223140 2023-05-21 15:05:13 0:00:08 72260 failed install-dependencies
10.7 145213 2023-05-21 15:04:15 0:00:14 44556 failed install-dependencies
11 115174 2023-05-21 15:03:42 0:02:29 32807 build successful
10.15 142539 2023-05-21 15:03:08 0:02:06 42891 build successful
10.14 167435 2023-05-21 15:02:09 0:01:48 53901 build successful
13 34106 2023-05-21 15:01:51 0:02:09 7349 build successful
12 70238 2023-05-21 15:01:42 0:02:02 21600 build successful
10.13 192813 2023-05-21 15:01:32 0:01:23 63138 build successful
11.arm64 93228 2023-05-21 15:01:22 0:00:29 32793 build successful