sentencepiece (textproc/sentencepiece) Updated: 11 months, 1 week ago Add to my watchlist

Unsupervised text tokenizer for Neural Network-based text generation.

SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) (Sennrich et al.) and unigram language model (Kudo)) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.

Version: 0.2.0 License: Apache-2 GitHub
Reset

149 build(s) found

Page 2 of 2 | Showing build(s) 101 to 149

Builder Build Number Start Time Elapsed Time Watcher Build Status
10.15 109793 2022-08-19 14:28:37 0:03:41 32391 build successful
10.13 160170 2022-08-19 14:28:30 0:02:46 52627 build successful
12.arm64 61121 2022-08-19 14:28:22 0:00:51 11070 build successful
12 3403 2021-11-25 8:53:34 0:03:29 525 build successful
12.arm64 6624 2021-11-06 20:59:19 0:01:08 531 build successful
11.arm64 16398 2021-04-23 9:14:40 0:01:07 4278 build successful
11 25321 2021-04-02 1:43:46 0:05:33 4076 build successful
10.12 142399 2021-03-31 4:43:19 0:02:41 42623 build successful
10.13 106945 2021-03-31 3:08:33 0:02:49 34580 build successful
10.15 53033 2021-03-30 1:51:27 0:03:11 13848 build successful
10.14 82603 2021-03-29 7:47:52 0:03:19 25277 build successful
10.6.x86_64 51784 2021-03-28 16:33:32 0:08:26 16057 build successful
10.10 138639 2021-03-28 15:13:51 0:06:53 43685 build successful
10.7 48146 2021-03-28 15:05:22 0:09:15 16096 build successful
10.9 142319 2021-03-28 15:03:56 0:10:38 43359 build successful
10.6 28295 2021-03-28 15:02:38 0:12:30 16095 build successful
10.11 137207 2021-03-28 14:46:28 0:02:50 43625 build successful
10.8 41890 2021-03-28 14:46:15 0:09:13 13949 build successful
11 13679 2021-01-11 14:43:14 0:04:07 1819 build successful
11.arm64 8413 2021-01-10 13:33:47 0:01:35 1905 build successful
10.14 69930 2020-10-23 11:12:25 0:03:47 20630 build successful
10.15 40948 2020-10-23 11:01:53 0:03:52 10183 build successful
10.6.x86_64 37284 2020-10-23 10:58:39 0:06:25 11397 build successful
10.11 124158 2020-10-23 10:54:44 0:03:32 38946 build successful
10.13 94014 2020-10-23 10:54:16 0:03:46 29903 build successful
10.6 19352 2020-10-23 10:53:24 0:09:05 11388 build successful
10.12 129384 2020-10-23 10:53:06 0:02:52 37944 build successful
10.10 125788 2020-10-23 10:52:53 0:06:14 39002 build successful
10.8 28303 2020-10-23 10:51:03 0:07:53 9250 build successful
10.7 33392 2020-10-23 10:49:17 0:06:47 11384 build successful
10.9 129427 2020-10-23 10:48:25 0:05:59 38953 build successful
10.6 4940 2019-11-27 22:47:34 0:09:16 2087 build successful
10.15 6138 2019-11-24 7:42:15 0:04:37 881 build successful
10.10 103702 2019-11-21 19:46:09 0:05:27 29755 build successful
10.8 8966 2019-11-21 16:16:40 0:07:58 2091 build successful
10.10 103692 2019-11-21 15:33:52 0:02:18 29750 failed install-port
10.9 106465 2019-11-21 15:22:38 0:07:29 29696 build successful
10.6.x86_64 9865 2019-11-21 11:18:11 0:07:36 2086 build successful
10.10 103620 2019-11-21 4:22:51 0:01:52 29743 failed install-port
10.8 8891 2019-11-21 4:22:41 0:01:57 2084 failed install-port
10.9 106395 2019-11-21 4:22:31 0:01:46 29689 failed install-port
10.7 10028 2019-11-21 2:08:11 0:06:37 2084 build successful
10.12 107236 2019-11-21 2:03:49 0:03:44 28678 build successful
10.10 103618 2019-11-21 2:03:36 0:02:57 29741 failed install-port
10.14 46768 2019-11-21 2:03:25 0:03:36 11374 build successful
10.13 72090 2019-11-21 2:03:13 0:03:38 20654 build successful
10.11 102332 2019-11-21 2:02:58 0:03:51 29695 build successful
10.9 106393 2019-11-21 2:02:40 0:01:54 29687 failed install-port
10.8 8889 2019-11-21 2:02:26 0:02:14 2082 failed install-port