This port has been deleted. This page will exist till another port with the name "py38-sentencepiece" comes
into existence.
py38-sentencepiece (python/py-sentencepiece) Updated: 1 year, 5 months ago Add to my watchlist
Python wrapper for sentencepieceSentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.
Version: 0.1.99 License: Apache-2Statistics for selected duration
2024-Oct-06 to 2024-Nov-05
No stats available for this selection.
Try changing the range of days. Alternatively visit statistics page to have an overall look at the submitted statistics.