This port has been deleted. This page will exist till another port with the name "py37-sentencepiece" comes
into existence.
py37-sentencepiece (python/py-sentencepiece) Updated: 1 year, 5 months ago Add to my watchlist
Python wrapper for sentencepieceSentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training. SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.
Version: 0.1.99 License: Apache-2Maintainers | No Maintainer |
Categories | textproc python |
Homepage | https://github.com/google/sentencepiece |
Platforms | darwin |
Variants |
|
Subport(s) (6)
"py37-sentencepiece" depends on
lib (3)
build (3)
test (1)
Ports that depend on "py37-sentencepiece"
run (1)Port Health:
Loading Port Health
Installations (30 days)
0
Requested Installations (30 days)
0
Livecheck error
Error: Port py37-sentencepiece not found
last updated: 1 day, 13 hours ago