|
@danieldekok | |||||
|
Just pushed the version 0.1.0 of the `sentencepiece` @rustlang crate, which provides a rustic interface to the sentencepiece unsupervised text tokenizer. crates.io/crates/sentenc… rustdoc.danieldk.eu/sentencepiece/
|
||||||
|
||||||
|
@danieldekok | |||||
|
Just pushed the version 0.1.0 of the `sentencepiece` @rustlang crate, which provides a rustic interface to the sentencepiece unsupervised text tokenizer. crates.io/crates/sentenc… rustdoc.danieldk.eu/sentencepiece/
|
||||||
|
||||||