Open source real-time translation app for Android that runs locally
-
Updated
Aug 1, 2024 - C++
Open source real-time translation app for Android that runs locally
Fast and customizable text tokenization library with BPE and SentencePiece support
Minimal example of using a traced huggingface transformers model with libtorch
R package for Byte Pair Encoding / Unigram modelling based on Sentencepiece
Sentencepiece Dart is a wrapper for Google's Sentencepiece C++ library modified
Unsupervised text tokenizer for Neural Network-based text generation.
Add a description, image, and links to the sentencepiece topic page so that developers can more easily learn about it.
To associate your repository with the sentencepiece topic, visit your repo's landing page and select "manage topics."