GitHub · Rust
ml-rust/splintr
A high-performance tokenizer (BPE, WordPiece, SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.
- Stars
- 63
- Forks
- 6
- Stars gained in 24 hours
- +2
- Forks gained in 24 hours
- 0
Topics: huggingface, llm, machine-learning, openai, rust, tokenizer
Latest data point: Nov 21, 2026 · 63 stars · 6 forks