GitHub 路 Rust
huggingface/tokenizers
馃挜 Fast State-of-the-Art Tokenizers optimized for Research and Production
- Stars
- 11,265
- Forks
- 1,274
- Stars gained in 24 hours
- +9
- Forks gained in 24 hours
- +18
Topics: bert, gpt, language-model, natural-language-processing, natural-language-understanding, nlp, transformers
Latest data point: Nov 21, 2026 路 11,265 stars 路 1,274 forks