yuniko-software/qwen3-tokenizer-dotnet
Multi-language BPE tokenizer implementation for Qwen3 models. Lightweight byte-pair encoding for C#/.NET
GitHub repository with 7 stars and 1 forks.
Language: C#
Topics: bpe-tokenizer, csharp, dotnet, embedding-models, huggingface, inference, llm, machine-learning, onnx, qwen