GitHub · C++
batchgen-project/batchgen
High-Throughput Batch Inference
- Stars
- 22
- Forks
- 1
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: deepseek, deepseek-r1, deepseek-v3, large-language-models, mixture-of-experts, model-serving, moe
Latest data point: Nov 20, 2026 · 22 stars · 1 forks