GitHub · Python
VectorInstitute/vector-inference
Efficient LLM inference on Slurm clusters.
- Stars
- 110
- Forks
- 14
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: audio-transcription, inference, llm, llm-infernece, llm-infrastructure, multimodal, reward-model, sglang, speech-to-text, text-embedding
Latest data point: Nov 21, 2026 · 110 stars · 14 forks