Chleba/ollamaMQ
High-performance Ollama proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.
GitHub repository with 105 stars and 10 forks.
Language: Rust
Topics: fair-share, llm-ops, message-queue, ollama, openai-compatible, proxy, rust, tui