lordmathis/llamactl
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
GitHub repository with 127 stars and 17 forks.
Language: Go
Topics: llama-cpp, llama-server, llamacpp, llm, llm-inference, openai-api, localllama, localllm, self-hosted, mlx