ernext/tokenrace
Compare local LLM inference servers (Ollama, LM Studio, MLX, llama.cpp, vLLM…) on your own hardware, with the same client-side timing for all of them.
GitHub repository with 5 stars and 0 forks.
Language: Python
Topics: apple-silicon, benchmark, llama-cpp, llm, lm-studio, mlx, ollama, streamlit, inference, local-llm