llm-server repositories
Trending repositories tagged llm-server, ranked by trending score. Updated daily.
-
1
raullenchai/Rapid-MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
GitHub · Python · 4,168 stars · 445 forks · +10 stars in 24 hours · Trending score 2.14
-
2
wannaphong/android-hostai
HostAI - Android LLM API Server
GitHub · Kotlin · 37 stars · 6 forks · 0 stars in 24 hours · Trending score 0.36
-
3
Quazmoz/InferBridge
Windows-first OpenAI-compatible local LLM server powered by OpenVINO GenAI for Intel CPU/GPU/NPU, with chat UI, model conversion, and setup scripts.
GitHub · Python · 51 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00