llm-server repositories

Trending repositories tagged llm-server, ranked by trending score. Updated daily.

  1. 1
    raullenchai/Rapid-MLX

    Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

    GitHub · Python · 4,168 stars · 445 forks · +10 stars in 24 hours · Trending score 2.14

  2. 2
    wannaphong/android-hostai

    HostAI - Android LLM API Server

    GitHub · Kotlin · 37 stars · 6 forks · 0 stars in 24 hours · Trending score 0.36

  3. 3
    Quazmoz/InferBridge

    Windows-first OpenAI-compatible local LLM server powered by OpenVINO GenAI for Intel CPU/GPU/NPU, with chat UI, model conversion, and setup scripts.

    GitHub · Python · 51 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00