fast-local-inference repositories

Trending repositories tagged fast-local-inference, ranked by trending score. Updated daily.

  1. 1
    nace-ai/kapitsa

    Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai

    GitHub · C++ · 860 stars · 120 forks · +17 stars in 24 hours · Trending score 2.58