fast-inference repositories

Trending repositories tagged fast-inference, ranked by trending score. Updated daily.

  1. 1
    YuhuaBillChen/justfit-llm

    Run Qwen3.8-27B with its full 256K context on a 24 GB Mac. Long-context local LLM serving for Apple silicon, built on Inco AI's Splash. OpenAI-compatible API.

    GitHub · C++ · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04

  2. 2
    ronitgupta138/Local-Jev

    ⚡ 100% offline, zero-cost drop-in alternative to TypeSafe Jev System One decision models in Rust (<18ms on CPU)

    GitHub · Rust · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.03

  3. 3
    Gilfeather/furnace

    Fast, Unified, Rust-Native, Axum-Compatible inference Endpoints for Burn models and LLMs

    GitHub · Rust · 66 stars · 6 forks · 0 stars in 24 hours · Trending score 0.02

  4. 4
    AskTheWay/dsh-jev-interceptor

    ⚡ Millisecond System-1 judgement for every tool call in DeepSeek Harness — Jev-powered risk classification & evidence-gated auto-approval. Fail-closed by construction. dsh 生态第一个 System-1 决策插件

    GitHub · TypeScript · 33 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00