fast-inference repositories
Trending repositories tagged fast-inference, ranked by trending score. Updated daily.
-
1
YuhuaBillChen/justfit-llm
Run Qwen3.8-27B with its full 256K context on a 24 GB Mac. Long-context local LLM serving for Apple silicon, built on Inco AI's Splash. OpenAI-compatible API.
GitHub · C++ · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04
-
2
ronitgupta138/Local-Jev
⚡ 100% offline, zero-cost drop-in alternative to TypeSafe Jev System One decision models in Rust (<18ms on CPU)
GitHub · Rust · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.03
-
3
Gilfeather/furnace
Fast, Unified, Rust-Native, Axum-Compatible inference Endpoints for Burn models and LLMs
GitHub · Rust · 66 stars · 6 forks · 0 stars in 24 hours · Trending score 0.02
-
4
AskTheWay/dsh-jev-interceptor
⚡ Millisecond System-1 judgement for every tool call in DeepSeek Harness — Jev-powered risk classification & evidence-gated auto-approval. Fail-closed by construction. dsh 生态第一个 System-1 决策插件
GitHub · TypeScript · 33 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00