offline-inference repositories
Trending repositories tagged offline-inference, ranked by trending score. Updated daily.
-
1
dineshsoudagar/local-llms-on-android
Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.
GitHub · Kotlin · 500 stars · 64 forks · +6 stars in 24 hours · Trending score 1.71
-
2
HighlyLoadedEgo/ClefMCP
Local MCP server exposing the Cloudflare Clef-Flash decision model to AI agents — structured decisions with probability outputs, fully offline via llama.cpp.
GitHub · TypeScript · 7 stars · 1 forks · 0 stars in 24 hours · Trending score 0.10
-
3
yzfly/edgejev
离线可用的本地类型化决策:4 核 CPU 单题 15.6ms。Local & offline Jev / System One inference on CPU — ONNX + INT8, no torch at runtime. 支持 laya / kev / PlayJev
GitHub · Python · 34 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00