offline-inference repositories

Trending repositories tagged offline-inference, ranked by trending score. Updated daily.

  1. 1
    dineshsoudagar/local-llms-on-android

    Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

    GitHub · Kotlin · 500 stars · 64 forks · +6 stars in 24 hours · Trending score 1.71

  2. 2
    HighlyLoadedEgo/ClefMCP

    Local MCP server exposing the Cloudflare Clef-Flash decision model to AI agents — structured decisions with probability outputs, fully offline via llama.cpp.

    GitHub · TypeScript · 7 stars · 1 forks · 0 stars in 24 hours · Trending score 0.10

  3. 3
    yzfly/edgejev

    离线可用的本地类型化决策:4 核 CPU 单题 15.6ms。Local & offline Jev / System One inference on CPU — ONNX + INT8, no torch at runtime. 支持 laya / kev / PlayJev

    GitHub · Python · 34 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00