on-device-ai repositories

Trending repositories tagged on-device-ai, ranked by trending score. Updated daily.

  1. 1
    Edge0-AI/Edge0

    Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.

    GitHub · C++ · 12,146 stars · 1,884 forks · +100 stars in 24 hours · Trending score 4.58

  2. 2
    cactus-compute/cactus

    Sub-50mb agentic, voice and vision intelligence for consumer devices.

    GitHub · Python · 14,857 stars · 1,043 forks · +42 stars in 24 hours · Trending score 3.22

  3. 3
    rayl15/OpenVision

    Open-source iOS app connecting Meta Ray-Ban smart glasses to AI — 5 backends (on-device MLX models, Apple Intelligence, OpenAI, Gemini Live, OpenClaw), on-device neural voice, face recognition & live web search. Private and offline-capable.

    GitHub · Swift · 205 stars · 58 forks · +49 stars in 24 hours · Trending score 3.11

  4. 4
    Helldez/BigMoeOnEdge

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    GitHub · C++ · 1,056 stars · 110 forks · +23 stars in 24 hours · Trending score 3.07

  5. 5
    AbrahamPaulJ/nightmare-mobile

    On-device, ComfyUI-style node graph for image/video diffusion on Android. Run MiniMax H3 and WAN 2.2 14B on the Qualcomm Hexagon NPU. SD1.5, SDXL, Flux, Z-Image, Anima, Qwen Image 2.1, Krea 2 & MOSS Image. Inpainting, outpainting, ControlNet, LoRA, IP-Adapter & LivePortrait. Fully offline, no server, no account.

    GitHub · Kotlin · 282 stars · 23 forks · +33 stars in 24 hours · Trending score 2.64

  6. 6
    subhashhhhhh/Lumen

    A photo gallery for Android with the smart features of Google Photos and iPhone Photos. Nothing leaves your phone.

    GitHub · Kotlin · 186 stars · 7 forks · +28 stars in 24 hours · Trending score 2.49

  7. 7
    0xCoach/TaoSheng

    涛声 TaoSheng:24小时人生上下文记录,用一部手机全天收音 → 转写 → 认人 → AI 整理成待办与记忆,夜里的鼾声、梦话也记录。无需硬件、无需账号,数据只在你手机里。

    GitHub · Kotlin · 436 stars · 62 forks · +12 stars in 24 hours · Trending score 2.48

  8. 8
    nicedreamzapp/claude-code-local

    Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.

    GitHub · Python · 3,524 stars · 650 forks · +12 stars in 24 hours · Trending score 2.34

  9. 9
    jammaru/sakutto

    A browser extension for easy on-device translation with a local LLM (PLaMo). Private, free, no server needed.

    GitHub · TypeScript · 274 stars · 32 forks · +11 stars in 24 hours · Trending score 2.30

  10. 10
    google-ai-edge/LiteRT-LM

    LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

    GitHub · C++ · 6,909 stars · 797 forks · +10 stars in 24 hours · Trending score 2.25

  11. 11
    tetherto/qvac

    Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.

    GitHub · TypeScript · 795 stars · 165 forks · +12 stars in 24 hours · Trending score 2.19

  12. 12
    Renakoni/Voicebox

    最好用的 Android 离线语音克隆与三语 TTS(误)——基于 GPT-SoVITS,支持中日英。 | The best offline voice cloning & trilingual TTS on Android (jk) — powered by GPT-SoVITS (ZH/JA/EN).

    GitHub · Kotlin · 203 stars · 41 forks · +83 stars in 24 hours · Trending score 2.15

  13. 13
    Muesli-HQ/muesli

    Muesli: agent-native local meeting transcription + dictation for macOS (Granola + WisprFlow + Littlebird alternative)

    GitHub · Swift · 1,651 stars · 158 forks · +13 stars in 24 hours · Trending score 2.15

  14. 14
    drumih/turbo-fieldfare

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    GitHub · Swift · 7,431 stars · 483 forks · +6 stars in 24 hours · Trending score 2.11

  15. 15
    qualcomm/GenieX

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    GitHub · Go · 8,541 stars · 1,091 forks · +7 stars in 24 hours · Trending score 2.06

  16. 16
    nobodywho-ooo/nobodywho

    NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    GitHub · Rust · 1,691 stars · 102 forks · +16 stars in 24 hours · Trending score 2.03

  17. 17
    aether-aiagent/aether

    Aether — open-source AI agent for Android (Kotlin, Jetpack Compose). Local LLM chat app with bash, file and MCP tools, subagents, offline Alpine/Proot runtime, Termux and Shizuku support. Signed APK releases. ИИ-агент на телефон: нейросеть на Android с инструментами.

    GitHub · Kotlin · 38 stars · 1 forks · +32 stars in 24 hours · Trending score 1.93

  18. 18
    dineshsoudagar/local-llms-on-android

    Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

    GitHub · Kotlin · 500 stars · 64 forks · +12 stars in 24 hours · Trending score 1.91

  19. 19
    amicalhq/amical

    Free, open source voice typing for macOS and Windows. Local speech-to-text with Whisper and Parakeet, also offline.

    GitHub · TypeScript · 1,626 stars · 144 forks · +13 stars in 24 hours · Trending score 1.91

  20. 20
    jsogn/Glint

    面向中文母语者的 macOS 英语学习工具,可切换其他目标语言:读取中文拼音输入法的当前高亮候选,在候选栏旁显示对应译文。

    GitHub · Swift · 164 stars · 8 forks · +6 stars in 24 hours · Trending score 1.75

  21. 21
    kellyvv/PhoneClaw

    PhoneClaw turns phones into local AI agent runtimes with on-device models, native mobile Skills, LiveLand, and optional Mac Gateway inference.

    GitHub · Swift · 1,294 stars · 172 forks · +2 stars in 24 hours · Trending score 1.72

  22. 22
    Zyphra/ZONOS3-Mini

    compact zero-shot voice-cloning TTS with state-of-the-art performance, leading voice control, real-time on-device.

    GitHub · Python · 259 stars · 28 forks · +32 stars in 24 hours · Trending score 1.68

  23. 23
    pasrom/meeting-transcriber

    On-device meeting transcriber for macOS — auto-records Teams/Zoom/Webex, transcribes & separates speakers locally. No cloud. Open-source alternative to Otter/Granola/Fireflies.

    GitHub · Swift · 251 stars · 79 forks · +4 stars in 24 hours · Trending score 1.56

  24. 24
    raslenabb12/Memoria

    Private, fully offline photo search for Android. Find photos with words in English, Arabic, French, Russian or Spanish, or with another photo.

    GitHub · Kotlin · 54 stars · 3 forks · +6 stars in 24 hours · Trending score 1.55