on-device-ai repositories
Trending repositories tagged on-device-ai, ranked by trending score. Updated daily.
-
1
Edge0-AI/Edge0
Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.
GitHub · C++ · 12,146 stars · 1,884 forks · +100 stars in 24 hours · Trending score 4.58
-
2
cactus-compute/cactus
Sub-50mb agentic, voice and vision intelligence for consumer devices.
GitHub · Python · 14,857 stars · 1,043 forks · +42 stars in 24 hours · Trending score 3.22
-
3
rayl15/OpenVision
Open-source iOS app connecting Meta Ray-Ban smart glasses to AI — 5 backends (on-device MLX models, Apple Intelligence, OpenAI, Gemini Live, OpenClaw), on-device neural voice, face recognition & live web search. Private and offline-capable.
GitHub · Swift · 205 stars · 58 forks · +49 stars in 24 hours · Trending score 3.11
-
4
Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
GitHub · C++ · 1,056 stars · 110 forks · +23 stars in 24 hours · Trending score 3.07
-
5
AbrahamPaulJ/nightmare-mobile
On-device, ComfyUI-style node graph for image/video diffusion on Android. Run MiniMax H3 and WAN 2.2 14B on the Qualcomm Hexagon NPU. SD1.5, SDXL, Flux, Z-Image, Anima, Qwen Image 2.1, Krea 2 & MOSS Image. Inpainting, outpainting, ControlNet, LoRA, IP-Adapter & LivePortrait. Fully offline, no server, no account.
GitHub · Kotlin · 282 stars · 23 forks · +33 stars in 24 hours · Trending score 2.64
-
6
subhashhhhhh/Lumen
A photo gallery for Android with the smart features of Google Photos and iPhone Photos. Nothing leaves your phone.
GitHub · Kotlin · 186 stars · 7 forks · +28 stars in 24 hours · Trending score 2.49
-
7
0xCoach/TaoSheng
涛声 TaoSheng:24小时人生上下文记录,用一部手机全天收音 → 转写 → 认人 → AI 整理成待办与记忆,夜里的鼾声、梦话也记录。无需硬件、无需账号,数据只在你手机里。
GitHub · Kotlin · 436 stars · 62 forks · +12 stars in 24 hours · Trending score 2.48
-
8
nicedreamzapp/claude-code-local
Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.
GitHub · Python · 3,524 stars · 650 forks · +12 stars in 24 hours · Trending score 2.34
-
9
jammaru/sakutto
A browser extension for easy on-device translation with a local LLM (PLaMo). Private, free, no server needed.
GitHub · TypeScript · 274 stars · 32 forks · +11 stars in 24 hours · Trending score 2.30
-
10
google-ai-edge/LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
GitHub · C++ · 6,909 stars · 797 forks · +10 stars in 24 hours · Trending score 2.25
-
11
tetherto/qvac
Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.
GitHub · TypeScript · 795 stars · 165 forks · +12 stars in 24 hours · Trending score 2.19
-
12
Renakoni/Voicebox
最好用的 Android 离线语音克隆与三语 TTS(误)——基于 GPT-SoVITS,支持中日英。 | The best offline voice cloning & trilingual TTS on Android (jk) — powered by GPT-SoVITS (ZH/JA/EN).
GitHub · Kotlin · 203 stars · 41 forks · +83 stars in 24 hours · Trending score 2.15
-
13
Muesli-HQ/muesli
Muesli: agent-native local meeting transcription + dictation for macOS (Granola + WisprFlow + Littlebird alternative)
GitHub · Swift · 1,651 stars · 158 forks · +13 stars in 24 hours · Trending score 2.15
-
14
drumih/turbo-fieldfare
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
GitHub · Swift · 7,431 stars · 483 forks · +6 stars in 24 hours · Trending score 2.11
-
15
qualcomm/GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
GitHub · Go · 8,541 stars · 1,091 forks · +7 stars in 24 hours · Trending score 2.06
-
16
nobodywho-ooo/nobodywho
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
GitHub · Rust · 1,691 stars · 102 forks · +16 stars in 24 hours · Trending score 2.03
-
17
aether-aiagent/aether
Aether — open-source AI agent for Android (Kotlin, Jetpack Compose). Local LLM chat app with bash, file and MCP tools, subagents, offline Alpine/Proot runtime, Termux and Shizuku support. Signed APK releases. ИИ-агент на телефон: нейросеть на Android с инструментами.
GitHub · Kotlin · 38 stars · 1 forks · +32 stars in 24 hours · Trending score 1.93
-
18
dineshsoudagar/local-llms-on-android
Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.
GitHub · Kotlin · 500 stars · 64 forks · +12 stars in 24 hours · Trending score 1.91
-
19
amicalhq/amical
Free, open source voice typing for macOS and Windows. Local speech-to-text with Whisper and Parakeet, also offline.
GitHub · TypeScript · 1,626 stars · 144 forks · +13 stars in 24 hours · Trending score 1.91
-
20
jsogn/Glint
面向中文母语者的 macOS 英语学习工具,可切换其他目标语言:读取中文拼音输入法的当前高亮候选,在候选栏旁显示对应译文。
GitHub · Swift · 164 stars · 8 forks · +6 stars in 24 hours · Trending score 1.75
-
21
kellyvv/PhoneClaw
PhoneClaw turns phones into local AI agent runtimes with on-device models, native mobile Skills, LiveLand, and optional Mac Gateway inference.
GitHub · Swift · 1,294 stars · 172 forks · +2 stars in 24 hours · Trending score 1.72
-
22
Zyphra/ZONOS3-Mini
compact zero-shot voice-cloning TTS with state-of-the-art performance, leading voice control, real-time on-device.
GitHub · Python · 259 stars · 28 forks · +32 stars in 24 hours · Trending score 1.68
-
23
pasrom/meeting-transcriber
On-device meeting transcriber for macOS — auto-records Teams/Zoom/Webex, transcribes & separates speakers locally. No cloud. Open-source alternative to Otter/Granola/Fireflies.
GitHub · Swift · 251 stars · 79 forks · +4 stars in 24 hours · Trending score 1.56
-
24
raslenabb12/Memoria
Private, fully offline photo search for Android. Find photos with words in English, Arabic, French, Russian or Spanish, or with another photo.
GitHub · Kotlin · 54 stars · 3 forks · +6 stars in 24 hours · Trending score 1.55