edge-ai repositories
Trending repositories tagged edge-ai, ranked by trending score. Updated daily.
-
1
Edge0-AI/Edge0
Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.
GitHub · C++ · 12,118 stars · 1,883 forks · +100 stars in 24 hours · Trending score 4.58
-
2
hyperionaidev/smolmaxxing
maxxing the ability to run different LLMs on the smallest devices possible
GitHub · C · 1,035 stars · 54 forks · +65 stars in 24 hours · Trending score 3.88
-
3
0xShug0/audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
GitHub · C++ · 4,359 stars · 538 forks · +45 stars in 24 hours · Trending score 3.33
-
4
cactus-compute/cactus
Sub-50mb agentic, voice and vision intelligence for consumer devices.
GitHub · Python · 14,843 stars · 1,044 forks · +42 stars in 24 hours · Trending score 3.22
-
5
Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
GitHub · C++ · 1,033 stars · 107 forks · +23 stars in 24 hours · Trending score 3.07
-
6
AbrahamPaulJ/nightmare-mobile
On-device, ComfyUI-style node graph for image/video diffusion on Android. Run MiniMax H3 and WAN 2.2 14B on the Qualcomm Hexagon NPU. SD1.5, SDXL, Flux, Z-Image, Anima, Qwen Image 2.1, Krea 2 & MOSS Image. Inpainting, outpainting, ControlNet, LoRA, IP-Adapter & LivePortrait. Fully offline, no server, no account.
GitHub · Kotlin · 270 stars · 22 forks · +33 stars in 24 hours · Trending score 2.64
-
7
google-ai-edge/LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
GitHub · C++ · 6,908 stars · 797 forks · +10 stars in 24 hours · Trending score 2.25
-
8
off-grid-ai/OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
GitHub · TypeScript · 3,398 stars · 339 forks · +7 stars in 24 hours · Trending score 2.24
-
9
Renakoni/Voicebox
最好用的 Android 离线语音克隆与三语 TTS(误)——基于 GPT-SoVITS,支持中日英。 | The best offline voice cloning & trilingual TTS on Android (jk) — powered by GPT-SoVITS (ZH/JA/EN).
GitHub · Kotlin · 181 stars · 39 forks · +45 stars in 24 hours · Trending score 1.85
-
10
afjcjsbx/picoclaw
Ultra-lightweight, open-source, self-hosted personal AI assistant in Go for RISC-V, SBCs, and embedded systems. Active PicoClaw fork with WebUI, MCP, memory, multi-agent workflows, plugins, and chat apps.
GitHub · Go · 60 stars · 18 forks · +7 stars in 24 hours · Trending score 1.72
-
11
beclab/Olares
Open-Source Personal Cloud OS for Always-On Agents
GitHub · Go · 5,368 stars · 340 forks · +6 stars in 24 hours · Trending score 1.67
-
12
Sherin-SEF-AI/Lyne-ADAS
Real-time, 100% on-device ADAS for Android: forward-collision, drivable-area segmentation, pedestrian, lane and traffic-sign warnings that self-tune from budget phones to flagships.
GitHub · Kotlin · 22 stars · 7 forks · +6 stars in 24 hours · Trending score 1.38
-
13
lotvulture/lotvulture
Real-time parking lot occupancy detection using existing security cameras and on-device computer vision.
GitHub · Python · 189 stars · 32 forks · −2 stars in 24 hours · Trending score 1.34
-
14
drtikov/microbrainsforagents
Sub-2ms CPU safety shield & smart tool router for AI agents (Claude Code, MCP). Stops bugs, destructive shell commands, and leaked secrets before execution—saving tokens, money, and your machine.
GitHub · Python · 16 stars · 3 forks · +9 stars in 24 hours · Trending score 1.21
-
15
DenisovAV/flutter_edge_ai
On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
GitHub · Dart · 666 stars · 181 forks · +2 stars in 24 hours · Trending score 1.20
-
16
NVIDIA/DeepStream
NVIDIA DeepStream Monorepo: DeepStream SDK and reference apps for building GPU‑accelerated, real-time video and multi‑sensor analytics pipelines with GStreamer, TensorRT, and vision AI models across edge, on‑prem, and cloud deployments.
GitHub · C++ · 321 stars · 77 forks · 0 stars in 24 hours · Trending score 1.20
-
17
LibreYOLO/libreyolo
LibreYOLO is a MIT licensed open source computer vision library
GitHub · Python · 1,017 stars · 70 forks · 0 stars in 24 hours · Trending score 1.13
-
18
open-nvr/open-nvr
The open platform for AI on your cameras: a self-hosted NVR (ONVIF/RTSP, recording, WebRTC) running any AI model through one open contract, with an app SDK and one-click apps. New capabilities arrive as software, not new boxes. Air-gapped or connected, audited end to end. Home Assistant built in. AGPLv3. A Frigate/ZoneMinder alternative.
GitHub · Python · 209 stars · 38 forks · +1 stars in 24 hours · Trending score 1.11
-
19
wangxb96/Awesome-EdgeAI
Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies" and "Cognitive Edge Computing: A Comprehensive Survey on Optimizing Large Models and AI Agents for Pervasive Deployment"
GitHub · Python · 122 stars · 22 forks · +2 stars in 24 hours · Trending score 0.86
-
20
OpenBMB/EC2-Bench
EC2-Bench (EC²-Bench): benchmark for edge-cloud collaboration in long-horizon LLM agents — task performance, resource usage & privacy exposure. arXiv 2610.17816
GitHub · Python · 24 stars · 0 forks · +2 stars in 24 hours · Trending score 0.81
-
21
thezolon/tiiny-studio
Local media studio for the Tiiny Pocket: desktop app (Windows, macOS, Linux) or Docker. Images, OCR & documents, chat with tools, voice, music, 3D
GitHub · Rust · 29 stars · 3 forks · +1 stars in 24 hours · Trending score 0.80
-
22
ruvnet/rvcsi
rvCSI — edge RF sensing runtime: normalize WiFi CSI from Nexmon/ESP32/Intel/Atheros/file/replay into one validated CsiFrame schema, run reusable DSP, emit typed confidence-scored events, bridge to RuVector. Rust + @ruv/rvcsi (npm) + rvcsi CLI + a Claude Code plugin.
GitHub · Rust · 30 stars · 6 forks · 0 stars in 24 hours · Trending score 0.73
-
23
ArgoHA/D-FINE-seg
Real-time object detection, keypoint estimation, instance and semantic segmentation. Train, export (TensorRT, ONNX, OpenVINO, CoreML), deploy. Apache-2.0
GitHub · Python · 225 stars · 39 forks · 0 stars in 24 hours · Trending score 0.70
-
24
sourcenetwork/defradb
DefraDB is a Peer-to-Peer Edge-First Database. It's the core data storage system for the Source Ecosystem.
GitHub · Go · 898 stars · 80 forks · +1 stars in 24 hours · Trending score 0.70