edge-ai repositories

Trending repositories tagged edge-ai, ranked by trending score. Updated daily.

  1. 1
    Edge0-AI/Edge0

    Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.

    GitHub · C++ · 12,118 stars · 1,883 forks · +100 stars in 24 hours · Trending score 4.58

  2. 2
    hyperionaidev/smolmaxxing

    maxxing the ability to run different LLMs on the smallest devices possible

    GitHub · C · 1,035 stars · 54 forks · +65 stars in 24 hours · Trending score 3.88

  3. 3
    0xShug0/audio.cpp

    An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

    GitHub · C++ · 4,359 stars · 538 forks · +45 stars in 24 hours · Trending score 3.33

  4. 4
    cactus-compute/cactus

    Sub-50mb agentic, voice and vision intelligence for consumer devices.

    GitHub · Python · 14,843 stars · 1,044 forks · +42 stars in 24 hours · Trending score 3.22

  5. 5
    Helldez/BigMoeOnEdge

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    GitHub · C++ · 1,033 stars · 107 forks · +23 stars in 24 hours · Trending score 3.07

  6. 6
    AbrahamPaulJ/nightmare-mobile

    On-device, ComfyUI-style node graph for image/video diffusion on Android. Run MiniMax H3 and WAN 2.2 14B on the Qualcomm Hexagon NPU. SD1.5, SDXL, Flux, Z-Image, Anima, Qwen Image 2.1, Krea 2 & MOSS Image. Inpainting, outpainting, ControlNet, LoRA, IP-Adapter & LivePortrait. Fully offline, no server, no account.

    GitHub · Kotlin · 270 stars · 22 forks · +33 stars in 24 hours · Trending score 2.64

  7. 7
    google-ai-edge/LiteRT-LM

    LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

    GitHub · C++ · 6,908 stars · 797 forks · +10 stars in 24 hours · Trending score 2.25

  8. 8
    off-grid-ai/OGAM

    The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

    GitHub · TypeScript · 3,398 stars · 339 forks · +7 stars in 24 hours · Trending score 2.24

  9. 9
    Renakoni/Voicebox

    最好用的 Android 离线语音克隆与三语 TTS(误)——基于 GPT-SoVITS,支持中日英。 | The best offline voice cloning & trilingual TTS on Android (jk) — powered by GPT-SoVITS (ZH/JA/EN).

    GitHub · Kotlin · 181 stars · 39 forks · +45 stars in 24 hours · Trending score 1.85

  10. 10
    afjcjsbx/picoclaw

    Ultra-lightweight, open-source, self-hosted personal AI assistant in Go for RISC-V, SBCs, and embedded systems. Active PicoClaw fork with WebUI, MCP, memory, multi-agent workflows, plugins, and chat apps.

    GitHub · Go · 60 stars · 18 forks · +7 stars in 24 hours · Trending score 1.72

  11. 11
    beclab/Olares

    Open-Source Personal Cloud OS for Always-On Agents

    GitHub · Go · 5,368 stars · 340 forks · +6 stars in 24 hours · Trending score 1.67

  12. 12
    Sherin-SEF-AI/Lyne-ADAS

    Real-time, 100% on-device ADAS for Android: forward-collision, drivable-area segmentation, pedestrian, lane and traffic-sign warnings that self-tune from budget phones to flagships.

    GitHub · Kotlin · 22 stars · 7 forks · +6 stars in 24 hours · Trending score 1.38

  13. 13
    lotvulture/lotvulture

    Real-time parking lot occupancy detection using existing security cameras and on-device computer vision.

    GitHub · Python · 189 stars · 32 forks · −2 stars in 24 hours · Trending score 1.34

  14. 14
    drtikov/microbrainsforagents

    Sub-2ms CPU safety shield & smart tool router for AI agents (Claude Code, MCP). Stops bugs, destructive shell commands, and leaked secrets before execution—saving tokens, money, and your machine.

    GitHub · Python · 16 stars · 3 forks · +9 stars in 24 hours · Trending score 1.21

  15. 15
    DenisovAV/flutter_edge_ai

    On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

    GitHub · Dart · 666 stars · 181 forks · +2 stars in 24 hours · Trending score 1.20

  16. 16
    NVIDIA/DeepStream

    NVIDIA DeepStream Monorepo: DeepStream SDK and reference apps for building GPU‑accelerated, real-time video and multi‑sensor analytics pipelines with GStreamer, TensorRT, and vision AI models across edge, on‑prem, and cloud deployments.

    GitHub · C++ · 321 stars · 77 forks · 0 stars in 24 hours · Trending score 1.20

  17. 17
    LibreYOLO/libreyolo

    LibreYOLO is a MIT licensed open source computer vision library

    GitHub · Python · 1,017 stars · 70 forks · 0 stars in 24 hours · Trending score 1.13

  18. 18
    open-nvr/open-nvr

    The open platform for AI on your cameras: a self-hosted NVR (ONVIF/RTSP, recording, WebRTC) running any AI model through one open contract, with an app SDK and one-click apps. New capabilities arrive as software, not new boxes. Air-gapped or connected, audited end to end. Home Assistant built in. AGPLv3. A Frigate/ZoneMinder alternative.

    GitHub · Python · 209 stars · 38 forks · +1 stars in 24 hours · Trending score 1.11

  19. 19
    wangxb96/Awesome-EdgeAI

    Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies" and "Cognitive Edge Computing: A Comprehensive Survey on Optimizing Large Models and AI Agents for Pervasive Deployment"

    GitHub · Python · 122 stars · 22 forks · +2 stars in 24 hours · Trending score 0.86

  20. 20
    OpenBMB/EC2-Bench

    EC2-Bench (EC²-Bench): benchmark for edge-cloud collaboration in long-horizon LLM agents — task performance, resource usage & privacy exposure. arXiv 2610.17816

    GitHub · Python · 24 stars · 0 forks · +2 stars in 24 hours · Trending score 0.81

  21. 21
    thezolon/tiiny-studio

    Local media studio for the Tiiny Pocket: desktop app (Windows, macOS, Linux) or Docker. Images, OCR & documents, chat with tools, voice, music, 3D

    GitHub · Rust · 29 stars · 3 forks · +1 stars in 24 hours · Trending score 0.80

  22. 22
    ruvnet/rvcsi

    rvCSI — edge RF sensing runtime: normalize WiFi CSI from Nexmon/ESP32/Intel/Atheros/file/replay into one validated CsiFrame schema, run reusable DSP, emit typed confidence-scored events, bridge to RuVector. Rust + @ruv/rvcsi (npm) + rvcsi CLI + a Claude Code plugin.

    GitHub · Rust · 30 stars · 6 forks · 0 stars in 24 hours · Trending score 0.73

  23. 23
    ArgoHA/D-FINE-seg

    Real-time object detection, keypoint estimation, instance and semantic segmentation. Train, export (TensorRT, ONNX, OpenVINO, CoreML), deploy. Apache-2.0

    GitHub · Python · 225 stars · 39 forks · 0 stars in 24 hours · Trending score 0.70

  24. 24
    sourcenetwork/defradb

    DefraDB is a Peer-to-Peer Edge-First Database. It's the core data storage system for the Source Ecosystem.

    GitHub · Go · 898 stars · 80 forks · +1 stars in 24 hours · Trending score 0.70