ggml repositories
Trending repositories tagged ggml, ranked by trending score. Updated daily.
-
1
ggml-org/llama.cpp
LLM inference in C/C++
GitHub · C++ · 135,810 stars · 25,818 forks · +85 stars in 24 hours · Trending score 4.41
-
2
timoncool/YuE2-Studio
Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.
GitHub · TypeScript · 2,387 stars · 280 forks · +58 stars in 24 hours · Trending score 3.57
-
3
JakeATX/llamAmpere
llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.
GitHub · C++ · 403 stars · 50 forks · +87 stars in 24 hours · Trending score 3.35
-
4
0xShug0/audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
GitHub · C++ · 4,359 stars · 538 forks · +45 stars in 24 hours · Trending score 3.33
-
5
alexturkey/voxcpm2-turkce-ses-tasarimi
Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read text in 30 languages. Patched audio.cpp, local UI in 30 languages, 14 ready-made voices.
GitHub · Python · 467 stars · 70 forks · +25 stars in 24 hours · Trending score 2.69
-
6
Zyphra/ZONOS3-Mini
compact zero-shot voice-cloning TTS with state-of-the-art performance, leading voice control, real-time on-device.
GitHub · Python · 254 stars · 28 forks · +32 stars in 24 hours · Trending score 1.68
-
7
alexturkey/wan22-pascal-4gb
Wan 2.2 TI2V-5B video generation on a 4 GB GTX 1050 Ti (Pascal): stable-diffusion.cpp patches, byte-identical speedups, recipe and agent-readable install guide
GitHub · Python · 27 stars · 13 forks · +15 stars in 24 hours · Trending score 1.42
-
8
CrispStrobe/CrispASR
C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more
GitHub · C++ · 822 stars · 124 forks · +3 stars in 24 hours · Trending score 1.37
-
9
nyosegawa/speech.cpp
Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.
GitHub · C++ · 419 stars · 28 forks · 0 stars in 24 hours · Trending score 1.32
-
10
leejet/stable-diffusion.cpp
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++
GitHub · C++ · 8,024 stars · 963 forks · 0 stars in 24 hours · Trending score 1.25
-
11
NVIDIA/NeMo-Speech.cpp
NeMo-Speech.cpp is a lightweight C++ inference runtime for Speech models
GitHub · C++ · 254 stars · 58 forks · 0 stars in 24 hours · Trending score 1.08
-
12
CrispStrobe/CrispEmbed
Lightweight text and scans processing: embedding, document processing, OCR, OMR, etc, with inference via ggml in pure C++
GitHub · Python · 81 stars · 14 forks · +2 stars in 24 hours · Trending score 0.91
-
13
orailnoor/hush-studio
Offline AI narration studio for Android: turn scripts into natural speech and clone your voice, all on-device. No cloud, no account.
GitHub · Kotlin · 53 stars · 9 forks · +1 stars in 24 hours · Trending score 0.83
-
14
shubham0204/SmolChat-Android
Running any GGUF SLMs/LLMs locally, on-device in Android
GitHub · Kotlin · 911 stars · 153 forks · 0 stars in 24 hours · Trending score 0.58
-
15
1picassoai/kraits
Run stock llama.cpp with large MoE models like Qwen3.8-Flash-Next (91 GB, 4-bit) on a 16 GB Mac.
GitHub · Rust · 15 stars · 1 forks · +1 stars in 24 hours · Trending score 0.55
-
16
llamatik/Llamatik
True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
GitHub · Kotlin · 223 stars · 38 forks · 0 stars in 24 hours · Trending score 0.40
-
17
OpenBitSys/vlut.cpp
[MobiSys 2026] On-device ultra-low-bit LLM inference with LUT
GitHub · C++ · 29 stars · 6 forks · 0 stars in 24 hours · Trending score 0.37
-
18
Mobile-Artificial-Intelligence/llama_sdk
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
GitHub · C++ · 124 stars · 25 forks · 0 stars in 24 hours · Trending score 0.30
-
19
gregordinary/ggml-rocket
Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU
GitHub · C++ · 28 stars · 4 forks · 0 stars in 24 hours · Trending score 0.28
-
20
papayawhiiptrial001/cs2-trigger-assist
CS2 Triggerbot 2026: Configurable Delay, Head-Only Mode, Team Damage Prevention
GitHub · TypeScript · 133 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
21
ranjithrajv/awesome-cpu-first-ai
Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.
GitHub · Python · 5 stars · 4 forks · 0 stars in 24 hours · Trending score 0.08
-
22
launcher-rs/audio-cpp-rs
audio.cpp(基于 ggml 的本地音频推理引擎)的 Rust 安全绑定与 FFI 封装:TTS / ASR / VAD / 说话人分离 / 音源分离 / 声音克隆 / 音频编解码 / 音乐生成,覆盖 135 个模型族,后端支持 CPU、CUDA、HIP、Vulkan、Metal,提供离线与流式 API 与预编译库自动下载。
GitHub · Rust · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07
-
23
ProjectArgus-cc/libargus.cc
Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process.
GitHub · Java · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.07
-
24
Lourdle/cosyvoice.cpp
CosyVoice inference in C/C++
GitHub · C++ · 59 stars · 16 forks · 0 stars in 24 hours · Trending score 0.06