ggml repositories

Trending repositories tagged ggml, ranked by trending score. Updated daily.

  1. 1
    ggml-org/llama.cpp

    LLM inference in C/C++

    GitHub · C++ · 135,810 stars · 25,818 forks · +85 stars in 24 hours · Trending score 4.41

  2. 2
    timoncool/YuE2-Studio

    Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.

    GitHub · TypeScript · 2,387 stars · 280 forks · +58 stars in 24 hours · Trending score 3.57

  3. 3
    JakeATX/llamAmpere

    llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

    GitHub · C++ · 403 stars · 50 forks · +87 stars in 24 hours · Trending score 3.35

  4. 4
    0xShug0/audio.cpp

    An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.

    GitHub · C++ · 4,359 stars · 538 forks · +45 stars in 24 hours · Trending score 3.33

  5. 5
    alexturkey/voxcpm2-turkce-ses-tasarimi

    Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read text in 30 languages. Patched audio.cpp, local UI in 30 languages, 14 ready-made voices.

    GitHub · Python · 467 stars · 70 forks · +25 stars in 24 hours · Trending score 2.69

  6. 6
    Zyphra/ZONOS3-Mini

    compact zero-shot voice-cloning TTS with state-of-the-art performance, leading voice control, real-time on-device.

    GitHub · Python · 254 stars · 28 forks · +32 stars in 24 hours · Trending score 1.68

  7. 7
    alexturkey/wan22-pascal-4gb

    Wan 2.2 TI2V-5B video generation on a 4 GB GTX 1050 Ti (Pascal): stable-diffusion.cpp patches, byte-identical speedups, recipe and agent-readable install guide

    GitHub · Python · 27 stars · 13 forks · +15 stars in 24 hours · Trending score 1.42

  8. 8
    CrispStrobe/CrispASR

    C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more

    GitHub · C++ · 822 stars · 124 forks · +3 stars in 24 hours · Trending score 1.37

  9. 9
    nyosegawa/speech.cpp

    Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.

    GitHub · C++ · 419 stars · 28 forks · 0 stars in 24 hours · Trending score 1.32

  10. 10
    leejet/stable-diffusion.cpp

    Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++

    GitHub · C++ · 8,024 stars · 963 forks · 0 stars in 24 hours · Trending score 1.25

  11. 11
    NVIDIA/NeMo-Speech.cpp

    NeMo-Speech.cpp is a lightweight C++ inference runtime for Speech models

    GitHub · C++ · 254 stars · 58 forks · 0 stars in 24 hours · Trending score 1.08

  12. 12
    CrispStrobe/CrispEmbed

    Lightweight text and scans processing: embedding, document processing, OCR, OMR, etc, with inference via ggml in pure C++

    GitHub · Python · 81 stars · 14 forks · +2 stars in 24 hours · Trending score 0.91

  13. 13
    orailnoor/hush-studio

    Offline AI narration studio for Android: turn scripts into natural speech and clone your voice, all on-device. No cloud, no account.

    GitHub · Kotlin · 53 stars · 9 forks · +1 stars in 24 hours · Trending score 0.83

  14. 14
    shubham0204/SmolChat-Android

    Running any GGUF SLMs/LLMs locally, on-device in Android

    GitHub · Kotlin · 911 stars · 153 forks · 0 stars in 24 hours · Trending score 0.58

  15. 15
    1picassoai/kraits

    Run stock llama.cpp with large MoE models like Qwen3.8-Flash-Next (91 GB, 4-bit) on a 16 GB Mac.

    GitHub · Rust · 15 stars · 1 forks · +1 stars in 24 hours · Trending score 0.55

  16. 16
    llamatik/Llamatik

    True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

    GitHub · Kotlin · 223 stars · 38 forks · 0 stars in 24 hours · Trending score 0.40

  17. 17
    OpenBitSys/vlut.cpp

    [MobiSys 2026] On-device ultra-low-bit LLM inference with LUT

    GitHub · C++ · 29 stars · 6 forks · 0 stars in 24 hours · Trending score 0.37

  18. 18
    Mobile-Artificial-Intelligence/llama_sdk

    lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

    GitHub · C++ · 124 stars · 25 forks · 0 stars in 24 hours · Trending score 0.30

  19. 19
    gregordinary/ggml-rocket

    Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU

    GitHub · C++ · 28 stars · 4 forks · 0 stars in 24 hours · Trending score 0.28

  20. 20
    papayawhiiptrial001/cs2-trigger-assist

    CS2 Triggerbot 2026: Configurable Delay, Head-Only Mode, Team Damage Prevention

    GitHub · TypeScript · 133 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  21. 21
    ranjithrajv/awesome-cpu-first-ai

    Curated, evidence-backed list of runtimes, formats & tools for running AI inference on CPU — start with CPU, justify the GPU.

    GitHub · Python · 5 stars · 4 forks · 0 stars in 24 hours · Trending score 0.08

  22. 22
    launcher-rs/audio-cpp-rs

    audio.cpp(基于 ggml 的本地音频推理引擎)的 Rust 安全绑定与 FFI 封装:TTS / ASR / VAD / 说话人分离 / 音源分离 / 声音克隆 / 音频编解码 / 音乐生成,覆盖 135 个模型族,后端支持 CPU、CUDA、HIP、Vulkan、Metal,提供离线与流式 API 与预编译库自动下载。

    GitHub · Rust · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07

  23. 23
    ProjectArgus-cc/libargus.cc

    Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in-process.

    GitHub · Java · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.07

  24. 24
    Lourdle/cosyvoice.cpp

    CosyVoice inference in C/C++

    GitHub · C++ · 59 stars · 16 forks · 0 stars in 24 hours · Trending score 0.06