single-executable / library which combines llama.cpp, whisper.cpp, and stable-diffusion.cpp
GitHub repository with 10 stars and 0 forks.
Language: C++
Topics: llama-cpp, llm-inference, llm-server, rag, sqlite, stable-diffusion-cpp, whisper-cpp
Trending score 0.89, freshness score 0.97, stars gained +2, forks gained +0.
2026-06-15: 10 stars and 0 forks.
Fast LLM speculative inference server for consumer hardware.
GitHub repository with 2,470 stars and 227 forks.
Trending score: 2.88; stars gained: +27; forks gained: +6.
Language: C++
Topics: kernel, llama-cpp, local-ai, nvidia-cuda, qwen, rtx3090
single-executable / library which combines llama.cpp, whisper.cpp, and stable-diffusion.cpp
GitHub repository with 10 stars and 0 forks.
Trending score: 0.89; stars gained: +2; forks gained: +0.
Language: C++
Topics: llama-cpp, llm-inference, llm-server, rag, sqlite, stable-diffusion-cpp
llama.cpp fork tuned for running modern models (Gemma-4, Qwen3.x) at full context on 12 GB Turing GPUs (RTX 2060/2070/2080, T4). TurboQuant KV cache (KTQ+VTQ, 2.78 bpw f16-quality), SWA-aware KV, MTP+n-gram speculation.
GitHub repository with 6 stars and 0 forks.
Trending score: 0.10; stars gained: +0; forks gained: +0.
Language: C++
Topics: fine-tuning, kv-cache, llama-cpp, llama-tq, low-vram, speculative-decoding
LLM inference in C/C++
GitHub repository with 116,581 stars and 19,587 forks.
Trending score: 4.92; stars gained: +285; forks gained: +59.
Language: C++
Topics: ggml
Open Source Computer Vision Library
GitHub repository with 89,152 stars and 56,658 forks.
Trending score: 4.35; stars gained: +147; forks gained: +16.
Language: C++
Topics: c-plus-plus, computer-vision, deep-learning, image-processing, opencv
A lightweight, lightning-fast, in-process vector database
GitHub repository with 10,064 stars and 583 forks.
Trending score: 4.23; stars gained: +283; forks gained: +17.
Language: C++
Topics: agent-skills, db, embedded, faiss, hnsw, llm-memory
Port of OpenAI's Whisper model in C/C++
GitHub repository with 50,727 stars and 5,661 forks.
Trending score: 3.92; stars gained: +155; forks gained: +26.
Language: C++
Topics: inference, openai, speech-recognition, speech-to-text, transformer, whisper
A sleek and minimal desktop shell thoughtfully crafted for Wayland.
GitHub repository with 7,749 stars and 545 forks.
Trending score: 3.82; stars gained: +91; forks gained: +10.
Language: C++
Topics: dotfiles, hyprland, linux, niri, noctalia, quickshell
MLX: An array framework for Apple silicon
GitHub repository with 27,010 stars and 1,908 forks.
Trending score: 3.68; stars gained: +58; forks gained: +10.
Language: C++
Topics: mlx
Fast LLM speculative inference server for consumer hardware.
GitHub repository with 2,470 stars and 227 forks.
Trending score: 2.88; stars gained: +27; forks gained: +6.
Language: C++
Topics: kernel, llama-cpp, local-ai, nvidia-cuda, qwen, rtx3090
AI-Git-Bot is a lightweight, self-hostable gateway application that connects your Git platforms with AI providers
GitHub repository with 86 stars and 20 forks.
Trending score: 2.37; stars gained: +18; forks gained: +9.
Language: Java
Topics: ai, ai-tools, anthropic, bot, gitea, pull-request
Cotabby is local AI autocomplete for your entire Mac. Open source. On device. Everywhere you type.
GitHub repository with 765 stars and 42 forks.
Trending score: 2.07; stars gained: +7; forks gained: +2.
Language: Swift
Topics: ai, macos, autocomplete, llama, llama-cpp, local-ai
Complete guide to running large language models locally on AMD Strix Halo / Ryzen AI MAX+ 395 with Radeon 8060S (gfx1151) and 96GB/128GB unified memory. Covers BIOS config, Ubuntu/kernel setup, Ollama, llama.cpp Vulkan/RADV, ROCm/HIP, vLLM, and 70B/120B GGUF evidence.
GitHub repository with 142 stars and 6 forks.
Trending score: 1.97; stars gained: +9; forks gained: +0.
Language: Python
Topics: amd, benchmark, gfx1151, llama-cpp, llm, local-llm
AI-powered screen memory — captures, analyzes, and lets you search/chat your screen history. Powered by Gemma 4 . 100% local, 100% private.
GitHub repository with 70 stars and 2 forks.
Trending score: 1.93; stars gained: +11; forks gained: +0.
Language: Python
Topics: ai, fastapi, gemma, llama-cpp, localai, multimodal
A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and cross-device sync. Built with Swift.
GitHub repository with 136 stars and 8 forks.
Trending score: 1.74; stars gained: +8; forks gained: +2.
Language: Swift
Topics: ai-assistant, apple-watch, ios, llm-client, mcp, rag