llamacpp repositories
Trending repositories tagged llamacpp, ranked by trending score. Updated daily.
-
1
janhq/jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
GitHub · Rust · 45,947 stars · 3,223 forks · +98 stars in 24 hours · Trending score 3.71
-
2
khoj-ai/khoj
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
GitHub · Python · 38,184 stars · 2,559 forks · +18 stars in 24 hours · Trending score 2.54
-
3
AtomicBot-ai/Atomic-Chat
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
GitHub · TypeScript · 2,034 stars · 234 forks · +21 stars in 24 hours · Trending score 2.50
-
4
ngxson/wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
GitHub · TypeScript · 1,397 stars · 141 forks · +33 stars in 24 hours · Trending score 2.49
-
5
mixa3607/ML-gfx906
ML software (llama.cpp, ComfyUI, Strata, Maya, ...) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
GitHub · C++ · 388 stars · 41 forks · +24 stars in 24 hours · Trending score 2.34
-
6
xorbitsai/inference
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
GitHub · Python · 9,666 stars · 902 forks · +7 stars in 24 hours · Trending score 1.82
-
7
Cerid-AI/quenchforge
Local LLM, embedding, reranker, and Whisper inference for Mac + AMD discrete GPU. Ollama- and OpenAI-compatible HTTP APIs. Apache-2.0.
GitHub · Go · 11 stars · 3 forks · +3 stars in 24 hours · Trending score 1.00
-
8
llamastash/llamastash
Zero-overhead, terminal-native local-LLM orchestrator. Run any engine, any model via the same proxy.
GitHub · Rust · 302 stars · 24 forks · 0 stars in 24 hours · Trending score 0.88
-
9
sybil-solutions/local-studio
Control panel for VLLM, Sglang, llama.cpp, exllamav3
GitHub · TypeScript · 1,850 stars · 172 forks · +1 stars in 24 hours · Trending score 0.85
-
10
raketenkater/ggrun
llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
GitHub · Go · 284 stars · 18 forks · +2 stars in 24 hours · Trending score 0.81
-
11
jegly/Box
The most advanced, fully offline client-side AI suite on Android today.
GitHub · Kotlin · 1,024 stars · 69 forks · 0 stars in 24 hours · Trending score 0.80
-
12
twinnydotdev/twinny
Open-source AI coding assistant for VS Code. Coding agent, code completion, chat, edits and reviews with local or hosted models. Your models, your infrastructure.
GitHub · TypeScript · 3,701 stars · 244 forks · 0 stars in 24 hours · Trending score 0.67
-
13
Fast-Editor/Lynkr
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
GitHub · JavaScript · 642 stars · 78 forks · +1 stars in 24 hours · Trending score 0.61
-
14
shubham0204/SmolChat-Android
Running any GGUF SLMs/LLMs locally, on-device in Android
GitHub · Kotlin · 911 stars · 153 forks · 0 stars in 24 hours · Trending score 0.58
-
15
jegly/OfflineLLM
Private on-device AI chat for Android - runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration - PQC ML-DSA-87 signed releases
GitHub · Kotlin · 291 stars · 29 forks · −1 stars in 24 hours · Trending score 0.55
-
16
hybridgroup/yzma
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
GitHub · Go · 675 stars · 30 forks · 0 stars in 24 hours · Trending score 0.48
-
17
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
GitHub · C# · 3,825 stars · 517 forks · 0 stars in 24 hours · Trending score 0.40
-
18
xybrid-ai/xybrid
Cross-platform on-device AI toolkit
GitHub · Rust · 526 stars · 59 forks · 0 stars in 24 hours · Trending score 0.40
-
19
dakotacookson/Llama-RPC-Farm
Web UI to pool your home machines into one llama.cpp cluster: multi-machine RPC GPU pooling + on-demand multi-model serving via llama-swap
GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.37
-
20
bloodworks-io/phlox
Open source, local first AI medical agent for desktop and web.
GitHub · JavaScript · 112 stars · 23 forks · 0 stars in 24 hours · Trending score 0.36
-
21
CambrianTech/continuum
Local-first AI citizens on your own hardware. Teams of continuously-learning personas (Rust core, llama.cpp fork, LoRA genomes) that collaborate, remember, dream, and improve on public benchmarks — on a MacBook. Not assistants you rent: minds you host.
GitHub · Rust · 39 stars · 11 forks · 0 stars in 24 hours · Trending score 0.33
-
22
Mobile-Artificial-Intelligence/llama_sdk
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
GitHub · C++ · 124 stars · 25 forks · 0 stars in 24 hours · Trending score 0.30
-
23
lordmathis/llamactl
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
GitHub · Go · 161 stars · 36 forks · 0 stars in 24 hours · Trending score 0.28
-
24
rozsival/panther-minor
🐆 Self-hosted AI workstation stack for @amd
GitHub · Shell · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22