llamacpp repositories

Trending repositories tagged llamacpp, ranked by trending score. Updated daily.

  1. 1
    janhq/jan

    Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

    GitHub · Rust · 45,947 stars · 3,223 forks · +98 stars in 24 hours · Trending score 3.71

  2. 2
    khoj-ai/khoj

    Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

    GitHub · Python · 38,184 stars · 2,559 forks · +18 stars in 24 hours · Trending score 2.54

  3. 3
    AtomicBot-ai/Atomic-Chat

    Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

    GitHub · TypeScript · 2,034 stars · 234 forks · +21 stars in 24 hours · Trending score 2.50

  4. 4
    ngxson/wllama

    WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

    GitHub · TypeScript · 1,397 stars · 141 forks · +33 stars in 24 hours · Trending score 2.49

  5. 5
    mixa3607/ML-gfx906

    ML software (llama.cpp, ComfyUI, Strata, Maya, ...) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60

    GitHub · C++ · 388 stars · 41 forks · +24 stars in 24 hours · Trending score 2.34

  6. 6
    xorbitsai/inference

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    GitHub · Python · 9,666 stars · 902 forks · +7 stars in 24 hours · Trending score 1.82

  7. 7
    Cerid-AI/quenchforge

    Local LLM, embedding, reranker, and Whisper inference for Mac + AMD discrete GPU. Ollama- and OpenAI-compatible HTTP APIs. Apache-2.0.

    GitHub · Go · 11 stars · 3 forks · +3 stars in 24 hours · Trending score 1.00

  8. 8
    llamastash/llamastash

    Zero-overhead, terminal-native local-LLM orchestrator. Run any engine, any model via the same proxy.

    GitHub · Rust · 302 stars · 24 forks · 0 stars in 24 hours · Trending score 0.88

  9. 9
    sybil-solutions/local-studio

    Control panel for VLLM, Sglang, llama.cpp, exllamav3

    GitHub · TypeScript · 1,850 stars · 172 forks · +1 stars in 24 hours · Trending score 0.85

  10. 10
    raketenkater/ggrun

    llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

    GitHub · Go · 284 stars · 18 forks · +2 stars in 24 hours · Trending score 0.81

  11. 11
    jegly/Box

    The most advanced, fully offline client-side AI suite on Android today.

    GitHub · Kotlin · 1,024 stars · 69 forks · 0 stars in 24 hours · Trending score 0.80

  12. 12
    twinnydotdev/twinny

    Open-source AI coding assistant for VS Code. Coding agent, code completion, chat, edits and reviews with local or hosted models. Your models, your infrastructure.

    GitHub · TypeScript · 3,701 stars · 244 forks · 0 stars in 24 hours · Trending score 0.67

  13. 13
    Fast-Editor/Lynkr

    Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

    GitHub · JavaScript · 642 stars · 78 forks · +1 stars in 24 hours · Trending score 0.61

  14. 14
    shubham0204/SmolChat-Android

    Running any GGUF SLMs/LLMs locally, on-device in Android

    GitHub · Kotlin · 911 stars · 153 forks · 0 stars in 24 hours · Trending score 0.58

  15. 15
    jegly/OfflineLLM

    Private on-device AI chat for Android - runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration - PQC ML-DSA-87 signed releases

    GitHub · Kotlin · 291 stars · 29 forks · −1 stars in 24 hours · Trending score 0.55

  16. 16
    hybridgroup/yzma

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    GitHub · Go · 675 stars · 30 forks · 0 stars in 24 hours · Trending score 0.48

  17. 17
    SciSharp/LLamaSharp

    A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

    GitHub · C# · 3,825 stars · 517 forks · 0 stars in 24 hours · Trending score 0.40

  18. 18
    xybrid-ai/xybrid

    Cross-platform on-device AI toolkit

    GitHub · Rust · 526 stars · 59 forks · 0 stars in 24 hours · Trending score 0.40

  19. 19
    dakotacookson/Llama-RPC-Farm

    Web UI to pool your home machines into one llama.cpp cluster: multi-machine RPC GPU pooling + on-demand multi-model serving via llama-swap

    GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.37

  20. 20
    bloodworks-io/phlox

    Open source, local first AI medical agent for desktop and web.

    GitHub · JavaScript · 112 stars · 23 forks · 0 stars in 24 hours · Trending score 0.36

  21. 21
    CambrianTech/continuum

    Local-first AI citizens on your own hardware. Teams of continuously-learning personas (Rust core, llama.cpp fork, LoRA genomes) that collaborate, remember, dream, and improve on public benchmarks — on a MacBook. Not assistants you rent: minds you host.

    GitHub · Rust · 39 stars · 11 forks · 0 stars in 24 hours · Trending score 0.33

  22. 22
    Mobile-Artificial-Intelligence/llama_sdk

    lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

    GitHub · C++ · 124 stars · 25 forks · 0 stars in 24 hours · Trending score 0.30

  23. 23
    lordmathis/llamactl

    Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

    GitHub · Go · 161 stars · 36 forks · 0 stars in 24 hours · Trending score 0.28

  24. 24
    rozsival/panther-minor

    🐆 Self-hosted AI workstation stack for @amd

    GitHub · Shell · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22