GitHub · C++

omgitsbase/llmash

Ollama-compatible LLM server. Beats vllm by 40% on single stream decode, and by 20% on multi stream decode, and beats ollama by much 2-4x. Made possible with custom CUDA kernels, MTP, speculation and its own 3-bit builds. Uncensors models in one command. Windows and Linux, NVIDIA. Optimized to not eat up ram.

Stars
37
Forks
7
Stars gained in 24 hours
0
Forks gained in 24 hours
0

Topics: llm, ollama, ollama-api, local-first, qwen, abliteration, cuda, gemma, gguf, inference-engine

Latest data point: Nov 22, 2026 · 37 stars · 7 forks

Open on GitHub

Trending in C++

  1. 1
    Niko1221/Strata

    Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

    GitHub · C++ · 46,545 stars · 5,187 forks · +629 stars in 24 hours · Trending score 5.41

  2. 2
    boykopovar/AnyPS5

    Tool for automatic PS5 executables porting to Linux and Windows

    GitHub · C++ · 59,585 stars · 5,788 forks · +1,852 stars in 24 hours · Trending score 6.13

  3. 3
    ggml-org/llama.cpp

    LLM inference in C/C++

    GitHub · C++ · 135,964 stars · 25,866 forks · +216 stars in 24 hours · Trending score 4.72

  4. 4
    Inginnng/EditHere

    EditHere — 截图、写下意见、直接调整布局,把修改意图一次交给 AI。

    GitHub · C++ · 1,791 stars · 115 forks · +38 stars in 24 hours · Trending score 3.13

  5. 5
    78/xiaozhi-esp32

    An MCP-based chatbot | 一个基于MCP的聊天机器人

    GitHub · C++ · 33,563 stars · 8,025 forks · +95 stars in 24 hours · Trending score 4.05

  6. 6
    aardappel/goose

    The Goose Programming Language

    GitHub · C++ · 3,778 stars · 185 forks · +43 stars in 24 hours · Trending score 3.37

Trending in llm

  1. 1
    nipmod/nipmod

    Nipmod package intelligence, Codex plugin, MCP workflows and public agent safety tooling.

    GitHub · TypeScript · 0 stars · 0 forks

  2. 2
    RealEgor/re-protocol

    re!think it. System prompt teaching LLMs to execute two core tasks: complex answers without hallucinations, and creative ideas without clichés. Written in math-like logic, which LLMs parse better than plain language. Built for mid-to-high complexity tasks, featuring a Bypass branch to execute simple prompts directly without added cognitive overhead

    GitHub · 14 stars · 0 forks

  3. 3
    LucasDuys/forge

    Turn a one-line idea into a branch with tested, reviewed, committed code. The brainstorm-to-commit pipeline for Claude Code.

    GitHub · JavaScript · 57 stars · 6 forks · 0 stars in 24 hours · Trending score 0.92

  4. 4
    pessini/langgraph-skills-agent

    Source repo for the blog post Stop Stuffing Your System Prompt: Build Scalable Agent Skills in LangGraph

    GitHub · Python · 14 stars · 1 forks