llm-optimization repositories

Trending repositories tagged llm-optimization, ranked by trending score. Updated daily.

  1. 1
    TensorTonic/llm-optimization-handbook

    Make LLMs faster, cheaper and smaller: inference fundamentals, quantization, KV cache, speculative decoding, GPU kernels and serving, with hands-on problems.

    GitHub · 98 stars · 4 forks · +35 stars in 24 hours · Trending score 1.69

  2. 2
    cgallic/kai-cmo-harness

    Open-source marketing harness for Claude Code and Codex: skills for SEO, content, email, ads, launches, CRO and AI-search visibility. Run as a service by Talk To Gina.

    GitHub · Python · 68 stars · 8 forks · +11 stars in 24 hours · Trending score 1.67

  3. 3
    Emmimal/prompt-pruning-layer

    A deterministic, zero-dependency prompt-pruning layer for long-running LLM conversations — expires stale tool state, collapses duplicate context, and proves it never drops a fact a later turn still depends on.

    GitHub · Python · 38 stars · 4 forks · +1 stars in 24 hours · Trending score 0.45

  4. 4
    felan-ai/felan

    Open-source, model-portable coding agent built for cost-efficient, verifiable software work—with model routing, progressive context, compact tool output, explicit task state, and estimated savings.

    GitHub · TypeScript · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08

  5. 5
    Burakkylmz/llm-token-economics-lab

    An experiment-driven LLM engineering lab with 9 reproducible Python experiments exploring token economics, API costs, caching, context growth, latency, model routing, rate limits, concurrency, and batching using Groq.

    GitHub · Python · 22 stars · 9 forks · 0 stars in 24 hours · Trending score 0.08

  6. 6
    choihyunsus/n2-arachne

    Optimize AI workflows with Arachne. Automatically assembles the perfect code context (Tree, Target, Deps, Semantic) to fit context windows without noise. Built for efficiency and scale.

    GitHub · HTML · 60 stars · 6 forks · 0 stars in 24 hours · Trending score 0.01

  7. 7
    pixelfogg/Plyxo-CRO-SEO-AIO-AEO-GEO

    Open-Source AI-Powered CRO, SEO, SXO, AEO & GEO Website Audit Tool. Automated Conversion Rate Optimization, AI Search Visibility (ChatGPT/Perplexity), Core Web Vitals & Visual UX Friction Detection.

    GitHub · TypeScript · 14 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00