llm-optimization repositories
Trending repositories tagged llm-optimization, ranked by trending score. Updated daily.
-
1
TensorTonic/llm-optimization-handbook
Make LLMs faster, cheaper and smaller: inference fundamentals, quantization, KV cache, speculative decoding, GPU kernels and serving, with hands-on problems.
GitHub · 98 stars · 4 forks · +35 stars in 24 hours · Trending score 1.69
-
2
cgallic/kai-cmo-harness
Open-source marketing harness for Claude Code and Codex: skills for SEO, content, email, ads, launches, CRO and AI-search visibility. Run as a service by Talk To Gina.
GitHub · Python · 68 stars · 8 forks · +11 stars in 24 hours · Trending score 1.67
-
3
Emmimal/prompt-pruning-layer
A deterministic, zero-dependency prompt-pruning layer for long-running LLM conversations — expires stale tool state, collapses duplicate context, and proves it never drops a fact a later turn still depends on.
GitHub · Python · 38 stars · 4 forks · +1 stars in 24 hours · Trending score 0.45
-
4
felan-ai/felan
Open-source, model-portable coding agent built for cost-efficient, verifiable software work—with model routing, progressive context, compact tool output, explicit task state, and estimated savings.
GitHub · TypeScript · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08
-
5
Burakkylmz/llm-token-economics-lab
An experiment-driven LLM engineering lab with 9 reproducible Python experiments exploring token economics, API costs, caching, context growth, latency, model routing, rate limits, concurrency, and batching using Groq.
GitHub · Python · 22 stars · 9 forks · 0 stars in 24 hours · Trending score 0.08
-
6
choihyunsus/n2-arachne
Optimize AI workflows with Arachne. Automatically assembles the perfect code context (Tree, Target, Deps, Semantic) to fit context windows without noise. Built for efficiency and scale.
GitHub · HTML · 60 stars · 6 forks · 0 stars in 24 hours · Trending score 0.01
-
7
pixelfogg/Plyxo-CRO-SEO-AIO-AEO-GEO
Open-Source AI-Powered CRO, SEO, SXO, AEO & GEO Website Audit Tool. Automated Conversion Rate Optimization, AI Search Visibility (ChatGPT/Perplexity), Core Web Vitals & Visual UX Friction Detection.
GitHub · TypeScript · 14 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00