llm-cost-optimization repositories
Trending repositories tagged llm-cost-optimization, ranked by trending score. Updated daily.
-
1
Shweta-Mishra-ai/tokenmizer-research
Research repository for TokenMizer, a graph-structured session-memory system for long-horizon LLM context management. This repository contains the benchmark suite, the labelled evaluation corpus, all raw results, and the manuscript for the associated paper.
GitHub · Python · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04
-
2
Cognipeer/console
Open-source, self-hosted AI gateway and control plane: OpenAI-compatible LLM routing, RAG, an MCP hub, guardrails and agent tracing for multi-tenant teams.
GitHub · TypeScript · 27 stars · 1 forks · 0 stars in 24 hours · Trending score 0.03
-
3
ppgranger/token-saver
Content-aware output compression for AI coding assistants. 36 specialized processors cut CLI output tokens by 60-99% (git, pytest, npm, terraform, kubectl, docker, and more) without losing errors, diffs, or stack traces.
GitHub · Python · 162 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00
-
4
zencefilefendi/kadi
⚖️ Kadı — a calibrated judge in front of your frontier LLM. Routine decisions answered locally with a conformal-prediction guarantee (≤ α disagreement with the oracle); everything else escalated and learned from. Zero-dependency Python.
GitHub · Python · 25 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00