llm-cost-optimization repositories

Trending repositories tagged llm-cost-optimization, ranked by trending score. Updated daily.

  1. 1
    Shweta-Mishra-ai/tokenmizer-research

    Research repository for TokenMizer, a graph-structured session-memory system for long-horizon LLM context management. This repository contains the benchmark suite, the labelled evaluation corpus, all raw results, and the manuscript for the associated paper.

    GitHub · Python · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04

  2. 2
    Cognipeer/console

    Open-source, self-hosted AI gateway and control plane: OpenAI-compatible LLM routing, RAG, an MCP hub, guardrails and agent tracing for multi-tenant teams.

    GitHub · TypeScript · 27 stars · 1 forks · 0 stars in 24 hours · Trending score 0.03

  3. 3
    ppgranger/token-saver

    Content-aware output compression for AI coding assistants. 36 specialized processors cut CLI output tokens by 60-99% (git, pytest, npm, terraform, kubectl, docker, and more) without losing errors, diffs, or stack traces.

    GitHub · Python · 162 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00

  4. 4
    zencefilefendi/kadi

    ⚖️ Kadı — a calibrated judge in front of your frontier LLM. Routine decisions answered locally with a conformal-prediction guarantee (≤ α disagreement with the oracle); everything else escalated and learned from. Zero-dependency Python.

    GitHub · Python · 25 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00