llm-cache repositories

Trending repositories tagged llm-cache, ranked by trending score. Updated daily.

  1. 1
    PerryLink/dsh-fast

    Read-only performance diagnostics for DeepSeek Harness: session load/restore timing, spill-hit counts, compaction count and trigger, context-injection volume (AGENTS.md/skills/tool-schema token share), and LLM cache hit rate — surfaced via /fast, persisted as reconstructable session events with async sampling off the model path.

    GitHub · TypeScript · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22

  2. 2
    kushals256/jevcache

    MorrowCache: open-source semantic cache for OpenAI-compatible LLM APIs. Local proxy that reuses answers for paraphrased prompts and AI agent retries. npm: @kushalicious/jevcache

    GitHub · TypeScript · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09

  3. 3
    sno-ai/llmix

    Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.

    GitHub · Python · 128 stars · 24 forks · 0 stars in 24 hours · Trending score 0.00