llm-cache repositories
Trending repositories tagged llm-cache, ranked by trending score. Updated daily.
-
1
PerryLink/dsh-fast
Read-only performance diagnostics for DeepSeek Harness: session load/restore timing, spill-hit counts, compaction count and trigger, context-injection volume (AGENTS.md/skills/tool-schema token share), and LLM cache hit rate — surfaced via /fast, persisted as reconstructable session events with async sampling off the model path.
GitHub · TypeScript · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22
-
2
kushals256/jevcache
MorrowCache: open-source semantic cache for OpenAI-compatible LLM APIs. Local proxy that reuses answers for paraphrased prompts and AI agent retries. npm: @kushalicious/jevcache
GitHub · TypeScript · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09
-
3
sno-ai/llmix
Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.
GitHub · Python · 128 stars · 24 forks · 0 stars in 24 hours · Trending score 0.00