semantic-cache repositories
Trending repositories tagged semantic-cache, ranked by trending score. Updated daily.
-
1
maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
GitHub · Go · 9,845 stars · 1,637 forks · +98 stars in 24 hours · Trending score 3.89
-
2
yanstd888/9routerx
9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
GitHub · Go · 256 stars · 158 forks · +8 stars in 24 hours · Trending score 2.85
-
3
redis/redis-vl-python
Redis Vector Library. The AI-native Python client for Redis.
GitHub · Python · 437 stars · 125 forks · +1 stars in 24 hours · Trending score 0.54
-
4
888newstep/ai-agent-platform
企业级 AI Agent 平台 | Spring Boot 3 + LangChain4j | ReAct 推理 + 多路召回 RAG + 语义缓存 + 多智能体协作
GitHub · Java · 126 stars · 6 forks · 0 stars in 24 hours · Trending score 0.45
-
5
redis-developer/adk-redis
Redis integration for Google Agent Development Kit (ADK) - Memory, Sessions, Search Tools, MCP
GitHub · Python · 32 stars · 5 forks · 0 stars in 24 hours · Trending score 0.26
-
6
kushals256/jevcache
MorrowCache: open-source semantic cache for OpenAI-compatible LLM APIs. Local proxy that reuses answers for paraphrased prompts and AI agent retries. npm: @kushalicious/jevcache
GitHub · TypeScript · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09
-
7
AlphaBitCore/nexus-gateway
Enterprise AI traffic gateway — unified compliance, routing across 20+ LLM providers, semantic cache, quotas, and audit. SDK / network / OS-layer intercept.
GitHub · Go · 25 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00
-
8
Rohit-Dnath/RAMen
RAMen is a fast in-memory data store like Redis, but built for AI: drop-in Redis protocol, native vector search, semantic caching, and a built-in MCP server for agents. Single Go binary, BSD-3.
GitHub · Go · 38 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00
-
9
NaCode-Studios/Kmemo
Kotlin Multiplatform semantic cache for LLM calls: eleven guards against false cache hits, measured on blind corpora, coroutine-first.
GitHub · Kotlin · 8 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
10
brienteth/openclaw-hermes-depin
Run OpenClaw Web Automation & Hermes AI Agents 100% Free on Your PC powered by MYCA DePIN Mesh & Zero-Cost Semantic Cache
GitHub · JavaScript · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
11
alphaparkinc/genpark-cosine-bm25-reciprocal-rank-fusion-skill
Zero-dependency hybrid retrieval engine fusing sparse lexical BM25 Okapi and dense Cosine vector similarities via Reciprocal Rank Fusion.
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
12
alphaparkinc/genpark-knowledge-graph-entity-relation-triplet-extractor-skill
Entity-relation-object triplet extractor and multi-hop path reasoning kernel with Cypher and JSON-LD graph generation.
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
13
alphaparkinc/genpark-agent-semantic-cache-similarity-deduplicator-skill
High-throughput semantic query cache and approximate deduplicator combining exact SHA-256 and cosine similarity threshold matching with LRU eviction.
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
14
alphaparkinc/genpark-context-window-lost-in-middle-reorderer-skill
Context window attention optimizer reordering retrieved documents to place critical evidence at prompt boundaries, mitigating lost-in-the-middle degradation.
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
15
alphaparkinc/genpark-agent-semantic-cache-query-matcher-skill
Deterministic Python Model Context Protocol (MCP) server & autonomous agent skill for Agent Semantic Cache Query Matcher.
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
16
alphaparkinc/genpark-semantic-cache-and-prompt-deduplication-sentinel-skill
Evaluates prompt similarity via n-gram shingling, token hashing, and min-hash signatures to serve deterministic cached agent responses and eliminate redundant LLM calls | GenPark: https://www.genpark.ai | LinkedIn: https://www.llinkedin.com/company/92955550
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
17
shinefuer/frugent
Cost-efficient coding-agent runtime: prefix-aware prompt-cache routing, poisoning-safe semantic cache, budgeted context compression, request batching/dedup, cascading model routing with DP-optimal policies, hard budget scheduling, span-level cost attribution, sandboxed tools, synthetic workload factory. NumPy core, CPU-only torch extra.
GitHub · Python · 37 stars · 237 forks · 0 stars in 24 hours · Trending score 0.00