sno-ai/llmix
Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.
GitHub repository with 129 stars and 28 forks.
Language: Python
Topics: ai-agents, ai-sdk, ai-tools, anthropic, circuit-breaker, gemini, key-rotation, litellm, llm, llm-cache