litellm repositories
Trending repositories tagged litellm, ranked by trending score. Updated daily.
-
1
Continuum-AI-Corp/OrcaRouter-Lite
Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter
GitHub · Python · 3,485 stars · 484 forks · +137 stars in 24 hours · Trending score 4.46
-
2
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
GitHub · Python · 63,599 stars · 13,441 forks · +122 stars in 24 hours · Trending score 4.24
-
3
martian56/redcell
AI red-team platform. Autonomous LLM agents run a penetration test end to end inside a Kali container and write the report. LangGraph plan/act engine, provider-agnostic models via LiteLLM, PDF/JSON/SARIF output. FastAPI + React.
GitHub · Python · 414 stars · 88 forks · +52 stars in 24 hours · Trending score 3.21
-
4
aiperceivable/apflow
**AI-Perceivable Distributed Orchestration** apflow is a distributed task orchestration engine where every capability is AI-perceivable — discoverable, understandable, and invocable by AI agents through the apcore module standard.
GitHub · Python · 41 stars · 8 forks · +32 stars in 24 hours · Trending score 2.85
-
5
strands-agents/samples
Agent samples built using the Strands Agents SDK.
GitHub · Python · 941 stars · 467 forks · +7 stars in 24 hours · Trending score 1.59
-
6
K-Dense-AI/k-dense-byok
An AI co-scientist running on your desktop. Claude Science but better.
GitHub · TypeScript · 1,451 stars · 192 forks · 0 stars in 24 hours · Trending score 1.49
-
7
ENTERPILOT/GoModel
AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.
GitHub · Go · 1,323 stars · 136 forks · +1 stars in 24 hours · Trending score 1.09
-
8
morphik-org/morphik-core
Open-source multimodal retrieval engine (Morphik Core)
GitHub · Python · 3,722 stars · 324 forks · +3 stars in 24 hours · Trending score 1.00
-
9
Edge-AI-HQ/proactive-assistant
The proactive personal AI that acts before you ask. Connects your apps and devices, builds a lifelong memory, and surfaces proactive cards. Web, macOS and iOS.
GitHub · TypeScript · 13 stars · 1 forks · +5 stars in 24 hours · Trending score 0.92
-
10
PorunC/CodeWiki
CodeWiki is a knowledge platform that analyzes repositories into AST graphs, builds GraphRAG indexes, and generates source-grounded developer wikis with FastAPI, React, and LiteLLM.
GitHub · Python · 161 stars · 15 forks · +2 stars in 24 hours · Trending score 0.91
-
11
ybak/ai-tutorial
中文 AI 应用实战教程(含英文版):AgentScope Java、MCP、RAGFlow、FastGPT、Langfuse、LiteLLM、CopilotKit,本机实测,在线阅读与源码同仓。Hands-on Chinese AI tutorials (English edition available) covering AgentScope Java, MCP, RAGFlow, FastGPT, Langfuse, LiteLLM, and CopilotKit.
GitHub · JavaScript · 26 stars · 2 forks · +1 stars in 24 hours · Trending score 0.83
-
12
dreadnode/rigging
Lightweight LLM Interaction Framework
GitHub · Python · 426 stars · 39 forks · +1 stars in 24 hours · Trending score 0.74
-
13
askalf/dario
One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies.
GitHub · JavaScript · 592 stars · 78 forks · +1 stars in 24 hours · Trending score 0.73
-
14
cuihuan/awesome-ai-gateway
⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.
GitHub · HTML · 158 stars · 152 forks · 0 stars in 24 hours · Trending score 0.69
-
15
ARMANDSnow/make-ur-Agent-writer
Multi-agent LLM pipeline for long-form novel continuation · 多 Agent 长篇小说续写流水线,19 轮迭代 + 全程 mock-first
GitHub · Python · 21 stars · 4 forks · 0 stars in 24 hours · Trending score 0.59
-
16
siamcafe/bomllm
Self-hosted Thai AI infrastructure — Mac Mini M4 Pro running TURBO-Fable 27B at 18.5 tok/s for $0.54/day. Fleet of 9 machines, GOD CONFIG v7.0, 40 IRON safety rules. Production-grade Open WebUI + LiteLLM + Ollama MLX stack.
GitHub · Python · 48 stars · 9 forks · 0 stars in 24 hours · Trending score 0.52
-
17
balcsida/pi-provider-litellm
LiteLLM proxy provider extension for Pi
GitHub · TypeScript · 62 stars · 41 forks · 0 stars in 24 hours · Trending score 0.50
-
18
DataFog/datafog-python
Offline PII firewall for AI agents and LLM apps: fast local detection and redaction, Claude Code hook, LiteLLM guardrail. Zero network calls, one dependency.
GitHub · Python · 80 stars · 15 forks · 0 stars in 24 hours · Trending score 0.49
-
19
ypollak2/llm-router
Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain cuts costs 35-80%.
GitHub · Python · 130 stars · 17 forks · 0 stars in 24 hours · Trending score 0.40
-
20
antiv/mate
Production-ready multi-agent orchestration engine built on Google ADK. Database-driven agent config, 50+ LLM providers, MCP protocol, persistent memory, web dashboard, RBAC.
GitHub · Python · 112 stars · 23 forks · 0 stars in 24 hours · Trending score 0.39
-
21
MiXaiLL76/auto_ai_router
High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection
GitHub · Go · 58 stars · 17 forks · 0 stars in 24 hours · Trending score 0.33
-
22
Kame696/kame-api-rotation-for-agent-zero
🐢⚡ The best free API key rotation + automatic model fallback for Agent Zero. Many keys and models as one pool: every 429 / RESOURCE_EXHAUSTED read, each key rested exactly as long as needed, a late reply raced by your next model. Gemini, OpenAI, OpenRouter, any provider.
GitHub · Python · 24 stars · 3 forks · 0 stars in 24 hours · Trending score 0.33
-
23
fegone/claude-code-delegate-local
MCP server that delegates Claude Code subagents to local models (LiteLLM/llama.cpp/Ollama), DeepSeek, AWS Bedrock, or any OpenAI/Anthropic-compatible backend — without losing the Claude Code orchestrator session.
GitHub · Python · 19 stars · 2 forks · 0 stars in 24 hours · Trending score 0.32
-
24
hwdsl2/self-hosted-ai-stack
Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.
GitHub · Shell · 180 stars · 35 forks · 0 stars in 24 hours · Trending score 0.31