litellm repositories

Trending repositories tagged litellm, ranked by trending score. Updated daily.

  1. 1
    Continuum-AI-Corp/OrcaRouter-Lite

    Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

    GitHub · Python · 3,485 stars · 484 forks · +137 stars in 24 hours · Trending score 4.46

  2. 2
    BerriAI/litellm

    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

    GitHub · Python · 63,599 stars · 13,441 forks · +122 stars in 24 hours · Trending score 4.24

  3. 3
    martian56/redcell

    AI red-team platform. Autonomous LLM agents run a penetration test end to end inside a Kali container and write the report. LangGraph plan/act engine, provider-agnostic models via LiteLLM, PDF/JSON/SARIF output. FastAPI + React.

    GitHub · Python · 414 stars · 88 forks · +52 stars in 24 hours · Trending score 3.21

  4. 4
    aiperceivable/apflow

    **AI-Perceivable Distributed Orchestration** apflow is a distributed task orchestration engine where every capability is AI-perceivable — discoverable, understandable, and invocable by AI agents through the apcore module standard.

    GitHub · Python · 41 stars · 8 forks · +32 stars in 24 hours · Trending score 2.85

  5. 5
    strands-agents/samples

    Agent samples built using the Strands Agents SDK.

    GitHub · Python · 941 stars · 467 forks · +7 stars in 24 hours · Trending score 1.59

  6. 6
    K-Dense-AI/k-dense-byok

    An AI co-scientist running on your desktop. Claude Science but better.

    GitHub · TypeScript · 1,451 stars · 192 forks · 0 stars in 24 hours · Trending score 1.49

  7. 7
    ENTERPILOT/GoModel

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

    GitHub · Go · 1,323 stars · 136 forks · +1 stars in 24 hours · Trending score 1.09

  8. 8
    morphik-org/morphik-core

    Open-source multimodal retrieval engine (Morphik Core)

    GitHub · Python · 3,722 stars · 324 forks · +3 stars in 24 hours · Trending score 1.00

  9. 9
    Edge-AI-HQ/proactive-assistant

    The proactive personal AI that acts before you ask. Connects your apps and devices, builds a lifelong memory, and surfaces proactive cards. Web, macOS and iOS.

    GitHub · TypeScript · 13 stars · 1 forks · +5 stars in 24 hours · Trending score 0.92

  10. 10
    PorunC/CodeWiki

    CodeWiki is a knowledge platform that analyzes repositories into AST graphs, builds GraphRAG indexes, and generates source-grounded developer wikis with FastAPI, React, and LiteLLM.

    GitHub · Python · 161 stars · 15 forks · +2 stars in 24 hours · Trending score 0.91

  11. 11
    ybak/ai-tutorial

    中文 AI 应用实战教程(含英文版):AgentScope Java、MCP、RAGFlow、FastGPT、Langfuse、LiteLLM、CopilotKit,本机实测,在线阅读与源码同仓。Hands-on Chinese AI tutorials (English edition available) covering AgentScope Java, MCP, RAGFlow, FastGPT, Langfuse, LiteLLM, and CopilotKit.

    GitHub · JavaScript · 26 stars · 2 forks · +1 stars in 24 hours · Trending score 0.83

  12. 12
    dreadnode/rigging

    Lightweight LLM Interaction Framework

    GitHub · Python · 426 stars · 39 forks · +1 stars in 24 hours · Trending score 0.74

  13. 13
    askalf/dario

    One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies.

    GitHub · JavaScript · 592 stars · 78 forks · +1 stars in 24 hours · Trending score 0.73

  14. 14
    cuihuan/awesome-ai-gateway

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    GitHub · HTML · 158 stars · 152 forks · 0 stars in 24 hours · Trending score 0.69

  15. 15
    ARMANDSnow/make-ur-Agent-writer

    Multi-agent LLM pipeline for long-form novel continuation · 多 Agent 长篇小说续写流水线,19 轮迭代 + 全程 mock-first

    GitHub · Python · 21 stars · 4 forks · 0 stars in 24 hours · Trending score 0.59

  16. 16
    siamcafe/bomllm

    Self-hosted Thai AI infrastructure — Mac Mini M4 Pro running TURBO-Fable 27B at 18.5 tok/s for $0.54/day. Fleet of 9 machines, GOD CONFIG v7.0, 40 IRON safety rules. Production-grade Open WebUI + LiteLLM + Ollama MLX stack.

    GitHub · Python · 48 stars · 9 forks · 0 stars in 24 hours · Trending score 0.52

  17. 17
    balcsida/pi-provider-litellm

    LiteLLM proxy provider extension for Pi

    GitHub · TypeScript · 62 stars · 41 forks · 0 stars in 24 hours · Trending score 0.50

  18. 18
    DataFog/datafog-python

    Offline PII firewall for AI agents and LLM apps: fast local detection and redaction, Claude Code hook, LiteLLM guardrail. Zero network calls, one dependency.

    GitHub · Python · 80 stars · 15 forks · 0 stars in 24 hours · Trending score 0.49

  19. 19
    ypollak2/llm-router

    Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain cuts costs 35-80%.

    GitHub · Python · 130 stars · 17 forks · 0 stars in 24 hours · Trending score 0.40

  20. 20
    antiv/mate

    Production-ready multi-agent orchestration engine built on Google ADK. Database-driven agent config, 50+ LLM providers, MCP protocol, persistent memory, web dashboard, RBAC.

    GitHub · Python · 112 stars · 23 forks · 0 stars in 24 hours · Trending score 0.39

  21. 21
    MiXaiLL76/auto_ai_router

    High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection

    GitHub · Go · 58 stars · 17 forks · 0 stars in 24 hours · Trending score 0.33

  22. 22
    Kame696/kame-api-rotation-for-agent-zero

    🐢⚡ The best free API key rotation + automatic model fallback for Agent Zero. Many keys and models as one pool: every 429 / RESOURCE_EXHAUSTED read, each key rested exactly as long as needed, a late reply raced by your next model. Gemini, OpenAI, OpenRouter, any provider.

    GitHub · Python · 24 stars · 3 forks · 0 stars in 24 hours · Trending score 0.33

  23. 23
    fegone/claude-code-delegate-local

    MCP server that delegates Claude Code subagents to local models (LiteLLM/llama.cpp/Ollama), DeepSeek, AWS Bedrock, or any OpenAI/Anthropic-compatible backend — without losing the Claude Code orchestrator session.

    GitHub · Python · 19 stars · 2 forks · 0 stars in 24 hours · Trending score 0.32

  24. 24
    hwdsl2/self-hosted-ai-stack

    Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

    GitHub · Shell · 180 stars · 35 forks · 0 stars in 24 hours · Trending score 0.31