llm-routing repositories

Trending repositories tagged llm-routing, ranked by trending score. Updated daily.

  1. 1
    mozilla-ai/otari

    Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

    GitHub · Python · 955 stars · 139 forks · +8 stars in 24 hours · Trending score 2.10

  2. 2
    pvjbuilds/delegate-router

    Claude Code and Codex CLI skill: an LLM router that delegates bulk, already-decided coding tasks to another model you already pay for (GPT via Codex, Gemini via agy, a Claude Opus subagent), on another subscription first. Benchmark-checked routes, cost per task measured on a bench, cross-model review. The host verifies every diff.

    GitHub · Python · 43 stars · 9 forks · +10 stars in 24 hours · Trending score 1.78

  3. 3
    lawrence3699/jev-style

    JevStyle: local decision models for AI agents. Classify, route and score with a probability per option. systemone-compatible local server, MCP tools, Claude Code guard. Open weights, Apache-2.0.

    GitHub · Python · 138 stars · 4 forks · +1 stars in 24 hours · Trending score 1.47

  4. 4
    Akramovic1/jev-pilot

    Let Jev steer Claude Code: the right reasoning effort, subagent model and skill for every prompt. A Claude Code plugin powered by TypeSafe's Jev (OpenRouter / TypeSafe).

    GitHub · TypeScript · 13 stars · 2 forks · +5 stars in 24 hours · Trending score 1.20

  5. 5
    0xNyk/council-of-high-intelligence

    Structured multi-perspective deliberation for hard decisions. Run full councils, focused triads, or duo debates across Claude Code, Codex, Gemini CLI, and OpenCode.

    GitHub · Shell · 4,853 stars · 457 forks · 0 stars in 24 hours · Trending score 0.87

  6. 6
    OpenBMB/EC2-Bench

    EC2-Bench (EC²-Bench): benchmark for edge-cloud collaboration in long-horizon LLM agents — task performance, resource usage & privacy exposure. arXiv 2610.17816

    GitHub · Python · 24 stars · 0 forks · +2 stars in 24 hours · Trending score 0.81

  7. 7
    CommonstackAI/TwinRouterBench

    Per-step LLM routing benchmark with 970 static labels, live SWE-bench evaluation, an open data pipeline, and a public leaderboard.

    GitHub · Python · 35 stars · 4 forks · 0 stars in 24 hours · Trending score 0.73

  8. 8
    manomilano/orca-compass

    Smart AI worker routing for Orca. Match agents, models, and reasoning effort to task complexity while optimizing usage across your existing subscriptions.

    GitHub · TypeScript · 7 stars · 1 forks · +2 stars in 24 hours · Trending score 0.60

  9. 9
    ankitvirdi4/awesome-llm-cost

    Tools, libraries, papers, and patterns for reducing the cost of running large language models in production.

    GitHub · 14 stars · 15 forks · 0 stars in 24 hours · Trending score 0.46

  10. 10
    RouteWorks/RouterArena

    RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

    GitHub · Python · 158 stars · 70 forks · 0 stars in 24 hours · Trending score 0.37

  11. 11
    deltawi/deltallm

    Self-hosted LLM gateway with SSO, audit logs, client access controls, routing, and usage tracking. OpenAI-compatible and MIT licensed.

    GitHub · Python · 21 stars · 5 forks · 0 stars in 24 hours · Trending score 0.32

  12. 12
    NeuralTrust/TrustGate

    Open-source AI gateway for LLM and agent traffic — multi-provider routing, guardrails, semantic caching and MCP support. Written in Go.

    GitHub · Go · 17 stars · 8 forks · 0 stars in 24 hours · Trending score 0.28

  13. 13
    sauravsingla/agentweave

    Pre-inference tool and agent routing for MCP, A2A and tool-rich LLM systems. Reduce candidate tools before model inference with policy-aware routing and recovery.

    GitHub · Python · 42 stars · 36 forks · 0 stars in 24 hours · Trending score 0.28

  14. 14
    dominicrico/jev-router

    Claude Code plugin: automatic Claude model routing. Picks Haiku, Sonnet or Opus and the reasoning effort per prompt, step and subagent; effort cap, prompt-cache guard, status band, benchmarks.

    GitHub · TypeScript · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.22

  15. 15
    Ninthless/StackFerry

    Desktop provider manager and local failover router for Codex, Claude Code, and Grok.

    GitHub · TypeScript · 31 stars · 4 forks · 0 stars in 24 hours · Trending score 0.18

  16. 16
    emirhuseynrmx/calybris-core

    Deterministic proof-carrying decision core with replay verification, WAL, and fixed-point budget proofs

    GitHub · Rust · 14 stars · 0 forks · 0 stars in 24 hours · Trending score 0.15

  17. 17
    surlymochan/swrm

    Distributed heterogeneous agent task dispatcher — claim under lease, return with evidence. Quota-aware routing across Claude, Codex, OpenCode Go and DeepSeek, in isolated git worktrees with hard budgets.

    GitHub · Python · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.10

  18. 18
    tiagovilasboas/downshift-ai

    Reduce token usage, optimize LLM costs, and route AI coding agents intelligently across Claude Code, Codex, Cursor, and other harnesses.

    GitHub · Go · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.10

  19. 19
    ABCastor/crossfeed-orchestrator

    Route AI coding work across the AI subscriptions you already pay for, with a local console and quota-aware switches.

    GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  20. 20
    soulsteads/soulsteads-model-router

    Blazing fast, capacity-aware routing for local AI. One OpenAI-compatible endpoint for your inference servers. Built in Rust. No BS.

    GitHub · Rust · 5 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09

  21. 21
    Burakkylmz/llm-routing-evaluation-platform

    Open-source LLM routing evaluation platform benchmarking cost, latency, quality, and safety across routing strategies, with a focus on Turkish banking.

    GitHub · Python · 12 stars · 3 forks · 0 stars in 24 hours · Trending score 0.04

  22. 22
    angel291592/Intent-Router

    Intent compiler for AI agents — converges vague requests into typed IntentSpec contracts (probe, ask, or halt before routing), the input layer for routers and typed-decision models like Jev & Laya

    GitHub · Python · 94 stars · 18 forks · 0 stars in 24 hours · Trending score 0.02

  23. 23
    tiagovilasboas/downshift

    Reduce token usage and LLM API cost in AI coding agents: compact verbose command output, right-size subagent models, flag wasted prompt cache. Deterministic, fail-open hooks for Claude Code, Cursor, Codex and OpenCode. No LLM in the loop.

    GitHub · Go · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    junchenzhi/Awesome-LLM-Ensemble

    A curated list of Awesome-LLM-Ensemble papers for the survey "Harnessing Multiple Large Language Models: A Survey on LLM Ensemble"

    GitHub · HTML · 256 stars · 21 forks · 0 stars in 24 hours · Trending score 0.00