load-balancing repositories

Trending repositories tagged load-balancing, ranked by trending score. Updated daily.

  1. 1
    maximhq/bifrost

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

    GitHub · Go · 9,800 stars · 1,628 forks · +73 stars in 24 hours · Trending score 3.67

  2. 2
    net-merge/net-merge

    Use all your internet connections at once on Windows, macOS, Linux and Android: per-connection load balancing over Wi-Fi, Ethernet, mobile data and phone tethers

    GitHub · Go · 3,445 stars · 197 forks · +70 stars in 24 hours · Trending score 3.57

  3. 3
    PegaProx/project-pegaprox

    The ultimate datacenter management solution for Proxmox VE and XCP-NG. Unified multi-cluster control, intelligent load balancing, and seamless cross-cluster VM migrations — all in one beautiful interface.

    GitHub · Python · 1,731 stars · 131 forks · 0 stars in 24 hours · Trending score 1.13

  4. 4
    kekawia/net-switch

    Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.

    GitHub · Go · 102 stars · 5 forks · +1 stars in 24 hours · Trending score 0.72

  5. 5
    adminsyspro/proxcenter-ui

    ProxCenter is an alternative to VMware vCenter for Proxmox environments. It provides a modern, intuitive web interface to manage multiple Proxmox VE clusters and Proxmox Backup Server instances from a single pane of glass.

    GitHub · TypeScript · 1,779 stars · 120 forks · 0 stars in 24 hours · Trending score 0.67

  6. 6
    net-merge/android

    net-merge for Android: use Wi-Fi and mobile data at the same time. No root, no account, no server.

    GitHub · Go · 24 stars · 3 forks · 0 stars in 24 hours · Trending score 0.63

  7. 7
    autcir/openvidia

    Multi-key proxy for NVIDIA NIM with a native desktop dashboard — auto-rotation, cooldown, RPM limiting, Claude Code + Codex CLI + opencode support. Free-tier keys pooled behind one endpoint.

    GitHub · Python · 9 stars · 1 forks · 0 stars in 24 hours · Trending score 0.38

  8. 8
    Kame696/kame-api-rotation-for-agent-zero

    🐢⚡ The best free API key rotation + automatic model fallback for Agent Zero. Many keys and models as one pool: every 429 / RESOURCE_EXHAUSTED read, each key rested exactly as long as needed, a late reply raced by your next model. Gemini, OpenAI, OpenRouter, any provider.

    GitHub · Python · 24 stars · 3 forks · 0 stars in 24 hours · Trending score 0.33

  9. 9
    HariSekhon/Diagrams-as-Code

    Cloud & DevOps Architecture Diagrams-as-Code in Python, D2 and MermaidJS languages

    GitHub · D2 · 284 stars · 56 forks · 0 stars in 24 hours · Trending score 0.31

  10. 10
    shuishuipingan/workbuddy-qoder-trae-hub

    WorkBuddy x Qoder x Trae 三引擎融合网关:一个 Python 进程跑三家引擎、一个端口(8817)对外、一把合并 Key 按模型/区域自动选路并在 401/429/502/503/504 时跨引擎故障转移;兼容 OpenAI Chat/Responses 与 Anthropic Messages(SSE 流式),合并 Key 支持模型/引擎作用域;内置 React 面板:账号池(签到/积分/出口)、模型清单、数据指标(区间/KPI/热力图/缓存命中)、请求流水、网关 Key、福利中心、设置与一键更新;MIT 开源,支持 Docker/ghcr。

    GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.24

  11. 11
    Lincoln-cn/JAiRouter

    Self-hosted LLM gateway for Java and Spring Boot teams: one OpenAI-compatible endpoint in front of Ollama, vLLM, GPUStack and cloud models, with RBAC, rate limiting, circuit breaking, audit and a visual console.

    GitHub · Java · 27 stars · 11 forks · 0 stars in 24 hours · Trending score 0.24

  12. 12
    majiayu000/litellm-rs

    Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.

    GitHub · Rust · 124 stars · 18 forks · 0 stars in 24 hours · Trending score 0.23

  13. 13
    azrtydxb/Fastllm-proxy

    The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.

    GitHub · Rust · 109 stars · 93 forks · 0 stars in 24 hours · Trending score 0.17

  14. 14
    cloudsimplus/cloudsimplus

    State-of-the-art Framework 🏗 for Cloud Computing ⛅️ Simulation: a modern, full-featured, easier-to-use, highly extensible 🧩, faster 🚀 and more accurate ☕️ Java 25+ tool for cloud computing research 🎓 Examples: https://github.com/cloudsimplus/cloudsimplus-examples

    GitHub · Java · 493 stars · 214 forks · −1 stars in 24 hours · Trending score 0.16

  15. 15
    jaxernst/lasso-rpc

    Fault-tolerant Ethereum JSON-RPC proxy with intelligent, low-latency, and deeply configurable routing. Lasso gives you fine grained control to make your blockchain apps faster, cheaper, and more reliable

    GitHub · Elixir · 36 stars · 5 forks · 0 stars in 24 hours · Trending score 0.10

  16. 16
    modcluster/mod_cluster

    mod_cluster is an intelligent native Apache httpd-based and pure-Java Undertow-based load-balancer

    GitHub · Java · 105 stars · 80 forks · 0 stars in 24 hours · Trending score 0.08

  17. 17
    himanshu231204/system-design-fundamentals

    Learn system design by breaking a real service. 16 runnable, dependency-free concept demos + one RAG API evolved through 6 stages — statelessness, caching, queues, backpressure, replicas, load balancing, observability. Every number measured, not asserted.

    GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  18. 18
    quinoacomputing/quinoa

    Adaptive computational fluid dynamics

    GitHub · C++ · 115 stars · 25 forks · 0 stars in 24 hours · Trending score 0.04

  19. 19
    intelligentwolf/WolfScale

    Free tools for building robust, clustered server infrastructure — WolfStack, WolfScale, WolfDisk, WolfNet

    GitHub · Rust · 304 stars · 27 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    junkurihara/rust-rpxy

    A simple and ultrafast http reverse proxy serving multiple domain names and terminating TLS for http/1.1, 2 and 3, written in Rust

    GitHub · Rust · 786 stars · 68 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    MaskingTechnology/jitar

    Distributed runtime for JavaScript and TypeScript

    GitHub · TypeScript · 167 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    openziti/llm-gateway

    Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

    GitHub · Go · 100 stars · 11 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    k8snetworkplumbingwg/bond-cni

    Bond-cni is for fail-over and high availability of networking in cloudnative orchestration

    GitHub · Go · 77 stars · 32 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    yolorouter/yolorouter

    A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

    GitHub · Go · 207 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00