SageSched: Intelligent LLM Request Scheduler with Workload Prediction — QoS-aware dual-queue scheduling for black-box LLM APIs (OpenAI/Azure/Doubao/Gemini)
GitHub repository with 7 stars and 0 forks.
Language: Python
Topics: api-gateway, faiss, fastapi, gittins-index, llm, llm-inference, llm-proxy, load-balancer, openai, qos
Trending score 0.00, activity score 0.00, stars gained +0, forks gained +0.
2026-06-05: 7 stars and 0 forks.
OpenAI-compatible LLM gateway: routes to the cheapest model meeting latency/quality targets, with SSE streaming, semantic caching, per-key rate limiting, and cost tracking.
GitHub repository with 7 stars and 0 forks.
Trending score: 0.32; stars gained: +1; forks gained: +0.
Language: Python
Topics: api-gateway, fastapi, gemini, groq, llm, llmops
Self-hosted, OpenAI-compatible AI gateway for organizations — multi-provider (Azure/OpenAI/Anthropic/Gemini), revocable per-allocation credentials, usage & cost tracking, and an OpenAI Codex–ready /v1/responses endpoint.
GitHub repository with 14 stars and 0 forks.
Trending score: 0.07; stars gained: +0; forks gained: +0.
Language: Python
Topics: ai-gateway, anthropic, api-gateway, azure-openai, fastapi, gemini
A smart, dynamic risk-scoring security layer that lives inside your Python web apps (FastAPI, Flask, Django). It provides flexible protection and real-time visibility without the rigidness of traditional web filters.
GitHub repository with 27 stars and 54 forks.
Trending score: 0.05; stars gained: +0; forks gained: +0.
Language: Python
Topics: ai, api-gateway, api-rest, api-wrapper, devtools, django
Sub2API gateway subscription → Codex CLI / Codex App injector. macOS-native, zero-deps Python single-file. Supports codex2api.com and any self-hosted Sub2API instance.
GitHub repository with 13 stars and 4 forks.
Trending score: 0.04; stars gained: +0; forks gained: +0.
Language: Python
Topics: api-gateway, channel-switcher, cli, codex, codex-cli, codex2api
Local Responses API shim for Codex custom providers backed by DeepSeek/OpenAI Chat Completions
GitHub repository with 8 stars and 0 forks.
Trending score: 0.00; stars gained: +0; forks gained: +0.
Language: Python
Topics: chat-completions, codex, deepseek, responses-api, agentic-coding, ai-coding
SageSched: Intelligent LLM Request Scheduler with Workload Prediction — QoS-aware dual-queue scheduling for black-box LLM APIs (OpenAI/Azure/Doubao/Gemini)
GitHub repository with 7 stars and 0 forks.
Trending score: 0.00; stars gained: +0; forks gained: +0.
Language: Python
Topics: api-gateway, faiss, fastapi, gittins-index, llm, llm-inference
The agent that grows with you
GitHub repository with 181,906 stars and 31,213 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 13,768 stars and 870 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, compression, context-engineering, context-window
Academic Research Skills for Claude Code: research → write → review → revise → finalize
GitHub repository with 27,484 stars and 2,256 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
Learn it. Build it. Ship it for others.
GitHub repository with 28,622 stars and 4,680 forks.
Trending score: 5.32; stars gained: +1,261; forks gained: +238.
Language: Python
Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course
GitHub repository with 30,029 stars and 4,231 forks.
Trending score: 4.88; stars gained: +688; forks gained: +114.
Language: Python
An opinionated list of Python frameworks, libraries, tools, and resources
GitHub repository with 301,396 stars and 28,042 forks.
Trending score: 4.60; stars gained: +518; forks gained: +24.
Language: Python
Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools
Next Generation Agentic Proxy for AI Agents and MCP servers
GitHub repository with 3,058 stars and 511 forks.
Trending score: 2.92; stars gained: +56; forks gained: +9.
Language: Rust
Topics: agents, ai, mcp, rust, ai-gateway, gateway-api
Agent-native LLM router that optimizes your agent with every run. Zero harness changes — every model call reliable, traceable, secure, and cost-effective.
GitHub repository with 148 stars and 4 forks.
Trending score: 2.46; stars gained: +43; forks gained: +2.
Language: Rust
Topics: ai-agent, ai-agents, rust, agent-guardrails, agent-harness, agent-observability
The Cloud-Native API Gateway and AI Gateway
GitHub repository with 16,690 stars and 2,875 forks.
Trending score: 2.39; stars gained: +11; forks gained: +4.
Language: Lua
Topics: cloud-native, nginx, api-management, luajit, api-gateway, microservices
🚀 Serverless AI API Gateway / 无服务器 AI API 网关 · Multi-provider routing 多 Provider 路由 · Key rotation · Failover · Vercel 一键部署 · OpenAI compatible
GitHub repository with 96 stars and 38 forks.
Trending score: 1.90; stars gained: +10; forks gained: +7.
Language: TypeScript
Topics: ai, api-gateway, api-relay, edge-runtime, llm, llm-gateway
⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.
GitHub repository with 4,148 stars and 512 forks.
Trending score: 1.48; stars gained: +35; forks gained: +8.
Language: Go
Topics: ai, anthropic, openai, agent, agents, anthropic-api
Manages Envoy Proxy as a Standalone or Kubernetes-based Application Gateway
GitHub repository with 2,764 stars and 769 forks.
Trending score: 1.31; stars gained: +3; forks gained: +2.
Language: Go
Topics: api-gateway, cncf, envoy, gateway-api, go-control-plane, hacktoberfest