ai-infrastructure repositories
Trending repositories tagged ai-infrastructure, ranked by trending score. Updated daily.
-
1
bojieli/ai-infra-book
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
GitHub · Python · 8,162 stars · 667 forks · +93 stars in 24 hours · Trending score 3.93
-
2
HarnessRouter/harnessrouter
HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an open standard. Your keys, your infrastructure.
GitHub · Python · 4,387 stars · 491 forks · +13 stars in 24 hours · Trending score 2.47
-
3
omnara-ai/omnara
The open-source managed agent platform. A self-hostable alternative to Claude Managed Agents and OpenAI's Agents API.
GitHub · Go · 3,427 stars · 271 forks · +12 stars in 24 hours · Trending score 2.24
-
4
pgrundev/pgboxdb
PGBoxDB — Lightweight Postgres for AI agents. Written in Rust. Thousands of isolated databases in one runtime 🐘
GitHub · Rust · 729 stars · 37 forks · +6 stars in 24 hours · Trending score 1.55
-
5
semantica-agi/semantica
Graph-Native Semantic Layer for Trustworthy Enterprise AI
GitHub · Python · 14,639 stars · 1,737 forks · 0 stars in 24 hours · Trending score 1.55
-
6
mindspore-ai/hyper-parallel
A SuperPod-Affinity Training Acceleration Framework.
GitHub · Python · 216 stars · 117 forks · +1 stars in 24 hours · Trending score 1.46
-
7
iflytek/skillhub
Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.
GitHub · Java · 5,430 stars · 820 forks · +3 stars in 24 hours · Trending score 1.45
-
8
NVIDIA/nsight-perf-sdk-for-ai
Always-on, low-overhead GPU and CUDA performance tracing SDK for AI workloads. C++ client APIs, CLI tools, open data model, Perfetto export.
GitHub · CMake · 116 stars · 9 forks · +2 stars in 24 hours · Trending score 1.40
-
9
SinapsisHub/sinapsis-hub
A single contract for the AI ecosystem
GitHub · Python · 54 stars · 14 forks · +12 stars in 24 hours · Trending score 1.27
-
10
tianyilt/qzcli_tool
启智平台任务管理 CLI:资源查询、任务提交、日志查看和 MCP/agent workflow
GitHub · Python · 152 stars · 28 forks · +5 stars in 24 hours · Trending score 1.26
-
11
caura-ai/caura
Caura (formerly MemClaw) — governed shared memory for AI agent fleets. Multi-agent, multi-tenant, MCP-native. Trust tiers, keystone policies, audit trails, knowledge graph, self-improving retrieval. Apache 2.0.
GitHub · Python · 567 stars · 110 forks · +3 stars in 24 hours · Trending score 1.23
-
12
design-gurus/grokking-system-design
The free, open companion to the original Grokking the System Design Interview course by DesignGurus.io.
GitHub · 401 stars · 100 forks · 0 stars in 24 hours · Trending score 1.14
-
13
ForceInjection/forceinjection.github.io
Github pages for Force Injection
GitHub · HTML · 104 stars · 22 forks · +2 stars in 24 hours · Trending score 1.14
-
14
NVIDIA/ccluster
CCluster is an efficiency-focused, Kubernetes-native platform for managing the end-to-end AI lifecycle across distributed, multi-cloud GPU infrastructure
GitHub · Go · 12 stars · 9 forks · +1 stars in 24 hours · Trending score 1.12
-
15
turingmotors/slurmkube
Slurm on Kubernetes, enabling workloads from both Slurm and Kubernetes with Kueue-based scheduling.
GitHub · Go · 11 stars · 0 forks · +6 stars in 24 hours · Trending score 0.92
-
16
Claws-ZH/awesome-ai-api
Curated list of 200+ AI API providers with daily ranking, OpenAI-compatible API checks, and live /v1/models probing for Claude, DeepSeek, Gemini, and more.
GitHub · Python · 92 stars · 54 forks · +1 stars in 24 hours · Trending score 0.91
-
17
jigjoy-ai/mozaik-network
The communication network for AI agents.
GitHub · TypeScript · 198 stars · 18 forks · 0 stars in 24 hours · Trending score 0.89
-
18
honestDS/MonoLight
MonoLight is a General Autonomous Agent runtime with IM interaction as its primary interaction modality, focusing on safe execution and human-machine collaboration.
GitHub · Python · 24 stars · 1 forks · +2 stars in 24 hours · Trending score 0.88
-
19
reshaprio/reshapr
The open source runtime that turns your APIs AI-Native, without rebuilding them
GitHub · Java · 180 stars · 40 forks · +1 stars in 24 hours · Trending score 0.80
-
20
hanzoai/cli
The Hanzo CLI — an AI coding agent and every product of the Hanzo cloud, in one Rust binary. curl -fsSL https://hanzo.sh | sh
GitHub · Rust · 22 stars · 18 forks · +1 stars in 24 hours · Trending score 0.69
-
21
cuihuan/awesome-ai-gateway
⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.
GitHub · HTML · 158 stars · 152 forks · 0 stars in 24 hours · Trending score 0.69
-
22
systempromptio/systemprompt-core
AI governance infrastructure for agentic systems. Rust library behind systemprompt.io — MCP, A2A, OAuth2, audit trails, compile-time extensions. Evaluate with systemprompt-template.
GitHub · Rust · 10 stars · 2 forks · +1 stars in 24 hours · Trending score 0.56
-
23
skyliulu/LLM-Infra-Explorer
Interactive visualization and exploration of large language model (LLM) systems, infrastructure, and inference workflows
GitHub · JavaScript · 12 stars · 1 forks · 0 stars in 24 hours · Trending score 0.48
-
24
inkbox-ai/inkbox
SDK, skills, and examples for Inkbox: give AI agents a persistent identity with email, phone number, and internet address
GitHub · TypeScript · 106 stars · 28 forks · 0 stars in 24 hours · Trending score 0.47