ai-infrastructure repositories

Trending repositories tagged ai-infrastructure, ranked by trending score. Updated daily.

  1. 1
    bojieli/ai-infra-book

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    GitHub · Python · 8,162 stars · 667 forks · +93 stars in 24 hours · Trending score 3.93

  2. 2
    HarnessRouter/harnessrouter

    HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an open standard. Your keys, your infrastructure.

    GitHub · Python · 4,387 stars · 491 forks · +13 stars in 24 hours · Trending score 2.47

  3. 3
    omnara-ai/omnara

    The open-source managed agent platform. A self-hostable alternative to Claude Managed Agents and OpenAI's Agents API.

    GitHub · Go · 3,427 stars · 271 forks · +12 stars in 24 hours · Trending score 2.24

  4. 4
    pgrundev/pgboxdb

    PGBoxDB — Lightweight Postgres for AI agents. Written in Rust. Thousands of isolated databases in one runtime 🐘

    GitHub · Rust · 729 stars · 37 forks · +6 stars in 24 hours · Trending score 1.55

  5. 5
    semantica-agi/semantica

    Graph-Native Semantic Layer for Trustworthy Enterprise AI

    GitHub · Python · 14,639 stars · 1,737 forks · 0 stars in 24 hours · Trending score 1.55

  6. 6
    mindspore-ai/hyper-parallel

    A SuperPod-Affinity Training Acceleration Framework.

    GitHub · Python · 216 stars · 117 forks · +1 stars in 24 hours · Trending score 1.46

  7. 7
    iflytek/skillhub

    Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.

    GitHub · Java · 5,430 stars · 820 forks · +3 stars in 24 hours · Trending score 1.45

  8. 8
    NVIDIA/nsight-perf-sdk-for-ai

    Always-on, low-overhead GPU and CUDA performance tracing SDK for AI workloads. C++ client APIs, CLI tools, open data model, Perfetto export.

    GitHub · CMake · 116 stars · 9 forks · +2 stars in 24 hours · Trending score 1.40

  9. 9
    SinapsisHub/sinapsis-hub

    A single contract for the AI ecosystem

    GitHub · Python · 54 stars · 14 forks · +12 stars in 24 hours · Trending score 1.27

  10. 10
    tianyilt/qzcli_tool

    启智平台任务管理 CLI:资源查询、任务提交、日志查看和 MCP/agent workflow

    GitHub · Python · 152 stars · 28 forks · +5 stars in 24 hours · Trending score 1.26

  11. 11
    caura-ai/caura

    Caura (formerly MemClaw) — governed shared memory for AI agent fleets. Multi-agent, multi-tenant, MCP-native. Trust tiers, keystone policies, audit trails, knowledge graph, self-improving retrieval. Apache 2.0.

    GitHub · Python · 567 stars · 110 forks · +3 stars in 24 hours · Trending score 1.23

  12. 12
    design-gurus/grokking-system-design

    The free, open companion to the original Grokking the System Design Interview course by DesignGurus.io.

    GitHub · 401 stars · 100 forks · 0 stars in 24 hours · Trending score 1.14

  13. 13
    ForceInjection/forceinjection.github.io

    Github pages for Force Injection

    GitHub · HTML · 104 stars · 22 forks · +2 stars in 24 hours · Trending score 1.14

  14. 14
    NVIDIA/ccluster

    CCluster is an efficiency-focused, Kubernetes-native platform for managing the end-to-end AI lifecycle across distributed, multi-cloud GPU infrastructure

    GitHub · Go · 12 stars · 9 forks · +1 stars in 24 hours · Trending score 1.12

  15. 15
    turingmotors/slurmkube

    Slurm on Kubernetes, enabling workloads from both Slurm and Kubernetes with Kueue-based scheduling.

    GitHub · Go · 11 stars · 0 forks · +6 stars in 24 hours · Trending score 0.92

  16. 16
    Claws-ZH/awesome-ai-api

    Curated list of 200+ AI API providers with daily ranking, OpenAI-compatible API checks, and live /v1/models probing for Claude, DeepSeek, Gemini, and more.

    GitHub · Python · 92 stars · 54 forks · +1 stars in 24 hours · Trending score 0.91

  17. 17
    jigjoy-ai/mozaik-network

    The communication network for AI agents.

    GitHub · TypeScript · 198 stars · 18 forks · 0 stars in 24 hours · Trending score 0.89

  18. 18
    honestDS/MonoLight

    MonoLight is a General Autonomous Agent runtime with IM interaction as its primary interaction modality, focusing on safe execution and human-machine collaboration.

    GitHub · Python · 24 stars · 1 forks · +2 stars in 24 hours · Trending score 0.88

  19. 19
    reshaprio/reshapr

    The open source runtime that turns your APIs AI-Native, without rebuilding them

    GitHub · Java · 180 stars · 40 forks · +1 stars in 24 hours · Trending score 0.80

  20. 20
    hanzoai/cli

    The Hanzo CLI — an AI coding agent and every product of the Hanzo cloud, in one Rust binary. curl -fsSL https://hanzo.sh | sh

    GitHub · Rust · 22 stars · 18 forks · +1 stars in 24 hours · Trending score 0.69

  21. 21
    cuihuan/awesome-ai-gateway

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    GitHub · HTML · 158 stars · 152 forks · 0 stars in 24 hours · Trending score 0.69

  22. 22
    systempromptio/systemprompt-core

    AI governance infrastructure for agentic systems. Rust library behind systemprompt.io — MCP, A2A, OAuth2, audit trails, compile-time extensions. Evaluate with systemprompt-template.

    GitHub · Rust · 10 stars · 2 forks · +1 stars in 24 hours · Trending score 0.56

  23. 23
    skyliulu/LLM-Infra-Explorer

    Interactive visualization and exploration of large language model (LLM) systems, infrastructure, and inference workflows

    GitHub · JavaScript · 12 stars · 1 forks · 0 stars in 24 hours · Trending score 0.48

  24. 24
    inkbox-ai/inkbox

    SDK, skills, and examples for Inkbox: give AI agents a persistent identity with email, phone number, and internet address

    GitHub · TypeScript · 106 stars · 28 forks · 0 stars in 24 hours · Trending score 0.47