ai-infra repositories

Trending repositories tagged ai-infra, ranked by trending score. Updated daily.

  1. 1
    opensandbox-group/OpenSandbox

    Secure, Fast, and Extensible Sandbox runtime for AI agents.

    GitHub · Go · 17,731 stars · 1,709 forks · +192 stars in 24 hours · Trending score 4.29

  2. 2
    bojieli/ai-infra-book

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    GitHub · Python · 8,162 stars · 667 forks · +93 stars in 24 hours · Trending score 3.93

  3. 3
    Tencent/AI-Infra-Guard

    A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

    GitHub · Python · 7,598 stars · 781 forks · +45 stars in 24 hours · Trending score 3.20

  4. 4
    CurvineIO/curvine

    AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.

    GitHub · Rust · 1,090 stars · 155 forks · +7 stars in 24 hours · Trending score 2.03

  5. 5
    zed123214/kitagent

    KitAgent:面向算子开发与性能优化的 Coding Agent。以 LangGraph 状态机编排开发、验证与迭代,集成工具执行、人工审批、会话恢复、Skills / MCP 扩展与 Kubernetes 沙箱。

    GitHub · Python · 104 stars · 9 forks · +14 stars in 24 hours · Trending score 2.00

  6. 6
    SwanHubX/SwanLab

    ⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

    GitHub · Python · 4,401 stars · 239 forks · +4 stars in 24 hours · Trending score 1.67

  7. 7
    ForceInjection/AI-fundamentals

    AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识。

    GitHub · HTML · 3,440 stars · 525 forks · 0 stars in 24 hours · Trending score 1.41

  8. 8
    go-taas/go-taas

    Open-source Token as a Service (TaaS) platform on Kubernetes — deploy LLMs, price by model × GPU, and meter/bill usage via an OpenAI-compatible API.

    GitHub · Go · 104 stars · 2 forks · +1 stars in 24 hours · Trending score 0.55

  9. 9
    agent-sandbox/agent-sandbox

    Agent-Sandbox is an easy-to-use, enterprise-grade sandbox platform for AI Agents — letting them securely run untrusted LLM-generated code, Browser use, Computer use, and deploy websites, among other tasks.

    GitHub · Go · 232 stars · 19 forks · 0 stars in 24 hours · Trending score 0.41

  10. 10
    ARSI-LAB/ARSI

    Make everything RSI-able! A pluggable framework for recursive self-improvement of AI agents and infrastructure through configurable strategies and evaluation-driven optimization.

    GitHub · TypeScript · 33 stars · 10 forks · +1 stars in 24 hours · Trending score 0.41

  11. 11
    tensorlakeai/tensorlake

    Tensorlake is a serverless runtime for sandboxes and deploying background agentic applications

    GitHub · Rust · 1,044 stars · 150 forks · 0 stars in 24 hours · Trending score 0.38

  12. 12
    usemoss/moss

    The retrieval layer for production AI systems. Lightning-fast (<10ms) search without vector databases. Built for browser, edge, on-device, and cloud.

    GitHub · Python · 807 stars · 104 forks · 0 stars in 24 hours · Trending score 0.30

  13. 13
    shen-shanshan/vllm-dev-skills

    A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.

    GitHub · Python · 33 stars · 3 forks · 0 stars in 24 hours · Trending score 0.22

  14. 14
    NexusGPU/vgpu.rs

    vgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust

    GitHub · Rust · 42 stars · 13 forks · 0 stars in 24 hours · Trending score 0.14

  15. 15
    ChaoyiHuang/sandswap

    ultra efficient sandboxes for AI agents - compute-disk decoupled AI agent sandbox, 183x tinyVM reuse/sec, ~2.3 ms cold, ~0.96 ms warm. ~ 6ms agent tinyVM rotation ~6ms, cuts agent execution costs by 50x–100x..

    GitHub · Go · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09

  16. 16
    compute-factory/compute-factory.github.io

    算力工地 · 面向新手的中文 AI Infra 教学站

    GitHub · JavaScript · 9 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  17. 17
    sheawinkler/ContextLattice

    The local-first intelligence layer that gives AI agents durable continuity, explainable retrieval, portable context, and verified learning across harnesses.

    GitHub · Go · 155 stars · 16 forks · 0 stars in 24 hours · Trending score 0.07

  18. 18
    mayooot/gpu-docker-api

    Easier than K8s to lift and lower the gpu number of docker container and scale capacity size of volume.

    GitHub · Go · 82 stars · 15 forks · 0 stars in 24 hours · Trending score 0.06

  19. 19
    cl-vv-h/SGLang_Tutor

    Bilingual SGLang tutorials and source-code walkthroughs for LLM inference, AI infrastructure, scheduling, KV cache, attention, Ascend NPU, and kernel optimization. | SGLang 中英双语教程与源码解析

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.03

  20. 20
    rootsongjc/ai-native-landscape

    Explore the ecosystem of open source tools, agents, runtimes, platforms, and infrastructure for the AI Native era, curated by hand and evaluated across multiple dimensions.

    GitHub · Astro · 41 stars · 15 forks · 0 stars in 24 hours · Trending score 0.02

  21. 21
    bitloops/bitloops

    Give AI coding agents the context they need to ship production-quality software.

    GitHub · Rust · 243 stars · 19 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    Tele-AI/Fluxon

    An AI-native distributed data plane built in Rust that supports high performance RPC, KV Cache, Message Queue, and File & Object Acceleration

    GitHub · Rust · 126 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    feiguangba/minivllm

    图解 vLLM 推理引擎:100 课动手练习册 + ~500 行可运行的迷你推理引擎 | An illustrated, hands-on course on how vLLM works

    GitHub · Python · 30 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    b-ostrov/MelonDMA

    Experimental PCIDriverKit driver for Mellanox ConnectX RDMA cards on macOS — RoCEv2 clustering between Mac Studios, no kernel extension required.

    GitHub · C++ · 10 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00