llm-ops repositories

Trending repositories tagged llm-ops, ranked by trending score. Updated daily.

  1. 1
    bentoml/OpenLLM

    Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

    GitHub · Python · 12,610 stars · 853 forks · +49 stars in 24 hours · Trending score 2.61

  2. 2
    ultracontext/ultracontext

    Open Source Context infrastructure for AI agents. Auto-capture and share your agents' context everywhere.

    GitHub · JavaScript · 443 stars · 40 forks · +21 stars in 24 hours · Trending score 2.24

  3. 3
    Kong/kong

    🦍 The API and AI Gateway

    GitHub · Lua · 44,404 stars · 5,248 forks · +6 stars in 24 hours · Trending score 1.89

  4. 4
    langwatch/langwatch

    Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.

    GitHub · TypeScript · 5,051 stars · 432 forks · +6 stars in 24 hours · Trending score 1.80

  5. 5
    TykTechnologies/tyk

    Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

    GitHub · Go · 10,899 stars · 1,172 forks · +3 stars in 24 hours · Trending score 1.42

  6. 6
    ai-sdlc-framework/ai-sdlc

    Declarative governance framework for AI-augmented software development lifecycles

    GitHub · TypeScript · 451 stars · 81 forks · +3 stars in 24 hours · Trending score 1.34

  7. 7
    Chleba/ollamaMQ

    High-performance LLM backends proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.

    GitHub · Rust · 132 stars · 16 forks · +2 stars in 24 hours · Trending score 0.72

  8. 8
    bytebeast/check-endpoint

    Live per-phase HTTP timing probe: DNS, TCP, TLS, TTFB, body transfer, and streaming chunk timing (ITL), streamed as each phase completes.

    GitHub · Python · 9 stars · 3 forks · +1 stars in 24 hours · Trending score 0.54

  9. 9
    iflytek/astron-agent

    Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

    GitHub · Java · 8,923 stars · 913 forks · −17 stars in 24 hours · Trending score 0.53

  10. 10
    ucsandman/claude-harness

    The Claude Code harness I run every day, published under this name since day one and now the same repository as ucsandman/Agnostic-AI: guard hooks, rules, context modules, Mods, subagents, workflows, tools and jobs, ported to 20 clients. Zero-dependency Node.

    GitHub · JavaScript · 32 stars · 2 forks · +1 stars in 24 hours · Trending score 0.46

  11. 11
    sherifican/Agent-FleetOps

    Operational tooling & discipline for multi-agent AI engineering fleets — mutation-proven guards, a Textual terminal monitor, generalized skills, and specs. Every check ships with proof it can fail.

    GitHub · Python · 35 stars · 0 forks · +1 stars in 24 hours · Trending score 0.45

  12. 12
    EmbeddedLLM/JamAIBase

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

    GitHub · Python · 1,104 stars · 48 forks · 0 stars in 24 hours · Trending score 0.29

  13. 13
    TaimoorKhan10/replayd

    Turn failed AI agent runs into replayable regression tests. Catch regressions before you ship.

    GitHub · Python · 19 stars · 2 forks · 0 stars in 24 hours · Trending score 0.28

  14. 14
    Jwuthri/Tracely-ai

    Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

    GitHub · Python · 1,299 stars · 131 forks · 0 stars in 24 hours · Trending score 0.07

  15. 15
    VibOpsai/vibops-mcp

    117 MCP tools for GPU infrastructure + Agent FinOps — deploy LLMs, manage VMs (Proxmox/XO/vSphere), track cost per agent, enforce budgets and model policies. Works with Claude, Cursor, n8n, LangChain

    GitHub · Python · 20 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  16. 16
    monaccode/astromesh

    Multi-model AI agent runtime. Define agents in YAML, route each role to a model, orchestrate with 7 patterns (ReAct, Plan & Execute, Fan-Out, Pipeline, Supervisor, Swarm, Glyph), and deploy as a REST/WebSocket API with RAG, memory, MCP tools, guardrails and OpenTelemetry observability.

    GitHub · Python · 39 stars · 9 forks · 0 stars in 24 hours · Trending score 0.04

  17. 17
    AcruxCore/AcruxCore

    Open-source LLMOps platform with prompt management, an OpenAI-compatible AI gateway, OpenTelemetry tracing, a versioned tool catalog, and LLM evaluation. Use hosted or self-host with TypeScript and Python SDKs.

    GitHub · TypeScript · 14 stars · 1 forks · 0 stars in 24 hours · Trending score 0.04

  18. 18
    hermes-labs-ai/lintlang

    Static analysis for AI agent configs, tool descriptions, and system prompts — catches vague tool descriptions, missing stop conditions, and schema gaps before they reach runtime. Zero-LLM, deterministic checks, built for CI.

    GitHub · Python · 147 stars · 13 forks · 0 stars in 24 hours · Trending score 0.01

  19. 19
    Emmimal/control-layer

    A production-grade control layer that sits between your application logic and any LLM — input validation, schema enforcement, circuit breaking, targeted retry, and audit logging in one composable pipeline.

    GitHub · Python · 62 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    ray-aqno/Toto-Wolff

    Persistent AI governance for Claude Code — three-tier council deliberation, P10 pre-execution plans, and deterministic confidence scoring grounded in your own past decisions.

    GitHub · TypeScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00