triton-inference-server repositories

Trending repositories tagged triton-inference-server, ranked by trending score. Updated daily.

  1. 1
    NVIDIA/GenerativeAIExamples

    Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

    GitHub · Jupyter Notebook · 4,235 stars · 1,104 forks · +32 stars in 24 hours · Trending score 2.37

  2. 2
    itsmekhoathekid/RecSys-MLops

    Highly Scalable RecSys ML & Data system

    GitHub · Python · 137 stars · 29 forks · +9 stars in 24 hours · Trending score 1.66

  3. 3
    ai-lab-tech/triton-control

    Web UI for NVIDIA Triton Inference Server on Kubernetes

    GitHub · Python · 10 stars · 7 forks · 0 stars in 24 hours · Trending score 0.10

  4. 4
    triton-inference-server/onnxruntime_backend

    The Triton backend for the ONNX Runtime.

    GitHub · C++ · 188 stars · 89 forks · 0 stars in 24 hours · Trending score 0.08

  5. 5
    clearml/clearml-serving

    ClearML - Model-Serving Orchestration and Repository Solution

    GitHub · Python · 170 stars · 54 forks · 0 stars in 24 hours · Trending score 0.08

  6. 6
    Raytorin/triton-openai-gateway

    OpenAI-compatible gateway for NVIDIA Triton and vLLM with tools, multimodal inputs, embeddings, reranking, and observability.

    GitHub · Python · 10 stars · 2 forks · 0 stars in 24 hours · Trending score 0.07

  7. 7
    NVIDIA/DeepStream

    NVIDIA DeepStream Monorepo: DeepStream SDK and reference apps for building GPU‑accelerated, real-time video and multi‑sensor analytics pipelines with GStreamer, TensorRT, and vision AI models across edge, on‑prem, and cloud deployments.

    GitHub · C++ · 321 stars · 77 forks · 0 stars in 24 hours · Trending score 0.04

  8. 8
    NVIDIA-ISAAC-ROS/isaac_ros_dnn_inference

    NVIDIA-accelerated DNN model inference ROS 2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU

    GitHub · C++ · 142 stars · 24 forks · 0 stars in 24 hours · Trending score 0.00