openvinotoolkit/model_server

A scalable inference server for models optimized with OpenVINO™

GitHub repository with 889 stars and 254 forks.

Language: C++

Topics: openvino, inference, ai, edge, cloud, deep-learning, serving, dag, kubernetes, machine-learning

Open provider repository

Latest metric snapshot

2026-06-13: 889 stars and 254 forks.

Similar repositories

  1. 1. open-edge-platform/dlstreamer

    Deep Learning Streamer (DL Streamer) Pipeline Framework is an open-source streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines for the Cloud or at the Edge.

    GitHub repository with 612 stars and 195 forks.

    Trending score: 0.99; stars gained: +1; forks gained: +0.

    Language: C++

    Topics: gstreamer, gstreamer-plugins, inference, intel, openvino

  2. 2. openvinotoolkit/openvino_contrib

    Repository for OpenVINO's extra modules

    GitHub repository with 179 stars and 189 forks.

    Trending score: 0.23; stars gained: +0; forks gained: +0.

    Language: C++

    Topics: openvino, pytorch, arm, java, inference-engine, nvidia-gpu

Trending in C++

  1. 1. ggml-org/llama.cpp

    LLM inference in C/C++

    GitHub repository with 116,286 stars and 19,520 forks.

    Trending score: 4.37; stars gained: +305; forks gained: +80.

    Language: C++

    Topics: ggml

  2. 2. opencv/opencv

    Open Source Computer Vision Library

    GitHub repository with 88,997 stars and 56,644 forks.

    Trending score: 4.20; stars gained: +103; forks gained: +5.

    Language: C++

    Topics: opencv, c-plus-plus, computer-vision, deep-learning, image-processing

  3. 3. Fincept-Corporation/FinceptTerminal

    FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.

    GitHub repository with 26,503 stars and 3,704 forks.

    Trending score: 4.20; stars gained: +230; forks gained: +21.

    Language: C++

    Topics: ai-agents, algorithmic-trading, bloomberg-terminal, cpp, finance, financial-markets

  4. 4. LizardByte/Sunshine

    Self-hosted game stream host for Moonlight.

    GitHub repository with 38,163 stars and 1,993 forks.

    Trending score: 3.90; stars gained: +202; forks gained: +9.

    Language: C++

    Topics: game-streaming-server, game-stream, game-streaming, remote-desktop, moonlight, geforce-experience

  5. 5. 78/xiaozhi-esp32

    An MCP-based chatbot | 一个基于MCP的聊天机器人

    GitHub repository with 27,280 stars and 6,076 forks.

    Trending score: 3.80; stars gained: +192; forks gained: +55.

    Language: C++

    Topics: chatbot, esp32, mcp

  6. 6. auralius/noodle

    Noodle provides primitive modular functions for convolution layer, dense layer, pooling and activations. It allows streaming the intermediate activations, weights, and biases from/to SD/FFat/SD_MMC filesystems to overcome RAM limitations.

    GitHub repository with 169 stars and 7 forks.

    Trending score: 3.64; stars gained: +162; forks gained: +7.

    Language: C++

    Topics: arduino, cnn, embedded-ai, esp32, lenet

Trending topic: openvino

  1. 1. collabora/WhisperLive

    A nearly-live implementation of OpenAI's Whisper.

    GitHub repository with 4,080 stars and 555 forks.

    Trending score: 1.69; stars gained: +14; forks gained: +1.

    Language: Python

    Topics: dictation, obs, openai, text-to-speech, translation, voice-recognition

  2. 2. openvinotoolkit/openvino_notebooks

    📚 Jupyter notebook tutorials for OpenVINO™

    GitHub repository with 3,164 stars and 1,021 forks.

    Trending score: 1.47; stars gained: +5; forks gained: +0.

    Language: Jupyter Notebook

    Topics: deep-learning, machine-learning, computer-vision, openvino, inference

  3. 3. RapidAI/RapidOCR

    📄 Awesome OCR multiple programing languages toolkits based on ONNX Runtime, OpenVINO, MNN, PaddlePaddle, TensorRT and PyTorch.

    GitHub repository with 6,813 stars and 649 forks.

    Trending score: 1.47; stars gained: +26; forks gained: +3.

    Language: Python

    Topics: ocr, onnxruntime, crnn, dbnet, openvino, rapidocr

  4. 4. open-edge-platform/dlstreamer

    Deep Learning Streamer (DL Streamer) Pipeline Framework is an open-source streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines for the Cloud or at the Edge.

    GitHub repository with 612 stars and 195 forks.

    Trending score: 0.99; stars gained: +1; forks gained: +0.

    Language: C++

    Topics: gstreamer, gstreamer-plugins, inference, intel, openvino

  5. 5. open-edge-platform/training_extensions

    Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™

    GitHub repository with 1,232 stars and 466 forks.

    Trending score: 0.88; stars gained: -1; forks gained: +0.

    Language: Python

    Topics: openvino, computer-vision, deep-learning, pytorch, neural-networks-compression, quantization

  6. 6. open-edge-platform/anomalib

    An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.

    GitHub repository with 5,830 stars and 939 forks.

    Trending score: 0.49; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: anomaly-detection, anomaly-localization, anomaly-segmentation, geti, neural-network-compression, openvino