Tencent/ncnn

ncnn is a high-performance neural network inference framework optimized for the mobile platform

GitHub repository with 23,337 stars and 4,434 forks.

Language: C++

Topics: inference, high-preformance, simd, arm-neon, deep-learning, artificial-intelligence, android, ios, ncnn, vulkan

Open provider repository

24h trend summary

Trending score 1.26, activity score 2.02, stars gained +9, forks gained +0.

Latest metric snapshot

2026-06-05: 23,337 stars and 4,434 forks.

Similar repositories

  1. 1. vllm-project/vllm-ascend

    Community maintained hardware plugin for vLLM on Ascend

    GitHub repository with 2,196 stars and 1,345 forks.

    Trending score: 3.25; stars gained: +16; forks gained: +22.

    Language: C++

    Topics: ascend, inference, llm, llm-serving, llmops, mlops

  2. 2. ggml-org/whisper.cpp

    Port of OpenAI's Whisper model in C/C++

    GitHub repository with 50,467 stars and 5,616 forks.

    Trending score: 1.87; stars gained: +69; forks gained: +8.

    Language: C++

    Topics: openai, speech-to-text, transformer, whisper, inference, speech-recognition

  3. 3. kvcache-ai/Mooncake

    Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

    GitHub repository with 5,512 stars and 828 forks.

    Trending score: 1.44; stars gained: +14; forks gained: +13.

    Language: C++

    Topics: disaggregation, inference, kvcache, llm, rdma, reinforcement-learning

  4. 4. google-ai-edge/mediapipe

    Cross-platform, customizable ML solutions for live and streaming media.

    GitHub repository with 35,480 stars and 6,003 forks.

    Trending score: 1.41; stars gained: +29; forks gained: -2.

    Language: C++

    Topics: mediapipe, c-plus-plus, computer-vision, deep-learning, android, video-processing

  5. 5. Tencent/ncnn

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    GitHub repository with 23,337 stars and 4,434 forks.

    Trending score: 1.26; stars gained: +9; forks gained: +0.

    Language: C++

    Topics: inference, high-preformance, simd, arm-neon, deep-learning, artificial-intelligence

  6. 6. Lourdle/cosyvoice.cpp

    CosyVoice inference in C/C++

    GitHub repository with 21 stars and 8 forks.

    Trending score: 0.57; stars gained: +2; forks gained: +0.

    Language: C++

    Topics: ai, cosyvoice, cosyvoice3, ggml, gguf, inference

Trending in C++

  1. 1. ggml-org/llama.cpp

    LLM inference in C/C++

    GitHub repository with 114,689 stars and 19,190 forks.

    Trending score: 4.40; stars gained: +304; forks gained: +99.

    Language: C++

    Topics: ggml

  2. 2. duckdb/duckdb

    DuckDB is an analytical in-process SQL database management system

    GitHub repository with 38,615 stars and 3,298 forks.

    Trending score: 3.50; stars gained: +40; forks gained: +6.

    Language: C++

    Topics: sql, database, olap, analytics, embedded-database

  3. 3. vllm-project/vllm-ascend

    Community maintained hardware plugin for vLLM on Ascend

    GitHub repository with 2,196 stars and 1,345 forks.

    Trending score: 3.25; stars gained: +16; forks gained: +22.

    Language: C++

    Topics: ascend, inference, llm, llm-serving, llmops, mlops

  4. 4. electron/electron

    :electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS

    GitHub repository with 121,541 stars and 17,235 forks.

    Trending score: 3.02; stars gained: +16; forks gained: +2.

    Language: C++

    Topics: c-plus-plus, chrome, css, electron, html, javascript

  5. 5. ClickHouse/ClickHouse

    ClickHouse® is a real-time analytics database management system

    GitHub repository with 47,823 stars and 8,467 forks.

    Trending score: 2.96; stars gained: +53; forks gained: +10.

    Language: C++

    Topics: ai, analytics, big-data, clickhouse, cloud-native, cpp

  6. 6. LadybirdBrowser/ladybird

    Truly independent web browser

    GitHub repository with 63,751 stars and 3,075 forks.

    Trending score: 2.89; stars gained: +52; forks gained: +5.

    Language: C++

    Topics: browser, browser-engine

Trending topic: inference

  1. 1. vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    GitHub repository with 81,969 stars and 17,668 forks.

    Trending score: 3.75; stars gained: +79; forks gained: +46.

    Language: Python

    Topics: amd, blackwell, cuda, deepseek, deepseek-v3, gpt

  2. 2. vllm-project/vllm-ascend

    Community maintained hardware plugin for vLLM on Ascend

    GitHub repository with 2,196 stars and 1,345 forks.

    Trending score: 3.25; stars gained: +16; forks gained: +22.

    Language: C++

    Topics: ascend, inference, llm, llm-serving, llmops, mlops

  3. 3. gpustack/gpustack

    A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.

    GitHub repository with 5,103 stars and 541 forks.

    Trending score: 2.51; stars gained: +11; forks gained: +1.

    Language: Python

    Topics: ascend, cuda, deepseek, distributed-inference, genai, high-performance-inference

  4. 4. LMCache/LMCache

    LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

    GitHub repository with 8,419 stars and 1,246 forks.

    Trending score: 2.17; stars gained: +11; forks gained: +6.

    Language: Python

    Topics: amd, cuda, fast, inference, kv-cache, llm

  5. 5. ggml-org/whisper.cpp

    Port of OpenAI's Whisper model in C/C++

    GitHub repository with 50,467 stars and 5,616 forks.

    Trending score: 1.87; stars gained: +69; forks gained: +8.

    Language: C++

    Topics: openai, speech-to-text, transformer, whisper, inference, speech-recognition

  6. 6. sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    GitHub repository with 28,884 stars and 6,341 forks.

    Trending score: 1.72; stars gained: -55; forks gained: +18.

    Language: Python

    Topics: attention, blackwell, cuda, deepseek, diffusion, glm