cuda-kernels repositories
Trending repositories tagged cuda-kernels, ranked by trending score. Updated daily.
-
1
xlite-dev/LeetCUDA
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
GitHub · TeX · 12,204 stars · 1,276 forks · +18 stars in 24 hours · Trending score 2.25
-
2
flashrt-project/FlashRT
FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B
GitHub · C++ · 817 stars · 107 forks · +13 stars in 24 hours · Trending score 1.97
-
3
h5i-dev/h5i
An Axum-based Rust web framework with Lean 4-verifiable application kernels that run on servers, bare-metal embedded devices, and GPUs, plus integrated security testing.
GitHub · Rust · 931 stars · 82 forks · +3 stars in 24 hours · Trending score 1.52
-
4
NVIDIA/cudnn-frontend
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
GitHub · Cuda · 1,007 stars · 340 forks · +3 stars in 24 hours · Trending score 1.47
-
5
alexturkey/wan22-pascal-4gb
Wan 2.2 TI2V-5B video generation on a 4 GB GTX 1050 Ti (Pascal): stable-diffusion.cpp patches, byte-identical speedups, recipe and agent-readable install guide
GitHub · Python · 27 stars · 13 forks · +15 stars in 24 hours · Trending score 1.42
-
6
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
GitHub · Python · 8,150 stars · 782 forks · +1 stars in 24 hours · Trending score 1.25
-
7
NVIDIA/cccl
CUDA Core Compute Libraries
GitHub · C++ · 2,580 stars · 557 forks · +1 stars in 24 hours · Trending score 0.96
-
8
NVIDIA/nvbench
CUDA Kernel Benchmarking Library
GitHub · Cuda · 949 stars · 137 forks · 0 stars in 24 hours · Trending score 0.95
-
9
pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
GitHub · Rust · 745 stars · 121 forks · 0 stars in 24 hours · Trending score 0.57
-
10
KernelTuner/kernel_tuner
Kernel Tuner
GitHub · Python · 428 stars · 70 forks · 0 stars in 24 hours · Trending score 0.29
-
11
sashakolpakov/dire-rapids
DiRe accelerated by PyTorch, PyKeOps and cuVS
GitHub · Python · 12 stars · 2 forks · 0 stars in 24 hours · Trending score 0.20
-
12
Yolande1994/CUDA_GPT2_Inference
纯 CUDA 实现 GPT2 推理,逐步优化算子与架构,最终在单请求下推理速度领先 vLLM 约 1.5 倍。含详细 NCU 分析、系统性讲解与记录报告。
GitHub · Cuda · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.19
-
13
Danialjfz/Opti-GEMM
Step-by-step CUDA GEMM optimization: from naive kernels to architecture-aware GPU performance analysis.
GitHub · Cuda · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.09
-
14
bgin/RF-EMT
Radio-Frequency Engineering Modeling Toolkit (RF-EMT). This project provides a high-fidelity simulation framework for Radar,Telecommunication and the other Radio-frequency engineering systems. The goal is to achieve realistic, design-level system modeling and simulation.
GitHub · C++ · 70 stars · 23 forks · 0 stars in 24 hours · Trending score 0.08
-
15
ashvardanian/ScalingElections
GPU-accelerated Schulze voting method in Python, Numba, CUDA, and Mojo 🔥, using ideas from Algebraic Graph Theory
GitHub · Cuda · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.06
-
16
aien-dev/CUDApp
CUDA++ for the NVIDIA DGX Spark (GB10, sm_121): Aien's own GPU machine-code toolchain, runtime and driver client, without the CUDA toolkit. Other NVIDIA GPUs are not supported yet.
GitHub · C · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.01
-
17
yanght27/GPU-Perf-Playground
GPU 性能与 AI Infra 学习项目:CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构
GitHub · Python · 126 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00
-
18
talhatahir-10xe/CuQwen
High-performance CUDA inference engine for Qwen models, written from scratch in C++/CUDA
GitHub · Cuda · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
19
NVIDIA/cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
GitHub · C++ · 9,742 stars · 2,446 forks · 0 stars in 24 hours · Trending score 0.00