Yolande1994/CUDA_GPT2_Inference

纯 CUDA 实现 GPT2 推理，逐步优化算子与架构，最终在单请求下推理速度领先 vLLM 约 1.5 倍。含详细 NCU 分析与 README 优化报告。

GitHub repository with 12 stars and 0 forks.

Language: Cuda

Topics: cpp, cuda, cuda-graphs, cuda-kernels, flash-attention, flash-decoding, gemv, gpt-2, kv-cache, llm-inference

Open provider repository

24h trend summary

Trending score 0.09, freshness score 0.73, stars gained +0, forks gained +0.

Latest metric snapshot

2026-11-15: 12 stars and 0 forks.

Trending topic: cpp

  1. 1. eisenwave/cowel

    COWEL (Compact Web Language) is a markup language that provides easy access to HTML features while being much more convenient to write.

    GitHub repository with 35 stars and 2 forks.

    Trending score: 0.00.

    Language: C++

    Topics: cpp, markup, cowel

  2. 2. jwmcglynn/donner

    A native SVG editor built on its own SVG2 and CSS3 engine, written from scratch in C++20.

    GitHub repository with 34 stars and 2 forks.

    Trending score: 0.10; stars gained: +0; forks gained: +0.

    Language: C++

    Topics: cpp, cpp20, css3, svg, svg2