cuda-graphs repositories

Trending repositories tagged cuda-graphs, ranked by trending score. Updated daily.

  1. 1
    General-Sequences/sequence-ai

    SequenceLink serves robot policies from GPUs anywhere: the policy runs on a GPU, and the robot connects to it over the internet. Works with openpi, LeRobot, GR00T and Octo, and with any policy written as a class. pip install sequence-ai

    GitHub · Python · 22 stars · 0 forks · −28 stars in 24 hours · Trending score 0.05

  2. 2
    Yolande1994/CUDA_GPT2_Inference

    纯 CUDA 实现 GPT2 推理,逐步优化算子与架构,最终在单请求下推理速度领先 vLLM 约 1.5 倍。逐算子、逐迭代的进行:NCU 视察、性能解析与记录报告。

    GitHub · Cuda · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04

  3. 3
    StartLuxLabs/StartLux-Prism

    Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.

    GitHub · Python · 459 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  4. 4
    aien-dev/CUDApp

    CUDA++ for the NVIDIA DGX Spark (GB10, sm_121): Aien's own GPU machine-code toolchain, runtime and driver client, without the CUDA toolkit. Other NVIDIA GPUs are not supported yet.

    GitHub · C · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00