cuda-graphs repositories
Trending repositories tagged cuda-graphs, ranked by trending score. Updated daily.
-
1
General-Sequences/sequence-ai
SequenceLink serves robot policies from GPUs anywhere: the policy runs on a GPU, and the robot connects to it over the internet. Works with openpi, LeRobot, GR00T and Octo, and with any policy written as a class. pip install sequence-ai
GitHub · Python · 22 stars · 0 forks · −28 stars in 24 hours · Trending score 0.05
-
2
Yolande1994/CUDA_GPT2_Inference
纯 CUDA 实现 GPT2 推理,逐步优化算子与架构,最终在单请求下推理速度领先 vLLM 约 1.5 倍。逐算子、逐迭代的进行:NCU 视察、性能解析与记录报告。
GitHub · Cuda · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04
-
3
StartLuxLabs/StartLux-Prism
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
GitHub · Python · 459 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00
-
4
aien-dev/CUDApp
CUDA++ for the NVIDIA DGX Spark (GB10, sm_121): Aien's own GPU machine-code toolchain, runtime and driver client, without the CUDA toolkit. Other NVIDIA GPUs are not supported yet.
GitHub · C · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00