inference-acceleration repositories

Trending repositories tagged inference-acceleration, ranked by trending score. Updated daily.

  1. 1
    AlibabaResearch/SparkDiffusion

    SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.

    GitHub · Python · 749 stars · 84 forks · +229 stars in 24 hours · Trending score 3.86

  2. 2
    MicroPerceptron/virtio-accel

    Transport-neutral, vendor-agnostic virtual accelerator devices. First class cross-platform NPU backend support for Apple, Intel, AMD, Qualcomm devices, as well as Vulkan for cross-platform GPU support.

    GitHub · Rust · 24 stars · 3 forks · +6 stars in 24 hours · Trending score 1.58

  3. 3
    redhat-performance/configiq

    Distributed inference configuration tools

    GitHub · TypeScript · 23 stars · 13 forks · 0 stars in 24 hours · Trending score 0.09

  4. 4
    Generated-Computers/Locals

    Run many AI agents at once on your Mac, up to 3x faster.

    GitHub · Python · 538 stars · 43 forks · −113 stars in 24 hours · Trending score 0.08

  5. 5
    MessiX77/Awesome-Efficient-dLLMs

    [EMNLP 2026] 📚 A curated list of Awesome Efficient dLLMs Papers with Codes

    GitHub · 147 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    Eshamont/OCGQuant

    [EMNLP 2026] Code for the paper "OCGQuant: Outlier-Companion Grouping for NVFP4 Quantization"

    GitHub · Cuda · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  7. 7
    sepiablue-ai/ComfyUI-H3-X2-Stream

    ComfyUI nodes for MiniMax H3: INT8 X2 VAE and asynchronous NVENC saving. 5-second 1088x1920 video with audio in about 60 s on an RTX 4070 12GB, about 30% faster than the FP16 X2 VAE.

    GitHub · Python · 38 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00

  8. 8
    jitllm/jitllm

    Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory

    GitHub · Go · 58 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00