expert-parallelism repositories

Trending repositories tagged expert-parallelism, ranked by trending score. Updated daily.

  1. 1
    NVIDIA-NeMo/labs-molt

    A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).

    GitHub · Python · 1,401 stars · 154 forks · +38 stars in 24 hours · Trending score 3.11

  2. 2
    afdEP/afdEP-comm

    Expert-parallel communication for Attention–FFN Disaggregation (AFD), built on DeepEP V2

    GitHub · Python · 94 stars · 1 forks · 0 stars in 24 hours · Trending score 0.90

  3. 3
    YuvrajSingh-mist/smolcluster

    Educational distributed training and inference library for heterogeneous local hardware: Mac minis, Raspberry Pis and GPUs over plain Python sockets. FSDP, GRPO, parameter-server, expert and data parallelism.

    GitHub · Python · 97 stars · 6 forks · 0 stars in 24 hours · Trending score 0.89