expert-parallelism repositories
Trending repositories tagged expert-parallelism, ranked by trending score. Updated daily.
-
1
NVIDIA-NeMo/labs-molt
A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).
GitHub · Python · 1,401 stars · 154 forks · +38 stars in 24 hours · Trending score 3.11
-
2
afdEP/afdEP-comm
Expert-parallel communication for Attention–FFN Disaggregation (AFD), built on DeepEP V2
GitHub · Python · 94 stars · 1 forks · 0 stars in 24 hours · Trending score 0.90
-
3
YuvrajSingh-mist/smolcluster
Educational distributed training and inference library for heterogeneous local hardware: Mac minis, Raspberry Pis and GPUs over plain Python sockets. FSDP, GRPO, parameter-server, expert and data parallelism.
GitHub · Python · 97 stars · 6 forks · 0 stars in 24 hours · Trending score 0.89