fsdp repositories

Trending repositories tagged fsdp, ranked by trending score. Updated daily.

  1. 1
    NVIDIA-NeMo/labs-molt

    A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).

    GitHub · Python · 1,395 stars · 154 forks · +30 stars in 24 hours · Trending score 3.03

  2. 2
    sgl-project/SpecForge

    Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

    GitHub · Python · 1,291 stars · 400 forks · +1 stars in 24 hours · Trending score 1.20

  3. 3
    traceopt-ai/traceml

    Find why PyTorch training is slow, compare runs, and catch performance regressions in CI.

    GitHub · Python · 189 stars · 33 forks · 0 stars in 24 hours · Trending score 0.46

  4. 4
    lightseekorg/TorchSpec

    A PyTorch native library for training speculative decoding models

    GitHub · Python · 268 stars · 70 forks · 0 stars in 24 hours · Trending score 0.04

  5. 5
    Forge-researchlab/forge-kernels

    Forge kernels — fused Triton kernels for faster, leaner LLM fine-tuning. One-call patching into Hugging Face models via forge.patch(model), with FSDP2 multi-GPU support and a growing set of kernels and architectures. Every speedup backed by a committed benchmark. Apache-2.0.

    GitHub · Python · 11 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    meta-pytorch/torchft

    Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

    GitHub · Python · 551 stars · 86 forks · 0 stars in 24 hours · Trending score 0.00