adamw repositories

Trending repositories tagged adamw, ranked by trending score. Updated daily.

  1. 1
    plugyawn/Megaprop

    Newton-Muon + Preconditioned Optimizers for MoE Training at scale, with out-of-the-box support for MuP and FSDP support for Muon, built on top of Megatron-LM and TransformerEngine.

    GitHub · 35 stars · 2 forks · 0 stars in 24 hours · Trending score 0.14

  2. 2
    Alpha-Park/genpark-adamw-decoupled-weight-decay-skill

    AdamW optimizer engine decoupling L2 weight decay regularization from adaptive gradient first and second moments.

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00