adamw repositories
Trending repositories tagged adamw, ranked by trending score. Updated daily.
-
1
plugyawn/Megaprop
Newton-Muon + Preconditioned Optimizers for MoE Training at scale, with out-of-the-box support for MuP and FSDP support for Muon, built on top of Megatron-LM and TransformerEngine.
GitHub · 35 stars · 2 forks · 0 stars in 24 hours · Trending score 0.14
-
2
Alpha-Park/genpark-adamw-decoupled-weight-decay-skill
AdamW optimizer engine decoupling L2 weight decay regularization from adaptive gradient first and second moments.
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00