optimizers repositories
Trending repositories tagged optimizers, ranked by trending score. Updated daily.
-
1
labmlai/annotated_deep_learning_paper_implementations
๐งโ๐ซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐ง
GitHub ยท Python ยท 67,779 stars ยท 6,776 forks ยท +6 stars in 24 hours ยท Trending score 1.54
-
2
IbrokhimN/ml-scratch-bench
From-scratch CPU vs CUDA implementations of 10 ML algorithms - AdamW, Nadam, L-BFGS, GMM-EM, Kernel PCA, MLP, Random Forest and more. No PyTorch, no cuDNN, no cuBLAS. Up to 24.7x GPU speedup.
GitHub ยท Cuda ยท 10 stars ยท 2 forks ยท +1 stars in 24 hours ยท Trending score 0.46
-
3
plugyawn/Megaprop
Newton-Muon + Preconditioned Optimizers for MoE Training at scale, with out-of-the-box support for MuP and FSDP support for Muon, built on top of Megatron-LM and TransformerEngine.
GitHub ยท 35 stars ยท 2 forks ยท 0 stars in 24 hours ยท Trending score 0.14
-
4
erolilhan/DataForge-Lua
DataPredict ML Library: 100+ Lua Models for Deep Learning and Reinforcement Learning 2026
GitHub ยท HTML ยท 68 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.01
-
5
AqwamCreates/DataPredict
Lua-Based Machine Learning, Deep Learning And Reinforcement Learning Library. Contains Over 110 Models!
GitHub ยท Lua ยท 27 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
6
palle-k/DL4S
Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux
GitHub ยท Swift ยท 108 stars ยท 13 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
7
MatthewK78/Rose
๐น Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.
GitHub ยท Python ยท 78 stars ยท 5 forks ยท 0 stars in 24 hours ยท Trending score 0.00