optimizers repositories

Trending repositories tagged optimizers, ranked by trending score. Updated daily.

  1. 1
    labmlai/annotated_deep_learning_paper_implementations

    ๐Ÿง‘โ€๐Ÿซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐Ÿ“; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ŸŽฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐Ÿง 

    GitHub ยท Python ยท 67,779 stars ยท 6,776 forks ยท +6 stars in 24 hours ยท Trending score 1.54

  2. 2
    IbrokhimN/ml-scratch-bench

    From-scratch CPU vs CUDA implementations of 10 ML algorithms - AdamW, Nadam, L-BFGS, GMM-EM, Kernel PCA, MLP, Random Forest and more. No PyTorch, no cuDNN, no cuBLAS. Up to 24.7x GPU speedup.

    GitHub ยท Cuda ยท 10 stars ยท 2 forks ยท +1 stars in 24 hours ยท Trending score 0.46

  3. 3
    plugyawn/Megaprop

    Newton-Muon + Preconditioned Optimizers for MoE Training at scale, with out-of-the-box support for MuP and FSDP support for Muon, built on top of Megatron-LM and TransformerEngine.

    GitHub ยท 35 stars ยท 2 forks ยท 0 stars in 24 hours ยท Trending score 0.14

  4. 4
    erolilhan/DataForge-Lua

    DataPredict ML Library: 100+ Lua Models for Deep Learning and Reinforcement Learning 2026

    GitHub ยท HTML ยท 68 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.01

  5. 5
    AqwamCreates/DataPredict

    Lua-Based Machine Learning, Deep Learning And Reinforcement Learning Library. Contains Over 110 Models!

    GitHub ยท Lua ยท 27 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  6. 6
    palle-k/DL4S

    Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux

    GitHub ยท Swift ยท 108 stars ยท 13 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  7. 7
    MatthewK78/Rose

    ๐ŸŒน Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

    GitHub ยท Python ยท 78 stars ยท 5 forks ยท 0 stars in 24 hours ยท Trending score 0.00