llm-training repositories

Trending repositories tagged llm-training, ranked by trending score. Updated daily.

  1. 1
    bojieli/ai-infra-book

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    GitHub · Python · 8,154 stars · 666 forks · +93 stars in 24 hours · Trending score 3.93

  2. 2
    skypilot-org/skypilot

    The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

    GitHub · Python · 10,862 stars · 1,360 forks · +6 stars in 24 hours · Trending score 2.09

  3. 3
    rsi-gear/gear

    Scikit-learn for Recursive Self-improvement (RSI). A modular framework for recursive harness evolution.

    GitHub · TypeScript · 462 stars · 43 forks · 0 stars in 24 hours · Trending score 1.66

  4. 4
    utkuozdemir/nvidia_gpu_exporter

    Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML

    GitHub · Go · 1,597 stars · 161 forks · +4 stars in 24 hours · Trending score 1.47

  5. 5
    datawhalechina/llm-algo-leetcode

    Hands-on LLM algorithms and systems with PyTorch, Triton & CUDA.《大模型算法与系统教程》:模型架构与训练、后训练、推理加速、性能与算子优化,配套 Notebook 练习、答案解析、测试与实验。

    GitHub · Jupyter Notebook · 797 stars · 162 forks · 0 stars in 24 hours · Trending score 1.38

  6. 6
    h2oai/h2o-llmstudio

    H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

    GitHub · Python · 5,199 stars · 556 forks · +4 stars in 24 hours · Trending score 1.27

  7. 7
    myylogic/cevahir-ai

    Cevahir Zihin: a mind that learns by living, not a Transformer. It keeps knowledge as evidence on ties, attends with a Seven-Place Focus and learns from every conversation. Also: a Turkish BPE tokenizer, a Transformer language-model core and cognitive systems.

    GitHub · Python · 295 stars · 12 forks · 0 stars in 24 hours · Trending score 1.05

  8. 8
    walkinglabs/modern-llm-notebook

    A hands-on course on modern LLM architectures, training, and inference, with step-by-step PyTorch implementations and runnable notebooks.

    GitHub · Jupyter Notebook · 289 stars · 62 forks · +2 stars in 24 hours · Trending score 0.95

  9. 9
    tingaicompass/AI-Compass

    “AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。

    GitHub · Python · 1,000 stars · 136 forks · 0 stars in 24 hours · Trending score 0.66

  10. 10
    Edge-Intelligence-Lab/MobileFineTuner

    MobileFineTuner: Native C++ framework for fine-tuning LLMs directly on mobile devices. Features: LoRA/Full-FT, ZeRO-inspired parameter sharding, energy-aware throttling, custom autograd engine. Keep your data on-device.

    GitHub · C++ · 25 stars · 11 forks · 0 stars in 24 hours · Trending score 0.32

  11. 11
    traceopt-ai/traceml

    Find why PyTorch training is slow, compare runs, and catch performance regressions in CI.

    GitHub · Python · 189 stars · 33 forks · 0 stars in 24 hours · Trending score 0.32

  12. 12
    mostofashakib/tech-interview-curriculum

    Interview prep for LLM post-training, ML, system design, and coding — organized by career path.

    GitHub · Java · 25 stars · 7 forks · 0 stars in 24 hours · Trending score 0.22

  13. 13
    Tencent-Hunyuan/FlashTopK

    Fast, exact fused top-k selection for learned sparse attention training and inference, from HyScale (Tencent Hy & University of Edinburgh).

    GitHub · Python · 16 stars · 2 forks · 0 stars in 24 hours · Trending score 0.16

  14. 14
    erogol/BlaGPT

    Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible experimentation and exploration.

    GitHub · Python · 118 stars · 12 forks · 0 stars in 24 hours · Trending score 0.10

  15. 15
    bd4sur/Nano

    电子鹦鹉 / Toy Language Model

    GitHub · C · 299 stars · 14 forks · 0 stars in 24 hours · Trending score 0.10

  16. 16
    Human-Agent-Society/reef

    Infrastructure for continually self‑improving agents

    GitHub · Python · 7,660 stars · 731 forks · −129 stars in 24 hours · Trending score 0.10

  17. 17
    IonDen/mlx-train-perf

    Fused, logit-free linear-cross-entropy loss, RAM-fit planner, and benchmark harness for MLX fine-tuning on Apple Silicon

    GitHub · Python · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07

  18. 18
    farbodtavakkoli/OTel

    Open Telco (OTel) AI: an open ecosystem of telecom models, datasets, benchmarks, and reproducible training and inference recipes. A shared AI foundation that gives operators the freedom to choose their models, software, hardware, and infrastructure.

    GitHub · Python · 35 stars · 9 forks · 0 stars in 24 hours · Trending score 0.04

  19. 19
    openlake-project/openlake

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    GitHub · Rust · 3,094 stars · 421 forks · 0 stars in 24 hours · Trending score 0.04

  20. 20
    volcengine/veScale

    Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

    GitHub · Python · 1,048 stars · 65 forks · 0 stars in 24 hours · Trending score 0.04

  21. 21
    linkedin/Liger-Kernel

    Efficient Triton Kernels for LLM Training

    GitHub · Python · 6,690 stars · 649 forks · 0 stars in 24 hours · Trending score 0.02

  22. 22
    InternScience/GraphGen

    GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

    GitHub · Python · 1,231 stars · 100 forks · 0 stars in 24 hours · Trending score 0.02

  23. 23
    ludwig-ai/ludwig

    Low-code framework for building custom LLMs, neural networks, and other AI models

    GitHub · Python · 11,784 stars · 1,214 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    chrisliu298/awesome-on-policy-distillation

    A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models

    GitHub · 866 stars · 38 forks · 0 stars in 24 hours · Trending score 0.00