sft repositories

Trending repositories tagged sft, ranked by trending score. Updated daily.

  1. 1
    MakazhanAlpamys/Soup

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38

  2. 2
    datawhalechina/diy-llm

    Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识

    GitHub · Jupyter Notebook · 3,023 stars · 296 forks · +37 stars in 24 hours · Trending score 3.20

  3. 3
    modelscope/ms-swift

    Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

    GitHub · Python · 16,135 stars · 1,817 forks · +12 stars in 24 hours · Trending score 2.42

  4. 4
    Valen-Team/Roller

    Turn agent runs into training data. Roller rolls out Claude Code, Codex, OpenClaw and four other Harnesses in disposable Docker containers, grades benchmark tasks in place, and exports SFT-ready trajectories that keep reasoning, images and compacted-context segments.

    GitHub · Python · 106 stars · 0 forks · +37 stars in 24 hours · Trending score 1.78

  5. 5
    AI-Hypercomputer/maxtext

    A simple, performant, and scalable Jax LLM!

    GitHub · Python · 2,468 stars · 648 forks · +3 stars in 24 hours · Trending score 1.36

  6. 6
    AgileRL/AgileRL

    The complete post-training stack for LLMs, plus RL for any problem. SFT, DPO and multi-turn agentic RL, with evolutionary hyperparameter optimization built in.

    GitHub · Python · 970 stars · 84 forks · +1 stars in 24 hours · Trending score 0.73

  7. 7
    oumi-ai/oumi

    Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

    GitHub · Python · 9,436 stars · 798 forks · 0 stars in 24 hours · Trending score 0.47

  8. 8
    baidu-baige/LoongForge

    A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.

    GitHub · Python · 869 stars · 70 forks · 0 stars in 24 hours · Trending score 0.46

  9. 9
    inclusionAI/AReno

    An easy-to-use, fast toolkit to scale up RL post-training on a single node.

    GitHub · Python · 389 stars · 141 forks · 0 stars in 24 hours · Trending score 0.30

  10. 10
    Zihao-Wu06/distillops

    Black-box LLM distillation for any verifiable task, with text or image inputs: teacher API -> rejection sampling -> SFT -> eval -> GRPO

    GitHub · Python · 101 stars · 7 forks · 0 stars in 24 hours · Trending score 0.25

  11. 11
    HodeTech/ForgeLM

    Config-driven LLM fine-tuning with safety evaluation, EU AI Act compliance, 6 alignment methods, and one-command bundled quickstart templates.

    GitHub · Python · 9 stars · 12 forks · 0 stars in 24 hours · Trending score 0.14

  12. 12
    lordaashishh/tf-nlp-modern-stack

    Complete TensorFlow NLP Guide 2026: BERT, GPT and LLM Downstream Tasks Explained

    GitHub · HTML · 53 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  13. 13
    basetenlabs/loops-cookbook

    Baseten Loops example recipes and patterns

    GitHub · Python · 7 stars · 0 forks · −1 stars in 24 hours · Trending score 0.08

  14. 14
    tterrasson/retrograd

    Run and Fine-tune GGUF models, with LoRA or full weights, from SFT to agentic GRPO

    GitHub · Rust · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07

  15. 15
    Phoenix-chaser/CodeAgent-R

    Auditable code-repair post-training platform: source-group-isolated QLoRA SFT, mutation-audited tasks, execution-based checkpoint selection, paired frozen-test evaluation. 3-seed protocol on Qwen2.5-Coder-7B: mean +1.7pp, zero regressions

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  16. 16
    InternScience/GraphGen

    GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

    GitHub · Python · 1,231 stars · 100 forks · 0 stars in 24 hours · Trending score 0.02

  17. 17
    walkinglabs/hands-on-modern-rl

    🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

    GitHub · Jupyter Notebook · 4,755 stars · 350 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    gvkhosla/pi-tinker

    Fine-tune open-source models with Tinker from inside Pi — managed improve loops, data prep, evals, smoke tests, deploy snippets, and checkpoint chat.

    GitHub · TypeScript · 25 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    adongwanai/AgentGuide

    https://adongwanai.github.io/AgentGuide | AI Agent开发指南 | LangGraph实战 | 高级RAG | 转行大模型 | 大模型面试 | 算法工程师 | 面试题库 | 强化学习|数据合成

    GitHub · MDX · 11,663 stars · 1,094 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    invergent-ai/surogate

    Train and serve LLMs at extreme speed and massive throughput.

    GitHub · C++ · 884 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    agentscope-ai/TuFT

    Multi-tenant fine-tuning for LLMs with Tinker-compatible API

    GitHub · Python · 74 stars · 15 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    Goekdeniz-Guelmez/MLX-LoRA-Studio

    A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

    GitHub · Swift · 284 stars · 30 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    Anthony827624/Awesome-DLMs-post-training

    A curated list of papers and selected technical blogs on the post-training of Diffusion Language Models (DLMs).

    GitHub · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    zaoshangduziteng/sft-dataset-formatter

    本地优先的 SFT 训练数据格式转换工具:将 JSON、JSONL、CSV 统一为 OpenAI messages,并生成 LLaMA-Factory 可用的 train.jsonl / val.jsonl。

    GitHub · Python · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00