sft repositories
Trending repositories tagged sft, ranked by trending score. Updated daily.
-
1
MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38
-
2
datawhalechina/diy-llm
Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识
GitHub · Jupyter Notebook · 3,023 stars · 296 forks · +37 stars in 24 hours · Trending score 3.20
-
3
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
GitHub · Python · 16,135 stars · 1,817 forks · +12 stars in 24 hours · Trending score 2.42
-
4
Valen-Team/Roller
Turn agent runs into training data. Roller rolls out Claude Code, Codex, OpenClaw and four other Harnesses in disposable Docker containers, grades benchmark tasks in place, and exports SFT-ready trajectories that keep reasoning, images and compacted-context segments.
GitHub · Python · 106 stars · 0 forks · +37 stars in 24 hours · Trending score 1.78
-
5
AI-Hypercomputer/maxtext
A simple, performant, and scalable Jax LLM!
GitHub · Python · 2,468 stars · 648 forks · +3 stars in 24 hours · Trending score 1.36
-
6
AgileRL/AgileRL
The complete post-training stack for LLMs, plus RL for any problem. SFT, DPO and multi-turn agentic RL, with evolutionary hyperparameter optimization built in.
GitHub · Python · 970 stars · 84 forks · +1 stars in 24 hours · Trending score 0.73
-
7
oumi-ai/oumi
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
GitHub · Python · 9,436 stars · 798 forks · 0 stars in 24 hours · Trending score 0.47
-
8
baidu-baige/LoongForge
A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
GitHub · Python · 869 stars · 70 forks · 0 stars in 24 hours · Trending score 0.46
-
9
inclusionAI/AReno
An easy-to-use, fast toolkit to scale up RL post-training on a single node.
GitHub · Python · 389 stars · 141 forks · 0 stars in 24 hours · Trending score 0.30
-
10
Zihao-Wu06/distillops
Black-box LLM distillation for any verifiable task, with text or image inputs: teacher API -> rejection sampling -> SFT -> eval -> GRPO
GitHub · Python · 101 stars · 7 forks · 0 stars in 24 hours · Trending score 0.25
-
11
HodeTech/ForgeLM
Config-driven LLM fine-tuning with safety evaluation, EU AI Act compliance, 6 alignment methods, and one-command bundled quickstart templates.
GitHub · Python · 9 stars · 12 forks · 0 stars in 24 hours · Trending score 0.14
-
12
lordaashishh/tf-nlp-modern-stack
Complete TensorFlow NLP Guide 2026: BERT, GPT and LLM Downstream Tasks Explained
GitHub · HTML · 53 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
13
basetenlabs/loops-cookbook
Baseten Loops example recipes and patterns
GitHub · Python · 7 stars · 0 forks · −1 stars in 24 hours · Trending score 0.08
-
14
tterrasson/retrograd
Run and Fine-tune GGUF models, with LoRA or full weights, from SFT to agentic GRPO
GitHub · Rust · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07
-
15
Phoenix-chaser/CodeAgent-R
Auditable code-repair post-training platform: source-group-isolated QLoRA SFT, mutation-audited tasks, execution-based checkpoint selection, paired frozen-test evaluation. 3-seed protocol on Qwen2.5-Coder-7B: mean +1.7pp, zero regressions
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06
-
16
InternScience/GraphGen
GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation
GitHub · Python · 1,231 stars · 100 forks · 0 stars in 24 hours · Trending score 0.02
-
17
walkinglabs/hands-on-modern-rl
🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
GitHub · Jupyter Notebook · 4,755 stars · 350 forks · 0 stars in 24 hours · Trending score 0.00
-
18
gvkhosla/pi-tinker
Fine-tune open-source models with Tinker from inside Pi — managed improve loops, data prep, evals, smoke tests, deploy snippets, and checkpoint chat.
GitHub · TypeScript · 25 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
19
adongwanai/AgentGuide
https://adongwanai.github.io/AgentGuide | AI Agent开发指南 | LangGraph实战 | 高级RAG | 转行大模型 | 大模型面试 | 算法工程师 | 面试题库 | 强化学习|数据合成
GitHub · MDX · 11,663 stars · 1,094 forks · 0 stars in 24 hours · Trending score 0.00
-
20
invergent-ai/surogate
Train and serve LLMs at extreme speed and massive throughput.
GitHub · C++ · 884 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00
-
21
agentscope-ai/TuFT
Multi-tenant fine-tuning for LLMs with Tinker-compatible API
GitHub · Python · 74 stars · 15 forks · 0 stars in 24 hours · Trending score 0.00
-
22
Goekdeniz-Guelmez/MLX-LoRA-Studio
A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
GitHub · Swift · 284 stars · 30 forks · 0 stars in 24 hours · Trending score 0.00
-
23
Anthony827624/Awesome-DLMs-post-training
A curated list of papers and selected technical blogs on the post-training of Diffusion Language Models (DLMs).
GitHub · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
24
zaoshangduziteng/sft-dataset-formatter
本地优先的 SFT 训练数据格式转换工具:将 JSON、JSONL、CSV 统一为 OpenAI messages,并生成 LLaMA-Factory 可用的 train.jsonl / val.jsonl。
GitHub · Python · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00