dpo repositories
Trending repositories tagged dpo, ranked by trending score. Updated daily.
-
1
MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38
-
2
dolev31/ProactiveInquirer
Asking for What Was Never Requested: horizontal and vertical proactivity in LLM agents. Need-graph metrics (no LLM judge) and Q&D, which trains a questioner from the consequences of its questions.
GitHub · Python · 22 stars · 0 forks · +10 stars in 24 hours · Trending score 1.63
-
3
Goekdeniz-Guelmez/mlx-lm-lora
Train Large Language Models on MLX.
GitHub · Python · 472 stars · 63 forks · 0 stars in 24 hours · Trending score 0.99
-
4
oumi-ai/oumi
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
GitHub · Python · 9,436 stars · 798 forks · 0 stars in 24 hours · Trending score 0.47
-
5
mostofashakib/tech-interview-curriculum
Interview prep for LLM post-training, ML, system design, and coding — organized by career path.
GitHub · Java · 25 stars · 7 forks · 0 stars in 24 hours · Trending score 0.22
-
6
HodeTech/ForgeLM
Config-driven LLM fine-tuning with safety evaluation, EU AI Act compliance, 6 alignment methods, and one-command bundled quickstart templates.
GitHub · Python · 9 stars · 12 forks · 0 stars in 24 hours · Trending score 0.14
-
7
lordaashishh/tf-nlp-modern-stack
Complete TensorFlow NLP Guide 2026: BERT, GPT and LLM Downstream Tasks Explained
GitHub · HTML · 53 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
8
mii-llm/palingenesis
Post-train LLMs and agents from one config: SFT, multi-turn RL in tool environments (MCP, Harbor, OpenEnv), on-policy distillation, DPO and merging, with state-of-the-art defaults.
GitHub · Python · 7 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09
-
9
Crescent-Ao/FinSec
FinSec: multi-stage financial model post-training, official safety evaluation, privacy assessment and executable Pi-Agent cryptographic auditing.
GitHub · Python · 23 stars · 1 forks · 0 stars in 24 hours · Trending score 0.05
-
10
codelion/pts
Pivotal Token Search
GitHub · Python · 160 stars · 9 forks · 0 stars in 24 hours · Trending score 0.01
-
11
dengxianghua888-ops/preference-lab
Policy-driven preference data for content moderation, with source-linked evidence, resumable runs, budget controls and TRL/ShareGPT exports.
GitHub · Python · 50 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00
-
12
walkinglabs/hands-on-modern-rl
🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
GitHub · Jupyter Notebook · 4,755 stars · 350 forks · 0 stars in 24 hours · Trending score 0.00
-
13
open-gitagent/shadowLM
A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.
GitHub · Python · 24 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00
-
14
Enping-Hu/minimind-deep-dive
从 MiniMind 源码读起,再延伸到现代大模型技术体系的中文学习笔记。主线逐行精读预训练 / SFT / DPO / PPO / GRPO 与训练机制;附录 17 篇进阶卷覆盖量化、投机解码、RLHF 全景、模型代际史等 MiniMind 没涉及、但进阶绕不开的主题。
GitHub · Python · 216 stars · 13 forks · 0 stars in 24 hours · Trending score 0.00
-
15
hscspring/post-training-atlas
An opinionated atlas of model post-training across modalities: RL, rewards, alignment, distillation, adaptation, agents, and their connections.
GitHub · Python · 75 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
16
0bserver07/Study-Reinforcement-Learning
RL study guide — foundations through RLHF, DPO, GRPO, RLVR, agentic RL, and offline RL. Hand-written CS294 notes, 34 lecture drafts, 9 tested exercises, citations that resolve.
GitHub · Python · 168 stars · 38 forks · 0 stars in 24 hours · Trending score 0.00
-
17
Anthony827624/Awesome-DLMs-post-training
A curated list of papers and selected technical blogs on the post-training of Diffusion Language Models (DLMs).
GitHub · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
18
Menno-MBA/infosec-council
Seven-expert security decision Gen-AI council plus red, blue, and incident-response teams for EU SMEs.
GitHub · JavaScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
19
GonzaloFuentes1/llm-learning-route
Roadmap and 44 hands-on guides (Spanish) for building LLMs: data, pretraining, post-training, evaluation and serving
GitHub · HTML · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
znxzsy/AlignLedger
Auditable human-feedback annotation, review, provenance, and frozen training-data export.
GitHub · Python · 100 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
21
alphaparkinc/genpark-pairwise-preference-dpo-loss-tracker-skill
GenPark AI Agent Skill - Direct Preference Optimization (DPO) implicit reward calculation, reference policy log-ratio tracking, and pairwise preference loss evaluation.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
22
Alpha-Park/genpark-kahneman-tversky-kto-utility-loss-skill
GenPark AI Agent Skill - Kahneman-Tversky Optimization (KTO) loss evaluator aligning agents directly on unpaired binary feedback (thumbs-up / thumbs-down) using prospect theory loss aversion.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
23
alphaparkinc/genpark-reinforcement-fine-tuning-trajectory-buffer-skill
GenPark AI Agent Skill - Prioritized experience replay buffer for agent reinforcement fine-tuning (RFT / GRPO) with advantage estimation and importance sampling weights.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
24
alphaparkinc/genpark-bradley-terry-elo-rating-tournament-skill
GenPark AI Agent Skill - Pairwise Bradley-Terry and Elo rating tournament engine for ranking multi-agent strategies, prompt mutations, and generated tool solutions.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00