dpo repositories

Trending repositories tagged dpo, ranked by trending score. Updated daily.

  1. 1
    MakazhanAlpamys/Soup

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38

  2. 2
    dolev31/ProactiveInquirer

    Asking for What Was Never Requested: horizontal and vertical proactivity in LLM agents. Need-graph metrics (no LLM judge) and Q&D, which trains a questioner from the consequences of its questions.

    GitHub · Python · 22 stars · 0 forks · +10 stars in 24 hours · Trending score 1.63

  3. 3
    Goekdeniz-Guelmez/mlx-lm-lora

    Train Large Language Models on MLX.

    GitHub · Python · 472 stars · 63 forks · 0 stars in 24 hours · Trending score 0.99

  4. 4
    oumi-ai/oumi

    Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

    GitHub · Python · 9,436 stars · 798 forks · 0 stars in 24 hours · Trending score 0.47

  5. 5
    mostofashakib/tech-interview-curriculum

    Interview prep for LLM post-training, ML, system design, and coding — organized by career path.

    GitHub · Java · 25 stars · 7 forks · 0 stars in 24 hours · Trending score 0.22

  6. 6
    HodeTech/ForgeLM

    Config-driven LLM fine-tuning with safety evaluation, EU AI Act compliance, 6 alignment methods, and one-command bundled quickstart templates.

    GitHub · Python · 9 stars · 12 forks · 0 stars in 24 hours · Trending score 0.14

  7. 7
    lordaashishh/tf-nlp-modern-stack

    Complete TensorFlow NLP Guide 2026: BERT, GPT and LLM Downstream Tasks Explained

    GitHub · HTML · 53 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  8. 8
    mii-llm/palingenesis

    Post-train LLMs and agents from one config: SFT, multi-turn RL in tool environments (MCP, Harbor, OpenEnv), on-policy distillation, DPO and merging, with state-of-the-art defaults.

    GitHub · Python · 7 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09

  9. 9
    Crescent-Ao/FinSec

    FinSec: multi-stage financial model post-training, official safety evaluation, privacy assessment and executable Pi-Agent cryptographic auditing.

    GitHub · Python · 23 stars · 1 forks · 0 stars in 24 hours · Trending score 0.05

  10. 10
    codelion/pts

    Pivotal Token Search

    GitHub · Python · 160 stars · 9 forks · 0 stars in 24 hours · Trending score 0.01

  11. 11
    dengxianghua888-ops/preference-lab

    Policy-driven preference data for content moderation, with source-linked evidence, resumable runs, budget controls and TRL/ShareGPT exports.

    GitHub · Python · 50 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    walkinglabs/hands-on-modern-rl

    🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

    GitHub · Jupyter Notebook · 4,755 stars · 350 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    open-gitagent/shadowLM

    A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.

    GitHub · Python · 24 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    Enping-Hu/minimind-deep-dive

    从 MiniMind 源码读起,再延伸到现代大模型技术体系的中文学习笔记。主线逐行精读预训练 / SFT / DPO / PPO / GRPO 与训练机制;附录 17 篇进阶卷覆盖量化、投机解码、RLHF 全景、模型代际史等 MiniMind 没涉及、但进阶绕不开的主题。

    GitHub · Python · 216 stars · 13 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    hscspring/post-training-atlas

    An opinionated atlas of model post-training across modalities: RL, rewards, alignment, distillation, adaptation, agents, and their connections.

    GitHub · Python · 75 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    0bserver07/Study-Reinforcement-Learning

    RL study guide — foundations through RLHF, DPO, GRPO, RLVR, agentic RL, and offline RL. Hand-written CS294 notes, 34 lecture drafts, 9 tested exercises, citations that resolve.

    GitHub · Python · 168 stars · 38 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    Anthony827624/Awesome-DLMs-post-training

    A curated list of papers and selected technical blogs on the post-training of Diffusion Language Models (DLMs).

    GitHub · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    Menno-MBA/infosec-council

    Seven-expert security decision Gen-AI council plus red, blue, and incident-response teams for EU SMEs.

    GitHub · JavaScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    GonzaloFuentes1/llm-learning-route

    Roadmap and 44 hands-on guides (Spanish) for building LLMs: data, pretraining, post-training, evaluation and serving

    GitHub · HTML · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    znxzsy/AlignLedger

    Auditable human-feedback annotation, review, provenance, and frozen training-data export.

    GitHub · Python · 100 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    alphaparkinc/genpark-pairwise-preference-dpo-loss-tracker-skill

    GenPark AI Agent Skill - Direct Preference Optimization (DPO) implicit reward calculation, reference policy log-ratio tracking, and pairwise preference loss evaluation.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    Alpha-Park/genpark-kahneman-tversky-kto-utility-loss-skill

    GenPark AI Agent Skill - Kahneman-Tversky Optimization (KTO) loss evaluator aligning agents directly on unpaired binary feedback (thumbs-up / thumbs-down) using prospect theory loss aversion.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    alphaparkinc/genpark-reinforcement-fine-tuning-trajectory-buffer-skill

    GenPark AI Agent Skill - Prioritized experience replay buffer for agent reinforcement fine-tuning (RFT / GRPO) with advantage estimation and importance sampling weights.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    alphaparkinc/genpark-bradley-terry-elo-rating-tournament-skill

    GenPark AI Agent Skill - Pairwise Bradley-Terry and Elo rating tournament engine for ranking multi-agent strategies, prompt mutations, and generated tool solutions.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00