peft repositories

Trending repositories tagged peft, ranked by trending score. Updated daily.

  1. 1
    MakazhanAlpamys/Soup

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38

  2. 2
    hiyouga/LlamaFactory

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    GitHub · Python · 76,148 stars · 9,394 forks · +48 stars in 24 hours · Trending score 3.32

  3. 3
    huggingface/peft

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    GitHub · Python · 21,910 stars · 2,676 forks · +19 stars in 24 hours · Trending score 2.51

  4. 4
    modelscope/ms-swift

    Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

    GitHub · Python · 16,135 stars · 1,817 forks · +12 stars in 24 hours · Trending score 2.42

  5. 5
    dolev31/ProactiveInquirer

    Asking for What Was Never Requested: horizontal and vertical proactivity in LLM agents. Need-graph metrics (no LLM judge) and Q&D, which trains a questioner from the consequences of its questions.

    GitHub · Python · 22 stars · 0 forks · +10 stars in 24 hours · Trending score 1.63

  6. 6
    whitecircle/halo

    Halo is an open-source framework built by White Circle for training large language and multimodal models

    GitHub · Python · 868 stars · 50 forks · +2 stars in 24 hours · Trending score 1.32

  7. 7
    ModelCloud/GPTQModel

    LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

    GitHub · Python · 1,294 stars · 220 forks · +2 stars in 24 hours · Trending score 1.11

  8. 8
    LostBeard/SpawnDev.ILGPU.ML

    Hardware-agnostic machine learning infrastructure for .NET. Implements high-performance neural network layers in C# that are transpiled to run on WebGPU, CUDA, OpenCL, WebGL, CPU, and Wasm via SpawnDev.ILGPU. Optimized for Blazor WebAssembly and native GPU execution.

    GitHub · C# · 26 stars · 4 forks · +1 stars in 24 hours · Trending score 0.55

  9. 9
    mem-audit/memaudit

    Training-data memorization auditor for fine-tuned LLMs — Trainer/TRL plugin, canary MIA + regurgitation audit, Apache-2.0

    GitHub · Python · 14 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46

  10. 10
    modelscope/mcore-bridge

    MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers — with support for 300+ large language models (Qwen3-Next, GLM-5.3, Deepseek-V4, MiniMax-2.7, ...) and 200+ multimodal large models (Qwen3.8, Qwen3-Omni, Gemma4, ...).

    GitHub · Python · 107 stars · 56 forks · 0 stars in 24 hours · Trending score 0.43

  11. 11
    astro-weights/astro-weights

    Small course corrections for open LLMs. Agent-driven weight edits. Democratizing AI for all.

    GitHub · Python · 8 stars · 3 forks · +1 stars in 24 hours · Trending score 0.42

  12. 12
    DaoyuanLi2816/can-i-finetune-this

    Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

    GitHub · Python · 796 stars · 107 forks · 0 stars in 24 hours · Trending score 0.32

  13. 13
    HodeTech/ForgeLM

    Config-driven LLM fine-tuning with safety evaluation, EU AI Act compliance, 6 alignment methods, and one-command bundled quickstart templates.

    GitHub · Python · 9 stars · 12 forks · 0 stars in 24 hours · Trending score 0.14

  14. 14
    PxA-Labs/safetypulse

    Early warning for LLM safety drift during fine-tuning: a Circuit Integrity Score read from the model's refusal circuit flags unsafe checkpoints before harm is measurable, with SafeTune repair and AuditKIT audit.

    GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  15. 15
    Phoenix-chaser/CodeAgent-R

    Auditable code-repair post-training platform: source-group-isolated QLoRA SFT, mutation-audited tasks, execution-based checkpoint selection, paired frozen-test evaluation. 3-seed protocol on Qwen2.5-Coder-7B: mean +1.7pp, zero regressions

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  16. 16
    QingGo/engram-peft

    🚀 Engram-PEFT: An unofficial implementation of DeepSeek Engram. Inject high-capacity conditional memory into LLMs via sparse retrieval PEFT without increasing inference FLOPs / DeepSeek Engram 架构的非官方实现。通过参数高效微调 (PEFT) 为大语言模型注入超大规模条件记忆,支持稀疏更新且不增加推理开销。

    GitHub · Python · 52 stars · 9 forks · 0 stars in 24 hours · Trending score 0.02

  17. 17
    wuwangzhang1216/abliterix

    Automated alignment adjustment for LLMs — direct steering, LoRA, and MoE expert-granular abliteration, optimized via multi-objective Optuna TPE.

    GitHub · Python · 276 stars · 46 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    open-gitagent/shadowLM

    A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.

    GitHub · Python · 24 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    kamalesh404/secforge

    Fine-tune a small, security-focused coding LLM with QLoRA — prepare, train, merge, chat, evaluate, and serve it locally. No cloud lock-in.

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    LING71671/sydeny

    Sydney: Fine-tuned model, companion novel, and philosophical inquiries.

    GitHub · HTML · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    aghasalim/lora-forgetting

    LoRA fine-tuning a small LLM for structured extraction, with the catastrophic-forgetting check most projects skip. Both numbers reported.

    GitHub · Python · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00