peft repositories
Trending repositories tagged peft, ranked by trending score. Updated daily.
-
1
MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
GitHub · Python · 10,666 stars · 1,777 forks · +43 stars in 24 hours · Trending score 3.38
-
2
hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
GitHub · Python · 76,148 stars · 9,394 forks · +48 stars in 24 hours · Trending score 3.32
-
3
huggingface/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
GitHub · Python · 21,910 stars · 2,676 forks · +19 stars in 24 hours · Trending score 2.51
-
4
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
GitHub · Python · 16,135 stars · 1,817 forks · +12 stars in 24 hours · Trending score 2.42
-
5
dolev31/ProactiveInquirer
Asking for What Was Never Requested: horizontal and vertical proactivity in LLM agents. Need-graph metrics (no LLM judge) and Q&D, which trains a questioner from the consequences of its questions.
GitHub · Python · 22 stars · 0 forks · +10 stars in 24 hours · Trending score 1.63
-
6
whitecircle/halo
Halo is an open-source framework built by White Circle for training large language and multimodal models
GitHub · Python · 868 stars · 50 forks · +2 stars in 24 hours · Trending score 1.32
-
7
ModelCloud/GPTQModel
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
GitHub · Python · 1,294 stars · 220 forks · +2 stars in 24 hours · Trending score 1.11
-
8
LostBeard/SpawnDev.ILGPU.ML
Hardware-agnostic machine learning infrastructure for .NET. Implements high-performance neural network layers in C# that are transpiled to run on WebGPU, CUDA, OpenCL, WebGL, CPU, and Wasm via SpawnDev.ILGPU. Optimized for Blazor WebAssembly and native GPU execution.
GitHub · C# · 26 stars · 4 forks · +1 stars in 24 hours · Trending score 0.55
-
9
mem-audit/memaudit
Training-data memorization auditor for fine-tuned LLMs — Trainer/TRL plugin, canary MIA + regurgitation audit, Apache-2.0
GitHub · Python · 14 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46
-
10
modelscope/mcore-bridge
MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers — with support for 300+ large language models (Qwen3-Next, GLM-5.3, Deepseek-V4, MiniMax-2.7, ...) and 200+ multimodal large models (Qwen3.8, Qwen3-Omni, Gemma4, ...).
GitHub · Python · 107 stars · 56 forks · 0 stars in 24 hours · Trending score 0.43
-
11
astro-weights/astro-weights
Small course corrections for open LLMs. Agent-driven weight edits. Democratizing AI for all.
GitHub · Python · 8 stars · 3 forks · +1 stars in 24 hours · Trending score 0.42
-
12
DaoyuanLi2816/can-i-finetune-this
Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.
GitHub · Python · 796 stars · 107 forks · 0 stars in 24 hours · Trending score 0.32
-
13
HodeTech/ForgeLM
Config-driven LLM fine-tuning with safety evaluation, EU AI Act compliance, 6 alignment methods, and one-command bundled quickstart templates.
GitHub · Python · 9 stars · 12 forks · 0 stars in 24 hours · Trending score 0.14
-
14
PxA-Labs/safetypulse
Early warning for LLM safety drift during fine-tuning: a Circuit Integrity Score read from the model's refusal circuit flags unsafe checkpoints before harm is measurable, with SafeTune repair and AuditKIT audit.
GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06
-
15
Phoenix-chaser/CodeAgent-R
Auditable code-repair post-training platform: source-group-isolated QLoRA SFT, mutation-audited tasks, execution-based checkpoint selection, paired frozen-test evaluation. 3-seed protocol on Qwen2.5-Coder-7B: mean +1.7pp, zero regressions
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06
-
16
QingGo/engram-peft
🚀 Engram-PEFT: An unofficial implementation of DeepSeek Engram. Inject high-capacity conditional memory into LLMs via sparse retrieval PEFT without increasing inference FLOPs / DeepSeek Engram 架构的非官方实现。通过参数高效微调 (PEFT) 为大语言模型注入超大规模条件记忆,支持稀疏更新且不增加推理开销。
GitHub · Python · 52 stars · 9 forks · 0 stars in 24 hours · Trending score 0.02
-
17
wuwangzhang1216/abliterix
Automated alignment adjustment for LLMs — direct steering, LoRA, and MoE expert-granular abliteration, optimized via multi-objective Optuna TPE.
GitHub · Python · 276 stars · 46 forks · 0 stars in 24 hours · Trending score 0.00
-
18
open-gitagent/shadowLM
A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.
GitHub · Python · 24 stars · 10 forks · 0 stars in 24 hours · Trending score 0.00
-
19
kamalesh404/secforge
Fine-tune a small, security-focused coding LLM with QLoRA — prepare, train, merge, chat, evaluate, and serve it locally. No cloud lock-in.
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
LING71671/sydeny
Sydney: Fine-tuned model, companion novel, and philosophical inquiries.
GitHub · HTML · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
21
aghasalim/lora-forgetting
LoRA fine-tuning a small LLM for structured extraction, with the catastrophic-forgetting check most projects skip. Both numbers reported.
GitHub · Python · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00