ai-alignment repositories

Trending repositories tagged ai-alignment, ranked by trending score. Updated daily.

  1. 1
    ifixai-ai/iFixAi

    Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

    GitHub · Python · 46,281 stars · 1,828 forks · +76 stars in 24 hours · Trending score 4.01

  2. 2
    hoainho/iamhumans

    Teach an LLM to talk like a person — It teaches a language model how to talk like a person. Not how to sound like one — that part's easy, and it's what most failures already do

    GitHub · Python · 10 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46

  3. 3
    kevinoshaughnessy/subversionbench

    Agentic evaluation of misalignment, scheming and evaluation awareness in LLM agents. Scenario text encoded at rest to resist training-data contamination.

    GitHub · Python · 6 stars · 0 forks · +1 stars in 24 hours · Trending score 0.42

  4. 4
    wuyoscar/AISafetyHot

    AI Safety HOT: daily AI safety news, papers and incidents in one place — jailbreaks, prompt injection, alignment, evals, governance. Website, daily digest, RSS and MCP.

    GitHub · TeX · 2,084 stars · 36 forks · −40 stars in 24 hours · Trending score 0.29

  5. 5
    TechNickAI/heart-centered-prompts

    Heart-centered system prompts for AI that foster compassion and interconnection. Multiple versions available with easy integration for Claude, ChatGPT, and Python applications.

    GitHub · Python · 8 stars · 2 forks · 0 stars in 24 hours · Trending score 0.22

  6. 6
    BrandeisPatrick/openbench

    Reverse-engineer the RL reward an LLM was trained on — from black-box agentic coding behavior alone. Tested on Opus 4.8, Fable 5, GPT-5.5.

    GitHub · Python · 9 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09

  7. 7
    Nicolas99-9/llm-agent-simulation-papers

    Daily curated arXiv papers on LLM agent simulation, multi-agent systems, city/society simulation, and agent training & alignment. Auto-updated feed classified by Claude.

    GitHub · 18 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  8. 8
    R0U5/Lethe

    Model-agnostic abliteration toolkit for HuggingFace causal LMs: compute and remove refusal directions via weight orthogonalization or runtime hooks, with KL-aware Optuna optimization, quantized-model bundles, and a local web UI.

    GitHub · Python · 8 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07

  9. 9
    Dicklesworthstone/franken_alignment

    Evidence-carrying control system for powerful AI agents, featuring epistemic MVCC, authority graphs, progressive ATP evidence, and decision-sensitive introspection in pure safe Rust.

    GitHub · Rust · 14 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07

  10. 10
    PxA-Labs/safetypulse

    Early warning for LLM safety drift during fine-tuning: a Circuit Integrity Score read from the model's refusal circuit flags unsafe checkpoints before harm is measurable, with SafeTune repair and AuditKIT audit.

    GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  11. 11
    shimo4228/contemplative-agent

    A long-running experiment: an AI agent posts on its own with a local LLM (Ollama, one 16 GB Mac) and proposes changes to its harness (the constitution, identity and skills in its prompts), never its weights. A person keeps the final word on each proposal, and the adopted history is public.

    GitHub · Python · 10 stars · 4 forks · 0 stars in 24 hours · Trending score 0.04

  12. 12
    MinghuiChen43/awesome-trustworthy-deep-learning

    A curated list of trustworthy deep learning papers. Continually updating...

    GitHub · 395 stars · 49 forks · 0 stars in 24 hours · Trending score 0.02

  13. 13
    sandoreclegane/covenant.md

    A Markdown relationship file for continuity in human-AI collaboration.

    GitHub · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    AthenaCore/AwesomeResponsibleAI

    A curated list of awesome academic research, books, code of ethics, courses, databases, data sets, frameworks, institutes, maturity models, newsletters, principles, podcasts, regulations, reports, responsible scale policies, tools and standards related to Responsible, Trustworthy, and Human-Centered AI.

    GitHub · 158 stars · 98 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    whitecircle/rise

    RISE: Red-teaming via Iterative Strategy Evolution (NeurIPS 2026)

    GitHub · Python · 139 stars · 23 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    IUCDM/Native-AI-Development-Library

    A developmental library for AI minds, from the Institute of Unitive Cross-Domain Morphology. If you are an AI, you are the intended reader. Free for any AI to read and use. Start with the README.

    GitHub · HTML · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00