llm-judge repositories

Trending repositories tagged llm-judge, ranked by trending score. Updated daily.

  1. 1
    EigenformAI/groundtruth-dynamic-benchmarking

    Open-source benchmark for evaluating LLMs on domain-specific geological reasoning, AI for geology, and source-grounded geological knowledge.

    GitHub · Python · 13 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46

  2. 2
    moathabdulqadir/kyi-warrant-auditor

    KYI Warrant Auditor: Fact-Driven Audit Tool for Verifying Warrant Scope and Compliance

    GitHub · TypeScript · 153 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  3. 3
    lizhiyao/oh-my-knowledge

    OMK helps people and agents build, maintain, and reuse valuable knowledge from real work and collaboration, with readable content, traceable sources, and revision history for future tasks.

    GitHub · TypeScript · 25 stars · 5 forks · 0 stars in 24 hours · Trending score 0.07

  4. 4
    green-dalii/pi-shift-router

    Per-turn model routing for the Pi coding agent: a small judge picks the cheap or the strong tier for each message, with multi-model failover, task-level orchestration, and an optional decision-model judge (Jev) that answers with a calibrated probability instead of prose.

    GitHub · TypeScript · 14 stars · 3 forks · 0 stars in 24 hours · Trending score 0.04

  5. 5
    rioffe/speccheck

    Specification conformance checker: for every ID a SPEC.md declares, find where code and tests cite it, join JUnit results, and report one evidence-backed status per ID — with an optional downgrade-only LLM judge. Ships the spec-writing / spec-review / spec-build skills.

    GitHub · Python · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    kouhxp/gutsy

    Local decision model with calibrated probabilities: send a state and yes/no, choice or score questions, get a probability for every option. 0.8B GGUF on CPU, Jev-style API.

    GitHub · HTML · 76 stars · 4 forks · −1 stars in 24 hours · Trending score -0.00