llm-judge repositories
Trending repositories tagged llm-judge, ranked by trending score. Updated daily.
-
1
EigenformAI/groundtruth-dynamic-benchmarking
Open-source benchmark for evaluating LLMs on domain-specific geological reasoning, AI for geology, and source-grounded geological knowledge.
GitHub · Python · 13 stars · 0 forks · +1 stars in 24 hours · Trending score 0.46
-
2
moathabdulqadir/kyi-warrant-auditor
KYI Warrant Auditor: Fact-Driven Audit Tool for Verifying Warrant Scope and Compliance
GitHub · TypeScript · 153 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
3
lizhiyao/oh-my-knowledge
OMK helps people and agents build, maintain, and reuse valuable knowledge from real work and collaboration, with readable content, traceable sources, and revision history for future tasks.
GitHub · TypeScript · 25 stars · 5 forks · 0 stars in 24 hours · Trending score 0.07
-
4
green-dalii/pi-shift-router
Per-turn model routing for the Pi coding agent: a small judge picks the cheap or the strong tier for each message, with multi-model failover, task-level orchestration, and an optional decision-model judge (Jev) that answers with a calibrated probability instead of prose.
GitHub · TypeScript · 14 stars · 3 forks · 0 stars in 24 hours · Trending score 0.04
-
5
rioffe/speccheck
Specification conformance checker: for every ID a SPEC.md declares, find where code and tests cite it, join JUnit results, and report one evidence-backed status per ID — with an optional downgrade-only LLM judge. Ships the spec-writing / spec-review / spec-build skills.
GitHub · Python · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
6
kouhxp/gutsy
Local decision model with calibrated probabilities: send a state and yes/no, choice or score questions, get a probability for every option. 0.8B GGUF on CPU, Jev-style API.
GitHub · HTML · 76 stars · 4 forks · −1 stars in 24 hours · Trending score -0.00