StartLuxLabs/DecisionPivot
DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.
GitHub repository with 152 stars and 3 forks.
Language: Python
Topics: benchmark, calibration, decision-making, evaluation, llm, llm-evaluation, selective-prediction