justi/ruby_llm-contract
Validate and retry LLM outputs for ruby_llm. Describe the JSON response you expect, fall back to a stronger model when the cheaper one fails the rules, and gate CI on regressions — all as one contract object per step.
GitHub repository with 30 stars and 0 forks.
Language: Ruby
Topics: ai, anthropic, cost-tracking, eval, llm, model-comparison, openai, rails, regression-testing, ruby