eval repositories

Trending repositories tagged eval, ranked by trending score. Updated daily.

  1. 1
    rpamis/comet

    Comet: agent skill harness for turning ideas into evaluated workflows

    GitHub · JavaScript · 3,305 stars · 316 forks · +5 stars in 24 hours · Trending score 1.63

  2. 2
    awslabs/uaef

    Universal Agent Evaluation Framework (UAEF) is a framework-agnostic evaluation system for AI agents. Invoke any agent and score it on multiple metrics spanning tool calling, response quality, safety, performance, and reasoning. Track experiments against baselines, catch regressions automatically, and get LLM-generated insights.

    GitHub · Python · 93 stars · 8 forks · 0 stars in 24 hours · Trending score 1.22

  3. 3
    ktwu01/benchmark-radar

    Track 50,331+ AI benchmark, eval, dataset, and data-quality records from 41 public sources, with linked evidence and daily updates.

    GitHub · Python · 409 stars · 65 forks · 0 stars in 24 hours · Trending score 1.16

  4. 4
    litefuse/litefuse

    Litefuse - Agent Observability and Evaluation Platform

    GitHub · TypeScript · 115 stars · 21 forks · +1 stars in 24 hours · Trending score 0.90

  5. 5
    Swival/swival

    A small, powerful, open-source CLI coding agent that works with open models.

    GitHub · Python · 360 stars · 25 forks · +1 stars in 24 hours · Trending score 0.63

  6. 6
    xg-gh-25/SwarmAI

    One brain, many hands: a self-evolving Agent OS. Domain knowledge (Brains) drives the work, it runs autonomously and in parallel on your cloud Hives, and it learns judgment from every session, so each task compounds and needs less of your attention. Human directs. AI delivers.

    GitHub · Python · 60 stars · 8 forks · 0 stars in 24 hours · Trending score 0.35

  7. 7
    dy/subscript

    Expression parser / evaluator.

    GitHub · JavaScript · 151 stars · 9 forks · 0 stars in 24 hours · Trending score 0.33

  8. 8
    alexgreensh/eval-genius

    Teach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it tells you. Deterministic-first, tool-agnostic.

    GitHub · Python · 27 stars · 4 forks · 0 stars in 24 hours · Trending score 0.14

  9. 9
    iris-eval/mcp-server

    Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.

    GitHub · TypeScript · 10 stars · 5 forks · 0 stars in 24 hours · Trending score 0.10

  10. 10
    majesticlabs-dev/writing-eval

    Writing Eval evaluates AI-generated text against configurable style rules and profiles to detect AI-writing patterns and produce deterministic Markdown/JSON audit reports.

    GitHub · Python · 10 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08

  11. 11
    privatenumber/mdeval

    Evaluate JavaScript in Markdown and interpolate results in-place

    GitHub · TypeScript · 59 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  12. 12
    Waterkyuu/theoria

    Agent gauge platform, comparison, operational observation.

    GitHub · Rust · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08

  13. 13
    kingdee/lingee-bench

    Enterprise-grade benchmark evaluating whether AI agents deliver verifiable business outcomes in real business systems — general domain, finance, supply chain, and manufacturing.

    GitHub · Python · 188 stars · 37 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    gf3/sandbox

    A nifty JavaScript sandbox for Node.js

    GitHub · JavaScript · 851 stars · 113 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    deniszykov/csharp-eval-unity3d

    C# Expression Parser for Unity3D

    GitHub · C# · 210 stars · 25 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    kimwalisch/calculator

    C++ math expression parser for integers

    GitHub · C++ · 109 stars · 71 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    nano-step/eval-harness

    Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance, and CI reports.

    GitHub · Shell · 15 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    GoogleCloudPlatform/evalbench

    EvalBench is a flexible framework designed to measure the quality of generative AI (GenAI) workflows around database specific tasks.

    GitHub · Python · 69 stars · 40 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    mgechev/skillgrade

    "Unit tests" for your agent skills

    GitHub · TypeScript · 721 stars · 49 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    natea/harness-eval

    Eval framework that ranks agentic coding frameworks (Superpowers, Compound Engineering, Agent Skills, GSD) by having each build the same spec with the same harness+model in isolated sandboxes, graded on a weighted evidence-based rubric: PRD adherence, code quality, speed, token spend

    GitHub · TypeScript · 15 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    maragudk/gai

    Go Artificial Intelligence (GAI) helps you work with foundational models, large language models, and other AI models.

    GitHub · Go · 54 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    AntonovAnton/math.evaluation

    This .NET library allows you to evaluate and compile any mathematical expression from a string dynamically at runtime. It supports a wide range of operations and allows for the use of custom variables, operators, and functions. The evaluator can be configured for different contexts, such as scientific, programming, boolean math expressions.

    GitHub · C# · 79 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    metahub-ai/assay

    An open, reproducible trust layer for AI artifacts — skills, MCP servers, agents, and plugins. Assay inspects code, runs sandboxed behavioral audits, and generates verifiable reports. Help us build the open standard for AI ecosystem security.

    GitHub · TypeScript · 12 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    adhabnr-ux/evalport

    EvalPort — The Open LLM Evaluation Standard. Portable test cases, graders, suites, and results across DeepEval, Promptfoo, Inspect AI, and more.

    GitHub · Python · 9 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00