eval repositories
Trending repositories tagged eval, ranked by trending score. Updated daily.
-
1
rpamis/comet
Comet: agent skill harness for turning ideas into evaluated workflows
GitHub · JavaScript · 3,305 stars · 316 forks · +5 stars in 24 hours · Trending score 1.63
-
2
awslabs/uaef
Universal Agent Evaluation Framework (UAEF) is a framework-agnostic evaluation system for AI agents. Invoke any agent and score it on multiple metrics spanning tool calling, response quality, safety, performance, and reasoning. Track experiments against baselines, catch regressions automatically, and get LLM-generated insights.
GitHub · Python · 93 stars · 8 forks · 0 stars in 24 hours · Trending score 1.22
-
3
ktwu01/benchmark-radar
Track 50,331+ AI benchmark, eval, dataset, and data-quality records from 41 public sources, with linked evidence and daily updates.
GitHub · Python · 409 stars · 65 forks · 0 stars in 24 hours · Trending score 1.16
-
4
litefuse/litefuse
Litefuse - Agent Observability and Evaluation Platform
GitHub · TypeScript · 115 stars · 21 forks · +1 stars in 24 hours · Trending score 0.90
-
5
Swival/swival
A small, powerful, open-source CLI coding agent that works with open models.
GitHub · Python · 360 stars · 25 forks · +1 stars in 24 hours · Trending score 0.63
-
6
xg-gh-25/SwarmAI
One brain, many hands: a self-evolving Agent OS. Domain knowledge (Brains) drives the work, it runs autonomously and in parallel on your cloud Hives, and it learns judgment from every session, so each task compounds and needs less of your attention. Human directs. AI delivers.
GitHub · Python · 60 stars · 8 forks · 0 stars in 24 hours · Trending score 0.35
-
7
dy/subscript
Expression parser / evaluator.
GitHub · JavaScript · 151 stars · 9 forks · 0 stars in 24 hours · Trending score 0.33
-
8
alexgreensh/eval-genius
Teach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it tells you. Deterministic-first, tool-agnostic.
GitHub · Python · 27 stars · 4 forks · 0 stars in 24 hours · Trending score 0.14
-
9
iris-eval/mcp-server
Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.
GitHub · TypeScript · 10 stars · 5 forks · 0 stars in 24 hours · Trending score 0.10
-
10
majesticlabs-dev/writing-eval
Writing Eval evaluates AI-generated text against configurable style rules and profiles to detect AI-writing patterns and produce deterministic Markdown/JSON audit reports.
GitHub · Python · 10 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08
-
11
privatenumber/mdeval
Evaluate JavaScript in Markdown and interpolate results in-place
GitHub · TypeScript · 59 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
12
Waterkyuu/theoria
Agent gauge platform, comparison, operational observation.
GitHub · Rust · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08
-
13
kingdee/lingee-bench
Enterprise-grade benchmark evaluating whether AI agents deliver verifiable business outcomes in real business systems — general domain, finance, supply chain, and manufacturing.
GitHub · Python · 188 stars · 37 forks · 0 stars in 24 hours · Trending score 0.00
-
14
gf3/sandbox
A nifty JavaScript sandbox for Node.js
GitHub · JavaScript · 851 stars · 113 forks · 0 stars in 24 hours · Trending score 0.00
-
15
deniszykov/csharp-eval-unity3d
C# Expression Parser for Unity3D
GitHub · C# · 210 stars · 25 forks · 0 stars in 24 hours · Trending score 0.00
-
16
kimwalisch/calculator
C++ math expression parser for integers
GitHub · C++ · 109 stars · 71 forks · 0 stars in 24 hours · Trending score 0.00
-
17
nano-step/eval-harness
Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance, and CI reports.
GitHub · Shell · 15 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
18
GoogleCloudPlatform/evalbench
EvalBench is a flexible framework designed to measure the quality of generative AI (GenAI) workflows around database specific tasks.
GitHub · Python · 69 stars · 40 forks · 0 stars in 24 hours · Trending score 0.00
-
19
mgechev/skillgrade
"Unit tests" for your agent skills
GitHub · TypeScript · 721 stars · 49 forks · 0 stars in 24 hours · Trending score 0.00
-
20
natea/harness-eval
Eval framework that ranks agentic coding frameworks (Superpowers, Compound Engineering, Agent Skills, GSD) by having each build the same spec with the same harness+model in isolated sandboxes, graded on a weighted evidence-based rubric: PRD adherence, code quality, speed, token spend
GitHub · TypeScript · 15 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00
-
21
maragudk/gai
Go Artificial Intelligence (GAI) helps you work with foundational models, large language models, and other AI models.
GitHub · Go · 54 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00
-
22
AntonovAnton/math.evaluation
This .NET library allows you to evaluate and compile any mathematical expression from a string dynamically at runtime. It supports a wide range of operations and allows for the use of custom variables, operators, and functions. The evaluator can be configured for different contexts, such as scientific, programming, boolean math expressions.
GitHub · C# · 79 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00
-
23
metahub-ai/assay
An open, reproducible trust layer for AI artifacts — skills, MCP servers, agents, and plugins. Assay inspects code, runs sandboxed behavioral audits, and generates verifiable reports. Help us build the open standard for AI ecosystem security.
GitHub · TypeScript · 12 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
24
adhabnr-ux/evalport
EvalPort — The Open LLM Evaluation Standard. Portable test cases, graders, suites, and results across DeepEval, Promptfoo, Inspect AI, and more.
GitHub · Python · 9 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00