agent-testing repositories
Trending repositories tagged agent-testing, ranked by trending score. Updated daily.
-
1
langwatch/langwatch
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
GitHub · TypeScript · 5,048 stars · 434 forks · +3 stars in 24 hours · Trending score 1.55
-
2
najeed/ai-agent-eval-harness
The open-source MultiAgentOps evaluation and verification harness for any industry business workflow.
GitHub · Python · 48 stars · 9 forks · +3 stars in 24 hours · Trending score 1.01
-
3
reticlehq/reticle
AI agents can generate code, but still struggle to understand what they build. Reticle brings Jev-style machine-native runtime perception to web & desktop applications.
GitHub · TypeScript · 1,318 stars · 262 forks · 0 stars in 24 hours · Trending score 0.92
-
4
langwatch/scenario
Agentic testing for agentic codebases
GitHub · TypeScript · 1,030 stars · 93 forks · 0 stars in 24 hours · Trending score 0.64
-
5
TaimoorKhan10/replayd
Turn failed AI agent runs into replayable regression tests. Catch regressions before you ship.
GitHub · Python · 19 stars · 2 forks · 0 stars in 24 hours · Trending score 0.28
-
6
ProofAgent-ai/proofagent-harness
Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI
GitHub · Python · 40 stars · 10 forks · 0 stars in 24 hours · Trending score 0.19
-
7
LambdaTest/rook
rook by TestMu AI: Agent Assurance from the terminal. Test how your AI agents actually behave across workflows, tools, and actions, and catch failures and vulnerabilities before they ship.
GitHub · Shell · 80 stars · 15 forks · −1 stars in 24 hours · Trending score 0.19
-
8
LeonEvo1103/surfaceloom
Open-source AI agent testing framework for browser and native desktop apps, with explicit tool effects, evidence, lifecycle, and trace contracts.
GitHub · TypeScript · 23 stars · 2 forks · 0 stars in 24 hours · Trending score 0.14
-
9
LambdaTest/homebrew-rook
Official Homebrew tap for rook by TestMu AI: agent assurance from the terminal. brew install lambdatest/rook/rook
GitHub · Shell · 23 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09
-
10
samikuikka/apo
Capability testing for agent harnesses: turn expert knowledge into executable specifications, run the real agent, get a binary pass/fail verdict with tests, traces, and deliverables.
GitHub · TypeScript · 5 stars · 3 forks · 0 stars in 24 hours · Trending score 0.09
-
11
vonavikon/qa-agent-evals
Acceptance testing for LLM systems via role subagents (Claude Code plugin)
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09
-
12
DefuzeX-AI/AgentBehaviorBench
AgentBehaviorBench (ABB): A benchmark for evaluating AI agents’ ability to test other agents and detect behavioral defects.
GitHub · Python · 22 stars · 30 forks · 0 stars in 24 hours · Trending score 0.01
-
13
nano-step/eval-harness
Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance, and CI reports.
GitHub · Shell · 15 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
14
automators-com/flowproof
Agents are starting to run real business processes. flowproof tests them like anything else: record one real run, then replay it on every commit with zero LLM calls, asserting which tools were called, with which arguments, in which order, and which were not.
GitHub · Rust · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
15
theagentplane/chronicle
Record-and-replay for agent decision graphs: reproduce a prod agent failure as a committed regression test, and re-run your fix without live LLM calls.
GitHub · Python · 27 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
16
arthi-arumugam-git/whatbroke
Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit prompts.
GitHub · TypeScript · 21 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
17
lewismosciski/LMMOCK
A lightweight local mock LLM provider — deterministic OpenAI and Anthropic responses, with no API calls, no tokens, and no code changes.
GitHub · Python · 47 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
18
zariffromlatif/life-forge
Autonomous flight simulator for AI agents: co-evolutionary adversarial red-teaming with 3D MAP-Elites quality-diversity. Discovers zero-days in LLM agents before production. MCP-native.
GitHub · Python · 5 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
19
Alpha-Park/genpark-agent-chaos-injection-and-resilience-evaluator-skill
Injects synthetic latency, truncated responses, and HTTP error faults to evaluate autonomous agent self-healing resilience | GenPark: https://www.genpark.ai | LinkedIn: https://www.llinkedin.com/company/92955550
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
alphaparkinc/genpark-agent-chaos-injection-and-resilience-evaluator-skill
Injects synthetic latency, truncated responses, and HTTP error faults to evaluate autonomous agent self-healing resilience | GenPark: https://www.genpark.ai | LinkedIn: https://www.llinkedin.com/company/92955550
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00