llm-benchmark repositories
Trending repositories tagged llm-benchmark, ranked by trending score. Updated daily.
-
1
jackson-cmd/risk-aware-trading-agents
AI trading agents for US stocks with news backtesting that can't see the future: a public LLM trading agent leaderboard (rta-bench-1), frozen point-in-time 2020/2022/2026 markets (prices, VIX, news), a look-ahead check on every run, LLM agents over MCP, and paper/live trading on 10 brokers. 风险感知美股交易智能体 · 新闻回测 · LLM 榜单
GitHub · Python · 349 stars · 80 forks · +101 stars in 24 hours · Trending score 3.90
-
2
molly554/whiteboard-ai-tutor
Open-source whiteboard AI tutor with animated lessons and interactive playback. Compare Claude, Gemini & DeepSeek across 288 generation runs and 64 blind-reviewed boards.
GitHub · HTML · 472 stars · 21 forks · +95 stars in 24 hours · Trending score 3.72
-
3
TIGER-AI-Lab/WebsiteBench
Can AI agents rebuild websites through browser exploration?
GitHub · Python · 575 stars · 49 forks · +32 stars in 24 hours · Trending score 3.12
-
4
theNetworkChuck/mac-studio-m5-ultra-local-ai
M5 Ultra vs M3 Ultra Mac Studio at local AI: every test, run, result and explanation (dense vs MoE, why reading got ~4x and writing ~1.5x). Raw data + the harness to rerun it.
GitHub · TypeScript · 13 stars · 4 forks · +5 stars in 24 hours · Trending score 1.30
-
5
Wendystar0628/AI-High-Pressure-Challenge
AI十项全能·定时挑战赛 | AI Decathlon · Timed Challenge: a timed benchmark for AI coding agents — 13 tasks across 10 categories (Lean proofs, competition math, CUDA/CPU optimization, game AI, 3D/web apps, nested OS), 60–100 min each, no human help.
GitHub · JavaScript · 75 stars · 5 forks · +13 stars in 24 hours · Trending score 1.29
-
6
phuryn/bug-hunt-bench
Bug Hunt Bench: 105 real bugs in two production repos, frontier coding models (GPT-6, Claude, Grok, Gemini, DeepSeek...) find and fix them in their own CLI, graded blind. Live leaderboard + every receipt.
GitHub · JavaScript · 219 stars · 10 forks · +1 stars in 24 hours · Trending score 1.25
-
7
HowieHwong/TrustLLM
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
GitHub · Python · 636 stars · 70 forks · +3 stars in 24 hours · Trending score 1.06
-
8
eomcaleb/weight-space-bench
Benchmark: can an LLM make a language model better at math by editing its weights directly? (Qwen3.5-0.8B, MATH-500/GSM8K, via OpenRouter)
GitHub · Python · 18 stars · 2 forks · +1 stars in 24 hours · Trending score 0.73
-
9
DaveEuson/RigMatch
Speed dating for local AI models: find the best one your PC can actually run. Tests Ollama models on your own hardware.
GitHub · TypeScript · 8 stars · 0 forks · +1 stars in 24 hours · Trending score 0.55
-
10
duckxy166/among-us-ai
Among Us for AI: Claude, GPT, Gemini, DeepSeek, Kimi and Grok play a social deduction game against each other, each with its own memory and secret thoughts. LLM arena by Duckxy.
GitHub · JavaScript · 17 stars · 2 forks · 0 stars in 24 hours · Trending score 0.48
-
11
blackwell-systems/gcf
The AI-native wire format for structured data. 100% comprehension on every frontier model. 50-92% fewer tokens than JSON. 43B+ lossless round-trips across 17 formats. Spec v3.5.1 Stable.
GitHub · 63 stars · 3 forks · 0 stars in 24 hours · Trending score 0.32
-
12
edujbarrios/trainlens
TrainLens turns training runs into evidence: what changed, what went wrong, and what experiment to run next.
GitHub · Python · 23 stars · 0 forks · 0 stars in 24 hours · Trending score 0.30
-
13
Folkbench/folkbench
AI API 中转站推荐与评测:中转站排行榜、中转站检测、Claude / GPT / Gemini 中转站对比 · AI API relay rankings · Folkbench Switch for Claude Code, Codex & Gemini CLI
GitHub · TypeScript · 3,239 stars · 20 forks · −845 stars in 24 hours · Trending score 0.24
-
14
gpustack/benchmark-runner
Benchmark OpenAI-compatible LLM servers: find throughput peaks and latency SLO capacity, with terminal charts.
GitHub · Python · 6 stars · 4 forks · 0 stars in 24 hours · Trending score 0.18
-
15
john-walks-slow/token-speed-patrol
基于 GitHub Actions 的 LLM 测速看板,含 OpenRouter, Nvidia NIM, OpenCode 等免费模型实时测速数据
GitHub · Python · 11 stars · 3 forks · 0 stars in 24 hours · Trending score 0.10
-
16
logxio/picchio
Catch local LLMs spilling into the CPU. One run shows GPU placement, prefill, decode, memory, power and a verdict.
GitHub · Python · 17 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09
-
17
Claire1217/benchmark-radar
Track newly released AI benchmarks and their real-world adoption momentum.
GitHub · HTML · 11 stars · 0 forks · −1 stars in 24 hours · Trending score 0.09
-
18
alexshpunt/explicit-edit-benchmark
Benchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.
GitHub · JavaScript · 38 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09
-
19
Moloch-AI/llm-api-benchmark
Open-source LLM API benchmark for measuring inference latency, TTFT, tokens/sec, throughput, reliability and cost across OpenAI-compatible endpoints.
GitHub · Python · 17 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
20
MSKazemi/aobench
Role-aware, permission-enforced benchmark for LLM agents that operate HPC systems — SLURM, telemetry, RBAC, docs, facility. A policy violation hard-fails the task. 88 tasks (10 categories x 5 roles), 29 reproducible environments with 6 rebuilt from real Marconi100 ExaData, scored on 7 weighted dimensions.
GitHub · Python · 9 stars · 14 forks · −2 stars in 24 hours · Trending score 0.08
-
21
thetahealth/mirobody-env
HAEnv — synthetic longitudinal patients with code-derived gold, for evaluating health agents over time
GitHub · Python · 224 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08
-
22
yyh-001/llm-value-rankings
Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜
GitHub · CSS · 30 stars · 4 forks · 0 stars in 24 hours · Trending score 0.04
-
23
facebookresearch/swe-sweep
How many bugs can LMs find & fix in large codebases?
GitHub · Python · 230 stars · 28 forks · 0 stars in 24 hours · Trending score 0.04
-
24
ARTPARK-SAHAI-ORG/calibrate
Core engine behind Calibrate, a framework for evaluating AI agents: speech-to-text, text-to-speech, LLM evaluation, end-to-end simulations
GitHub · JavaScript · 24 stars · 7 forks · 0 stars in 24 hours · Trending score 0.04