llm-benchmark repositories

Trending repositories tagged llm-benchmark, ranked by trending score. Updated daily.

  1. 1
    jackson-cmd/risk-aware-trading-agents

    AI trading agents for US stocks with news backtesting that can't see the future: a public LLM trading agent leaderboard (rta-bench-1), frozen point-in-time 2020/2022/2026 markets (prices, VIX, news), a look-ahead check on every run, LLM agents over MCP, and paper/live trading on 10 brokers. 风险感知美股交易智能体 · 新闻回测 · LLM 榜单

    GitHub · Python · 349 stars · 80 forks · +101 stars in 24 hours · Trending score 3.90

  2. 2
    molly554/whiteboard-ai-tutor

    Open-source whiteboard AI tutor with animated lessons and interactive playback. Compare Claude, Gemini & DeepSeek across 288 generation runs and 64 blind-reviewed boards.

    GitHub · HTML · 472 stars · 21 forks · +95 stars in 24 hours · Trending score 3.72

  3. 3
    TIGER-AI-Lab/WebsiteBench

    Can AI agents rebuild websites through browser exploration?

    GitHub · Python · 575 stars · 49 forks · +32 stars in 24 hours · Trending score 3.12

  4. 4
    theNetworkChuck/mac-studio-m5-ultra-local-ai

    M5 Ultra vs M3 Ultra Mac Studio at local AI: every test, run, result and explanation (dense vs MoE, why reading got ~4x and writing ~1.5x). Raw data + the harness to rerun it.

    GitHub · TypeScript · 13 stars · 4 forks · +5 stars in 24 hours · Trending score 1.30

  5. 5
    Wendystar0628/AI-High-Pressure-Challenge

    AI十项全能·定时挑战赛 | AI Decathlon · Timed Challenge: a timed benchmark for AI coding agents — 13 tasks across 10 categories (Lean proofs, competition math, CUDA/CPU optimization, game AI, 3D/web apps, nested OS), 60–100 min each, no human help.

    GitHub · JavaScript · 75 stars · 5 forks · +13 stars in 24 hours · Trending score 1.29

  6. 6
    phuryn/bug-hunt-bench

    Bug Hunt Bench: 105 real bugs in two production repos, frontier coding models (GPT-6, Claude, Grok, Gemini, DeepSeek...) find and fix them in their own CLI, graded blind. Live leaderboard + every receipt.

    GitHub · JavaScript · 219 stars · 10 forks · +1 stars in 24 hours · Trending score 1.25

  7. 7
    HowieHwong/TrustLLM

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    GitHub · Python · 636 stars · 70 forks · +3 stars in 24 hours · Trending score 1.06

  8. 8
    eomcaleb/weight-space-bench

    Benchmark: can an LLM make a language model better at math by editing its weights directly? (Qwen3.5-0.8B, MATH-500/GSM8K, via OpenRouter)

    GitHub · Python · 18 stars · 2 forks · +1 stars in 24 hours · Trending score 0.73

  9. 9
    DaveEuson/RigMatch

    Speed dating for local AI models: find the best one your PC can actually run. Tests Ollama models on your own hardware.

    GitHub · TypeScript · 8 stars · 0 forks · +1 stars in 24 hours · Trending score 0.55

  10. 10
    duckxy166/among-us-ai

    Among Us for AI: Claude, GPT, Gemini, DeepSeek, Kimi and Grok play a social deduction game against each other, each with its own memory and secret thoughts. LLM arena by Duckxy.

    GitHub · JavaScript · 17 stars · 2 forks · 0 stars in 24 hours · Trending score 0.48

  11. 11
    blackwell-systems/gcf

    The AI-native wire format for structured data. 100% comprehension on every frontier model. 50-92% fewer tokens than JSON. 43B+ lossless round-trips across 17 formats. Spec v3.5.1 Stable.

    GitHub · 63 stars · 3 forks · 0 stars in 24 hours · Trending score 0.32

  12. 12
    edujbarrios/trainlens

    TrainLens turns training runs into evidence: what changed, what went wrong, and what experiment to run next.

    GitHub · Python · 23 stars · 0 forks · 0 stars in 24 hours · Trending score 0.30

  13. 13
    Folkbench/folkbench

    AI API 中转站推荐与评测:中转站排行榜、中转站检测、Claude / GPT / Gemini 中转站对比 · AI API relay rankings · Folkbench Switch for Claude Code, Codex & Gemini CLI

    GitHub · TypeScript · 3,239 stars · 20 forks · −845 stars in 24 hours · Trending score 0.24

  14. 14
    gpustack/benchmark-runner

    Benchmark OpenAI-compatible LLM servers: find throughput peaks and latency SLO capacity, with terminal charts.

    GitHub · Python · 6 stars · 4 forks · 0 stars in 24 hours · Trending score 0.18

  15. 15
    john-walks-slow/token-speed-patrol

    基于 GitHub Actions 的 LLM 测速看板,含 OpenRouter, Nvidia NIM, OpenCode 等免费模型实时测速数据

    GitHub · Python · 11 stars · 3 forks · 0 stars in 24 hours · Trending score 0.10

  16. 16
    logxio/picchio

    Catch local LLMs spilling into the CPU. One run shows GPU placement, prefill, decode, memory, power and a verdict.

    GitHub · Python · 17 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09

  17. 17
    Claire1217/benchmark-radar

    Track newly released AI benchmarks and their real-world adoption momentum.

    GitHub · HTML · 11 stars · 0 forks · −1 stars in 24 hours · Trending score 0.09

  18. 18
    alexshpunt/explicit-edit-benchmark

    Benchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.

    GitHub · JavaScript · 38 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09

  19. 19
    Moloch-AI/llm-api-benchmark

    Open-source LLM API benchmark for measuring inference latency, TTFT, tokens/sec, throughput, reliability and cost across OpenAI-compatible endpoints.

    GitHub · Python · 17 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  20. 20
    MSKazemi/aobench

    Role-aware, permission-enforced benchmark for LLM agents that operate HPC systems — SLURM, telemetry, RBAC, docs, facility. A policy violation hard-fails the task. 88 tasks (10 categories x 5 roles), 29 reproducible environments with 6 rebuilt from real Marconi100 ExaData, scored on 7 weighted dimensions.

    GitHub · Python · 9 stars · 14 forks · −2 stars in 24 hours · Trending score 0.08

  21. 21
    thetahealth/mirobody-env

    HAEnv — synthetic longitudinal patients with code-derived gold, for evaluating health agents over time

    GitHub · Python · 224 stars · 1 forks · 0 stars in 24 hours · Trending score 0.08

  22. 22
    yyh-001/llm-value-rankings

    Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

    GitHub · CSS · 30 stars · 4 forks · 0 stars in 24 hours · Trending score 0.04

  23. 23
    facebookresearch/swe-sweep

    How many bugs can LMs find & fix in large codebases?

    GitHub · Python · 230 stars · 28 forks · 0 stars in 24 hours · Trending score 0.04

  24. 24
    ARTPARK-SAHAI-ORG/calibrate

    Core engine behind Calibrate, a framework for evaluating AI agents: speech-to-text, text-to-speech, LLM evaluation, end-to-end simulations

    GitHub · JavaScript · 24 stars · 7 forks · 0 stars in 24 hours · Trending score 0.04