llm-benchmarking repositories

Trending repositories tagged llm-benchmarking, ranked by trending score. Updated daily.

  1. 1
    TIGER-AI-Lab/WebsiteBench

    Can AI agents rebuild websites through browser exploration?

    GitHub · Python · 644 stars · 49 forks · +57 stars in 24 hours · Trending score 3.33

  2. 2
    facebookresearch/swe-sweep

    How many bugs can LMs find & fix in large codebases?

    GitHub · Python · 247 stars · 31 forks · +17 stars in 24 hours · Trending score 2.11

  3. 3
    alopatenko/LLMEvaluation

    A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.

    GitHub · HTML · 208 stars · 35 forks · 0 stars in 24 hours · Trending score 0.49

  4. 4
    beyefendi/awesome-llm-security

    Agentic security, LLM security tools, research, and documents

    GitHub · 49 stars · 81 forks · 0 stars in 24 hours · Trending score 0.29

  5. 5
    forecastingresearch/forecastbench

    Forecastbench is a dynamic, contamination-free benchmark of LLM forecasting accuracy with human comparison groups, serving as a valuable proxy for general intelligence.

    GitHub · Python · 96 stars · 27 forks · 0 stars in 24 hours · Trending score 0.28

  6. 6
    Pro-GenAI/Agent-Action-Guard

    🛡️ Safe AI Agents through Action Classifier

    GitHub · Python · 7 stars · 8 forks · 0 stars in 24 hours · Trending score 0.09

  7. 7
    voice-from-the-outer-world/lisan-bench

    LisanBench is a lightweight benchmark for LLMs that stresses forward planning, vocabulary depth, constraint adherence, attention, and long-context "stamina" all at once.

    GitHub · Python · 68 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00