llms-benchmarking repositories

Trending repositories tagged llms-benchmarking, ranked by trending score. Updated daily.

  1. 1
    Portkey-AI/models

    This repository contains comprehensive pricing and configuration data for LLMs. It powers cost attribution for 200+ enterprises running 400B+ tokens through Portkey AI Gateway every day.

    GitHub · JavaScript · 147 stars · 63 forks · 0 stars in 24 hours · Trending score 0.39

  2. 2
    lechmazur/nyt-connections

    Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words

    GitHub · Python · 250 stars · 9 forks · 0 stars in 24 hours · Trending score 0.03

  3. 3
    steel-dev/awesome-web-agents

    🔥 A list of tools, frameworks, and resources for building AI web agents

    GitHub · Python · 1,606 stars · 288 forks · 0 stars in 24 hours · Trending score 0.03

  4. 4
    Pro-GenAI/iRAT

    🔄 Replanning and Controlled Retrieval for Robust LLM Reasoning

    GitHub · Jupyter Notebook · 5 stars · 1 forks · −2 stars in 24 hours · Trending score 0.01

  5. 5
    eth-sri/constrained-diffusion

    Constrained Decoding of Diffusion LLMs with Context-Free Grammars.

    GitHub · Rust · 61 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00