microsoft/SWE-bench-Live

[NeurIPS 2025 D&B] ๐Ÿš€ SWE-bench Goes Live!

GitHub repository with 193 stars and 26 forks.

Language: Python

Topics: benchmark, llm, swe

Open provider repository

Latest metric snapshot

2026-06-05: 193 stars and 26 forks.

Similar repositories

  1. 1. VibeBench/VibeSearchBench

    ๐Ÿ” The hardest search benchmark in the wild โ€” vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.

    GitHub repository with 780 stars and 9 forks.

    Trending score: 1.88; stars gained: +102; forks gained: +0.

    Language: Python

    Topics: agentic-ai, benchmark, llm, proactive-agent, search, search-agent

  2. 2. hogeheer499-commits/strix-halo-guide

    AMD Strix Halo local LLM guide: direct 100.0 t/s 30B Qwen MoE on Ryzen AI MAX+ 395 / Radeon 8060S. Setup, benchmarks, raw evidence.

    GitHub repository with 91 stars and 4 forks.

    Trending score: 0.98; stars gained: +7; forks gained: +0.

    Language: Python

    Topics: amd, benchmark, gfx1151, inference, llama-cpp, llm

  3. 3. sierra-research/tau2-bench

    ฯ„-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

    GitHub repository with 1,273 stars and 328 forks.

    Trending score: 0.92; stars gained: +7; forks gained: +1.

    Language: Python

    Topics: benchmark, llm, ai, language-model-agent, conversational-agents

  4. 4. open-compass/opencompass

    OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

    GitHub repository with 7,061 stars and 784 forks.

    Trending score: 0.91; stars gained: +4; forks gained: +1.

    Language: Python

    Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2

  5. 5. embeddings-benchmark/mteb

    MTEB: Massive Text Embedding Benchmark

    GitHub repository with 3,290 stars and 618 forks.

    Trending score: 0.84; stars gained: +4; forks gained: +1.

    Language: Python

    Topics: benchmark, clustering, information-retrieval, sentence-transformers, sts, text-embedding

  6. 6. Ropedia/SpatialBench

    SpatialBench: Is Your Spatial Foundation Model an All-Round Player?

    GitHub repository with 93 stars and 0 forks.

    Trending score: 0.74; stars gained: +5; forks gained: +0.

    Language: Python

    Topics: 3d-reconstruction, spatial-foundation-model, benchmark

Trending in Python

  1. 1. NousResearch/hermes-agent

    The agent that grows with you

    GitHub repository with 181,855 stars and 31,199 forks.

    Trending score: 5.95; stars gained: +1,867; forks gained: +361.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude

  2. 2. chopratejas/headroom

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

    GitHub repository with 13,768 stars and 870 forks.

    Trending score: 5.69; stars gained: +2,829; forks gained: +175.

    Language: Python

    Topics: agent, ai, anthropic, compression, context-engineering, context-window

  3. 3. Imbad0202/academic-research-skills

    Academic Research Skills for Claude Code: research โ†’ write โ†’ review โ†’ revise โ†’ finalize

    GitHub repository with 27,484 stars and 2,256 forks.

    Trending score: 5.52; stars gained: +1,079; forks gained: +89.

    Language: Python

    Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review

  4. 4. rohitg00/ai-engineering-from-scratch

    Learn it. Build it. Ship it for others.

    GitHub repository with 28,622 stars and 4,680 forks.

    Trending score: 5.32; stars gained: +1,261; forks gained: +238.

    Language: Python

    Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course

  5. 5. anthropics/financial-services

    GitHub repository with 30,029 stars and 4,231 forks.

    Trending score: 4.88; stars gained: +688; forks gained: +114.

    Language: Python

  6. 6. vinta/awesome-python

    An opinionated list of Python frameworks, libraries, tools, and resources

    GitHub repository with 301,396 stars and 28,042 forks.

    Trending score: 4.60; stars gained: +518; forks gained: +24.

    Language: Python

    Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools

Trending topic: benchmark

  1. 1. Purewhiter/mobilegym

    MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research ยท ๆต่งˆๅ™จ้‡Œ่ฟ่กŒ็š„ๅฎ‰ๅ“ๆจกๆ‹Ÿๅ™จ ยท Browser-hosted Android Simulator ยท Verifiable Evaluation ยท Scalable Online RL Training

    GitHub repository with 520 stars and 82 forks.

    Trending score: 3.00; stars gained: +33; forks gained: +4.

    Language: TypeScript

    Topics: agent, agents, ai, android, automation, benchmark

  2. 2. VibeBench/VibeSearchBench

    ๐Ÿ” The hardest search benchmark in the wild โ€” vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.

    GitHub repository with 780 stars and 9 forks.

    Trending score: 1.88; stars gained: +102; forks gained: +0.

    Language: Python

    Topics: agentic-ai, benchmark, llm, proactive-agent, search, search-agent

  3. 3. Ammaar-Alam/minebench

    Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)

    GitHub repository with 245 stars and 17 forks.

    Trending score: 1.14; stars gained: +13; forks gained: +0.

    Language: TypeScript

    Topics: ai, benchmark, llm, nlp, voxel, comparison-benchmarks

  4. 4. hogeheer499-commits/strix-halo-guide

    AMD Strix Halo local LLM guide: direct 100.0 t/s 30B Qwen MoE on Ryzen AI MAX+ 395 / Radeon 8060S. Setup, benchmarks, raw evidence.

    GitHub repository with 91 stars and 4 forks.

    Trending score: 0.98; stars gained: +7; forks gained: +0.

    Language: Python

    Topics: amd, benchmark, gfx1151, inference, llama-cpp, llm

  5. 5. sierra-research/tau2-bench

    ฯ„-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

    GitHub repository with 1,273 stars and 328 forks.

    Trending score: 0.92; stars gained: +7; forks gained: +1.

    Language: Python

    Topics: benchmark, llm, ai, language-model-agent, conversational-agents

  6. 6. open-compass/opencompass

    OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

    GitHub repository with 7,061 stars and 784 forks.

    Trending score: 0.91; stars gained: +4; forks gained: +1.

    Language: Python

    Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2