open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

GitHub repository with 7,061 stars and 784 forks.

Language: Python

Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2, openai, llama3

Open provider repository

24h trend summary

Trending score 0.91, activity score 1.50, stars gained +4, forks gained +1.

Latest metric snapshot

2026-06-05: 7,061 stars and 784 forks.

Similar repositories

  1. 1. BlazeUp-AI/Observal

    Observal is a unified platform for agent distribution, observability and insights.

    GitHub repository with 2,001 stars and 379 forks.

    Trending score: 4.07; stars gained: +119; forks gained: +63.

    Language: Python

    Topics: cli-tool, evaluation, large-language-models, llm, llm-evaluation, llm-observability

  2. 2. mlflow/mlflow

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

    GitHub repository with 26,312 stars and 5,812 forks.

    Trending score: 3.17; stars gained: +43; forks gained: +7.

    Language: Python

    Topics: agentops, agents, ai, ai-governance, apache-spark, evaluation

  3. 3. NVIDIA-NeMo/Gym

    Evaluate and improve models and agents using environments

    GitHub repository with 960 stars and 170 forks.

    Trending score: 2.41; stars gained: +16; forks gained: +5.

    Language: Python

    Topics: reinforcement-learning, reinforcement-learning-environments, rl-environment, rl-training, gym, agents

  4. 4. comet-ml/opik

    Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    GitHub repository with 19,434 stars and 1,496 forks.

    Trending score: 2.37; stars gained: +10; forks gained: +1.

    Language: Python

    Topics: evaluation, hacktoberfest, hacktoberfest2025, langchain, llama-index, llm

  5. 5. open-compass/opencompass

    OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

    GitHub repository with 7,061 stars and 784 forks.

    Trending score: 0.91; stars gained: +4; forks gained: +1.

    Language: Python

    Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2

  6. 6. crimeacs/auto-improve

    GAN-style self-improvement loop for any text artifact: mutate, grade with a SEPARATE model, keep only verified wins (pairwise-judged), revert the rest. The git history is the improvement log.

    GitHub repository with 18 stars and 1 forks.

    Trending score: 0.48; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: ai-agents, developer-tools, evaluation, gan, gemini, generative-ai

Trending in Python

  1. 1. NousResearch/hermes-agent

    The agent that grows with you

    GitHub repository with 181,960 stars and 31,220 forks.

    Trending score: 5.95; stars gained: +1,867; forks gained: +361.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude

  2. 2. chopratejas/headroom

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

    GitHub repository with 13,768 stars and 870 forks.

    Trending score: 5.69; stars gained: +2,829; forks gained: +175.

    Language: Python

    Topics: agent, ai, anthropic, compression, context-engineering, context-window

  3. 3. Imbad0202/academic-research-skills

    Academic Research Skills for Claude Code: research → write → review → revise → finalize

    GitHub repository with 27,548 stars and 2,267 forks.

    Trending score: 5.52; stars gained: +1,079; forks gained: +89.

    Language: Python

    Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review

  4. 4. rohitg00/ai-engineering-from-scratch

    Learn it. Build it. Ship it for others.

    GitHub repository with 28,622 stars and 4,680 forks.

    Trending score: 5.32; stars gained: +1,261; forks gained: +238.

    Language: Python

    Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course

  5. 5. anthropics/financial-services

    GitHub repository with 30,060 stars and 4,235 forks.

    Trending score: 4.88; stars gained: +688; forks gained: +114.

    Language: Python

  6. 6. vinta/awesome-python

    An opinionated list of Python frameworks, libraries, tools, and resources

    GitHub repository with 301,396 stars and 28,042 forks.

    Trending score: 4.60; stars gained: +518; forks gained: +24.

    Language: Python

    Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools

Trending topic: evaluation

  1. 1. BlazeUp-AI/Observal

    Observal is a unified platform for agent distribution, observability and insights.

    GitHub repository with 2,001 stars and 379 forks.

    Trending score: 4.07; stars gained: +119; forks gained: +63.

    Language: Python

    Topics: cli-tool, evaluation, large-language-models, llm, llm-evaluation, llm-observability

  2. 2. mlflow/mlflow

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

    GitHub repository with 26,312 stars and 5,812 forks.

    Trending score: 3.17; stars gained: +43; forks gained: +7.

    Language: Python

    Topics: agentops, agents, ai, ai-governance, apache-spark, evaluation

  3. 3. NVIDIA-NeMo/Gym

    Evaluate and improve models and agents using environments

    GitHub repository with 960 stars and 170 forks.

    Trending score: 2.41; stars gained: +16; forks gained: +5.

    Language: Python

    Topics: reinforcement-learning, reinforcement-learning-environments, rl-environment, rl-training, gym, agents

  4. 4. comet-ml/opik

    Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    GitHub repository with 19,434 stars and 1,496 forks.

    Trending score: 2.37; stars gained: +10; forks gained: +1.

    Language: Python

    Topics: evaluation, hacktoberfest, hacktoberfest2025, langchain, llama-index, llm

  5. 5. langwatch/langwatch

    The platform for LLM evaluations and AI agent testing

    GitHub repository with 3,288 stars and 320 forks.

    Trending score: 2.05; stars gained: +6; forks gained: +0.

    Language: TypeScript

    Topics: ai, analytics, datasets, dspy, evaluation, gpt

  6. 6. open-compass/opencompass

    OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

    GitHub repository with 7,061 stars and 784 forks.

    Trending score: 0.91; stars gained: +4; forks gained: +1.

    Language: Python

    Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2