A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
GitHub repository with 2,888 stars and 386 forks.
Language: Python
Topics: evaluation, llm, performance, rag, vlm
2026-06-05: 2,888 stars and 386 forks.
Observal is a unified platform for agent distribution, observability and insights.
GitHub repository with 1,994 stars and 374 forks.
Trending score: 4.07; stars gained: +119; forks gained: +63.
Language: Python
Topics: cli-tool, evaluation, large-language-models, llm, llm-evaluation, llm-observability
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
GitHub repository with 26,302 stars and 5,813 forks.
Trending score: 3.17; stars gained: +43; forks gained: +7.
Language: Python
Topics: agentops, agents, ai, ai-governance, apache-spark, evaluation
Evaluate and improve models and agents using environments
GitHub repository with 957 stars and 170 forks.
Trending score: 2.41; stars gained: +16; forks gained: +5.
Language: Python
Topics: agents, benchmarks, environments, evaluation, gym, llm
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
GitHub repository with 19,433 stars and 1,496 forks.
Trending score: 2.37; stars gained: +10; forks gained: +1.
Language: Python
Topics: open-source, langchain, openai, playground, prompt-engineering, llama-index
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
GitHub repository with 7,061 stars and 783 forks.
Trending score: 0.91; stars gained: +4; forks gained: +1.
Language: Python
Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2
LangSmith Client SDK Implementations
GitHub repository with 918 stars and 246 forks.
Trending score: 0.59; stars gained: +0; forks gained: +1.
Language: Python
Topics: evaluation, language-model, observability
The agent that grows with you
GitHub repository with 181,259 stars and 31,100 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 12,851 stars and 828 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, claude-code, compression, context-engineering
Academic Research Skills for Claude Code: research → write → review → revise → finalize
GitHub repository with 27,320 stars and 2,248 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
GitHub repository with 140,059 stars and 20,110 forks.
Trending score: 5.04; stars gained: +317; forks gained: +58.
Language: Python
Topics: ollama, ollama-webui, llm, webui, self-hosted, llm-ui
LLM驱动的 A/H/美股智能分析：多数据源行情 + 实时新闻 + LLM决策仪表盘 + 多渠道推送，零成本定时运行，纯白嫖. LLM-powered stock analysis system for A/H/US markets.
GitHub repository with 40,774 stars and 38,952 forks.
Trending score: 4.88; stars gained: +836; forks gained: +443.
Language: Python
Topics: a-stock, ai-agent, aigc, llm, quant, quantitative-finance
GitHub repository with 29,986 stars and 4,219 forks.
Trending score: 4.88; stars gained: +688; forks gained: +114.
Language: Python
Observal is a unified platform for agent distribution, observability and insights.
GitHub repository with 1,994 stars and 374 forks.
Trending score: 4.07; stars gained: +119; forks gained: +63.
Language: Python
Topics: cli-tool, evaluation, large-language-models, llm, llm-evaluation, llm-observability
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
GitHub repository with 26,302 stars and 5,813 forks.
Trending score: 3.17; stars gained: +43; forks gained: +7.
Language: Python
Topics: agentops, agents, ai, ai-governance, apache-spark, evaluation
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
GitHub repository with 21,893 stars and 1,937 forks.
Trending score: 3.11; stars gained: +73; forks gained: +12.
Language: TypeScript
Topics: ci, ci-cd, cicd, evaluation, evaluation-framework, llm
Evaluate and improve models and agents using environments
GitHub repository with 957 stars and 170 forks.
Trending score: 2.41; stars gained: +16; forks gained: +5.
Language: Python
Topics: agents, benchmarks, environments, evaluation, gym, llm
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
GitHub repository with 19,433 stars and 1,496 forks.
Trending score: 2.37; stars gained: +10; forks gained: +1.
Language: Python
Topics: open-source, langchain, openai, playground, prompt-engineering, llama-index
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
GitHub repository with 7,061 stars and 783 forks.
Trending score: 0.91; stars gained: +4; forks gained: +1.
Language: Python
Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2