Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
GitHub repository with 19,435 stars and 1,496 forks.
Language: Python
Topics: evaluation, hacktoberfest, hacktoberfest2025, langchain, llama-index, llm, llm-evaluation, llm-observability, llmops, open-source
Trending score 2.37, activity score 3.28, stars gained +10, forks gained +1.
2026-06-05: 19,435 stars and 1,496 forks.
Observal is a unified platform for agent distribution, observability and insights.
GitHub repository with 1,997 stars and 376 forks.
Trending score: 4.07; stars gained: +119; forks gained: +63.
Language: Python
Topics: cli-tool, evaluation, large-language-models, llm, llm-evaluation, llm-observability
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
GitHub repository with 26,312 stars and 5,812 forks.
Trending score: 3.17; stars gained: +43; forks gained: +7.
Language: Python
Topics: agentops, agents, ai, ai-governance, apache-spark, evaluation
Evaluate and improve models and agents using environments
GitHub repository with 960 stars and 170 forks.
Trending score: 2.41; stars gained: +16; forks gained: +5.
Language: Python
Topics: reinforcement-learning, reinforcement-learning-environments, rl-environment, rl-training, gym, agents
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
GitHub repository with 19,435 stars and 1,496 forks.
Trending score: 2.37; stars gained: +10; forks gained: +1.
Language: Python
Topics: evaluation, hacktoberfest, hacktoberfest2025, langchain, llama-index, llm
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
GitHub repository with 7,061 stars and 784 forks.
Trending score: 0.91; stars gained: +4; forks gained: +1.
Language: Python
Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2
GAN-style self-improvement loop for any text artifact: mutate, grade with a SEPARATE model, keep only verified wins (pairwise-judged), revert the rest. The git history is the improvement log.
GitHub repository with 18 stars and 1 forks.
Trending score: 0.48; stars gained: +2; forks gained: +0.
Language: Python
Topics: ai-agents, developer-tools, evaluation, gan, gemini, generative-ai
The agent that grows with you
GitHub repository with 181,873 stars and 31,205 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 13,768 stars and 870 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, compression, context-engineering, context-window
Academic Research Skills for Claude Code: research → write → review → revise → finalize
GitHub repository with 27,484 stars and 2,256 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
Learn it. Build it. Ship it for others.
GitHub repository with 28,622 stars and 4,680 forks.
Trending score: 5.32; stars gained: +1,261; forks gained: +238.
Language: Python
Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course
GitHub repository with 30,029 stars and 4,231 forks.
Trending score: 4.88; stars gained: +688; forks gained: +114.
Language: Python
An opinionated list of Python frameworks, libraries, tools, and resources
GitHub repository with 301,396 stars and 28,042 forks.
Trending score: 4.60; stars gained: +518; forks gained: +24.
Language: Python
Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools
Observal is a unified platform for agent distribution, observability and insights.
GitHub repository with 1,997 stars and 376 forks.
Trending score: 4.07; stars gained: +119; forks gained: +63.
Language: Python
Topics: cli-tool, evaluation, large-language-models, llm, llm-evaluation, llm-observability
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
GitHub repository with 26,312 stars and 5,812 forks.
Trending score: 3.17; stars gained: +43; forks gained: +7.
Language: Python
Topics: agentops, agents, ai, ai-governance, apache-spark, evaluation
Evaluate and improve models and agents using environments
GitHub repository with 960 stars and 170 forks.
Trending score: 2.41; stars gained: +16; forks gained: +5.
Language: Python
Topics: reinforcement-learning, reinforcement-learning-environments, rl-environment, rl-training, gym, agents
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
GitHub repository with 19,435 stars and 1,496 forks.
Trending score: 2.37; stars gained: +10; forks gained: +1.
Language: Python
Topics: evaluation, hacktoberfest, hacktoberfest2025, langchain, llama-index, llm
The platform for LLM evaluations and AI agent testing
GitHub repository with 3,288 stars and 320 forks.
Trending score: 2.05; stars gained: +6; forks gained: +0.
Language: TypeScript
Topics: ai, analytics, datasets, evaluation, gpt, llm
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
GitHub repository with 7,061 stars and 784 forks.
Trending score: 0.91; stars gained: +4; forks gained: +1.
Language: Python
Topics: evaluation, benchmark, large-language-model, chatgpt, llm, llama2