Research platform for model training, evaluation, and experimentation across architectures, benchmarks, and recipes.
GitHub repository with 23 stars and 3 forks.
Language: Python
Topics: benchmarking, causal-lm, ddp, deep-learning, distributed-training, dpo, evaluation, experimentation, finetuning, fsdp
2026-06-05: 23 stars and 3 forks.
Write scalable load tests in plain Python 🚗💨
GitHub repository with 27,847 stars and 3,214 forks.
Trending score: 0.76; stars gained: +5; forks gained: +1.
Language: Python
Topics: locust, python, load-testing, performance-testing, http, benchmarking
ML Performance and Extrapolation Guide
GitHub repository with 41 stars and 45 forks.
Trending score: 0.50; stars gained: +1; forks gained: +0.
Language: Python
Topics: machine-learning-interatomic-potentials, mlips, validation, benchmarking, machine-learning, ai-for-science
Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.
GitHub repository with 9 stars and 2 forks.
Trending score: 0.33; stars gained: +1; forks gained: +0.
Language: Python
Topics: benchmarking, cuda, fastapi, gguf, llama-cpp, llm
Production-grade LLM Evaluation & Benchmarking Framework — GPT-4, Claude, Gemini, Mistral. Accuracy, latency, cost, hallucination, reasoning metrics.
GitHub repository with 12 stars and 0 forks.
Trending score: 0.28; stars gained: +1; forks gained: +0.
Language: Python
Topics: accuracy, ai, benchmarking, claude, fastapi, gemini
Make AI work for Everyone - Monitoring and governing for your AI/ML
GitHub repository with 82 stars and 10 forks.
Trending score: 0.24; stars gained: +0; forks gained: +0.
Language: Python
Topics: benchmarking, evaluation, genai, guardrails, llm, ml
Streamlit + Python pipeline that benchmarks gym workout efficiency (kcal/min) using present sessions only. Generates sortable workout-type benchmarks, distribution plots, fairness-aware gap analysis with uncertainty/low-sample flags, and a data-quality report to prevent misleading comparisons.
GitHub repository with 11 stars and 0 forks.
Trending score: 0.05; stars gained: +0; forks gained: +0.
Language: Python
Topics: analytics, benchmarking, bias-audit, dashboard, data-analysis, data-quality
The agent that grows with you
GitHub repository with 181,960 stars and 31,220 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 13,768 stars and 870 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, compression, context-engineering, context-window
Academic Research Skills for Claude Code: research → write → review → revise → finalize
GitHub repository with 27,548 stars and 2,267 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
Learn it. Build it. Ship it for others.
GitHub repository with 28,622 stars and 4,680 forks.
Trending score: 5.32; stars gained: +1,261; forks gained: +238.
Language: Python
Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course
GitHub repository with 30,060 stars and 4,235 forks.
Trending score: 4.88; stars gained: +688; forks gained: +114.
Language: Python
An opinionated list of Python frameworks, libraries, tools, and resources
GitHub repository with 301,396 stars and 28,042 forks.
Trending score: 4.60; stars gained: +518; forks gained: +24.
Language: Python
Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools
Write scalable load tests in plain Python 🚗💨
GitHub repository with 27,847 stars and 3,214 forks.
Trending score: 0.76; stars gained: +5; forks gained: +1.
Language: Python
Topics: locust, python, load-testing, performance-testing, http, benchmarking
Powerful .NET library for benchmarking
GitHub repository with 11,421 stars and 1,050 forks.
Trending score: 0.60; stars gained: +1; forks gained: +0.
Language: C#
Topics: benchmark, benchmarking, c-sharp, dotnet, performance, csharp
ML Performance and Extrapolation Guide
GitHub repository with 41 stars and 45 forks.
Trending score: 0.50; stars gained: +1; forks gained: +0.
Language: Python
Topics: machine-learning-interatomic-potentials, mlips, validation, benchmarking, machine-learning, ai-for-science
Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.
GitHub repository with 9 stars and 2 forks.
Trending score: 0.33; stars gained: +1; forks gained: +0.
Language: Python
Topics: benchmarking, cuda, fastapi, gguf, llama-cpp, llm
Is your project as good as the best out there? sota-scan benchmarks your repo against real top projects and hands you a scorecard + to-do list. A Claude Code skill.
GitHub repository with 34 stars and 4 forks.
Trending score: 0.31; stars gained: +1; forks gained: +0.
Language: JavaScript
Topics: ai-agents, anthropic, benchmarking, claude-code, code-quality, competitive-analysis
Production-grade LLM Evaluation & Benchmarking Framework — GPT-4, Claude, Gemini, Mistral. Accuracy, latency, cost, hallucination, reasoning metrics.
GitHub repository with 12 stars and 0 forks.
Trending score: 0.28; stars gained: +1; forks gained: +0.
Language: Python
Topics: accuracy, ai, benchmarking, claude, fastapi, gemini