model-evaluation repositories
Trending repositories tagged model-evaluation, ranked by trending score. Updated daily.
-
1
future-agi/future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
GitHub · Python · 2,288 stars · 725 forks · +2 stars in 24 hours · Trending score 1.55
-
2
Blackwellboy/model-serving-minefield
Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each.
GitHub · Python · 177 stars · 19 forks · 0 stars in 24 hours · Trending score 1.02
-
3
ml4t/diagnostic
Signal diagnostics, statistical validation, and backtest evaluation for quantitative trading workflows.
GitHub · Python · 50 stars · 25 forks · +2 stars in 24 hours · Trending score 0.81
-
4
Andreas698/glm-5.3-uncensored
GLM 5.3 Uncensored — 35 jailbreak prompt files, model guide and API access. One RouterHub key also covers GPT, Claude, DeepSeek, Qwen and Grok.
GitHub · Python · 51 stars · 13 forks · +1 stars in 24 hours · Trending score 0.53
-
5
ruvnet/ruv-FANN
Neural networks and weight-space programming in Rust, JavaScript and WebAssembly. Inspect activations, edit weights, evaluate candidates, train small models, and explicitly promote or roll back revisions.
GitHub · Rust · 394 stars · 109 forks · 0 stars in 24 hours · Trending score 0.50
-
6
kevinoshaughnessy/subversionbench
Agentic evaluation of misalignment, scheming and evaluation awareness in LLM agents. Scenario text encoded at rest to resist training-data contamination.
GitHub · Python · 6 stars · 0 forks · +1 stars in 24 hours · Trending score 0.42
-
7
ulyssestenn/omt
Ollama Model Test - Figure out the best model for the task
GitHub · Python · 50 stars · 1 forks · 0 stars in 24 hours · Trending score 0.30
-
8
Folkbench/folkbench
AI API 中转站推荐与评测:中转站排行榜、中转站检测、Claude / GPT / Gemini 中转站对比 · AI API relay rankings · Folkbench Switch for Claude Code, Codex & Gemini CLI
GitHub · TypeScript · 3,131 stars · 20 forks · −745 stars in 24 hours · Trending score 0.18
-
9
Anil-matcha/awesome-abliterated-llms
Developer guide to deployed abliterated LLM endpoints on Muapi, with model comparisons and API examples.
GitHub · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.17
-
10
Burakkylmz/ml-labs
A hands-on Machine Learning laboratory built with Python, Scikit-learn, Pandas, NumPy, JupyterLab, Docker, and uv. Features reproducible, step-by-step labs covering data analysis, statistics, EDA, preprocessing, model training, evaluation, and forecasting.
GitHub · Jupyter Notebook · 14 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09
-
11
Claire1217/benchmark-radar
Track newly released AI benchmarks and their real-world adoption momentum.
GitHub · HTML · 11 stars · 0 forks · −1 stars in 24 hours · Trending score 0.09
-
12
npstorey/civic-ai-tools
Open-source platform connecting AI assistants to government open data — MCP server, curated civic MCP directory, and anti-hallucination framework for all 559 Socrata portals
GitHub · TypeScript · 48 stars · 18 forks · 0 stars in 24 hours · Trending score 0.09
-
13
fstandhartinger/model-market-comparison
Benchmark Heaven: AI model benchmarks with sources and modeled costs, plus the JevBench and ImageJevBench decision model leaderboards.
GitHub · HTML · 23 stars · 6 forks · 0 stars in 24 hours · Trending score 0.08
-
14
saccofrancesco/deepshot
AI-powered NBA game outcome predictor that uses advanced team stats and trend-based features to forecast winners and track model performance
GitHub · Jupyter Notebook · 175 stars · 22 forks · 0 stars in 24 hours · Trending score 0.08
-
15
samsarone/samsar
Full-stack Generative Video Cloud
GitHub · JavaScript · 58 stars · 10 forks · 0 stars in 24 hours · Trending score 0.08
-
16
routerhubSI/glm-5.3-abliterated
GLM 5.3 abliterated or uncensored API access with RouterHub. Browse 35 jailbreak prompt links, compare GLM models, and find SDK examples, coding-tool setup, pricing, and evaluation guides.
GitHub · Python · 181 stars · 38 forks · −168 stars in 24 hours · Trending score 0.06
-
17
umstek/zero-shot-ie-bench
60 zero-shot information-extraction & classification systems (57 benchmarked) across 32 families — extractor encoders, zero-shot classifiers, cross-encoder rerankers, typed-decision engines — local, Ollaya-served & hosted (OpenRouter, Cloudflare, TypeSafe); measured accuracy/latency/cost benchmarks, 9-language suite, web UI
GitHub · Python · 8 stars · 2 forks · 0 stars in 24 hours · Trending score 0.04
-
18
Guillain-RDCDE/FLAC_Detective
Catches fake hi-fi: music sold as lossless that was secretly compressed. It only says so when the proof is overwhelming.
GitHub · Python · 25 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
19
billyrdavis1985-bot/hf-critic
Fine-tuning open-source LLMs into reasoning-process critics — QLoRA, held-out eval, controlled cross-model comparison. Part of the IRMB program.
GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
suncityldp/zx-bench
A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.
GitHub · TypeScript · 158 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00
-
21
AdArya125/Primer-to-Machine-Learning
'Primer to Machine Learning' is a comprehensive guide covering essential topics in machine learning, including statistics, data preprocessing, supervised and unsupervised learning, neural networks, deep learning, NLP, time series analysis, and reinforcement learning. Perfect for beginners and intermediates.
GitHub · Jupyter Notebook · 42 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00
-
22
To3akaRin/VLMForge
Evaluate visual models on your own images, JSON Schema, and production constraints with LangGraph, Pareto analysis, and a no-key Replay demo.
GitHub · Python · 101 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
23
Brainchip-Inc/brainchip_devhub
Code and tutorials for training and deploying models on Akida
GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
24
LalaGa-1119/jiazuo-atelier
甲作 Atelier:手机端 AI 美甲推荐与虚拟试戴;仓库公开其中的轻量评测工作台。
GitHub · TypeScript · 22 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00