rag-evaluation repositories
Trending repositories tagged rag-evaluation, ranked by trending score. Updated daily.
-
1
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
GitHub · Python · 5,965 stars · 577 forks · +15 stars in 24 hours · Trending score 2.20
-
2
future-agi/future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
GitHub · Python · 2,285 stars · 725 forks · +4 stars in 24 hours · Trending score 1.78
-
3
dolev31/lasagna
Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.
GitHub · Python · 37 stars · 14 forks · +1 stars in 24 hours · Trending score 0.72
-
4
ggozad/haiku.rag
Agentic RAG for local and self-hosted document search: hybrid retrieval, reranking and multimodal RAG on embedded LanceDB, with Docling parsing and an MCP server
GitHub · Python · 659 stars · 60 forks · 0 stars in 24 hours · Trending score 0.42
-
5
OpenAgentHQ/openagent-eval
Local-first evaluation framework for RAG systems and AI Agents. 18+ metrics, CLI + SDK, framework-agnostic. The pytest of AI evaluation.
GitHub · Python · 16 stars · 32 forks · 0 stars in 24 hours · Trending score 0.32
-
6
tonydzi/verbatim-citation-gate
Catch fabricated RAG citations before they reach the user: a zero-token verbatim gate + a burden-of-proof judge, framework-agnostic.
GitHub · Python · 6 stars · 4 forks · 0 stars in 24 hours · Trending score 0.10
-
7
lizhiyao/oh-my-knowledge
OMK helps people and agents build, maintain, and reuse valuable knowledge from real work and collaboration, with readable content, traceable sources, and revision history for future tasks.
GitHub · TypeScript · 25 stars · 5 forks · 0 stars in 24 hours · Trending score 0.08
-
8
HosseinHeydari2004/RAG-Tutorial-From-Zero-to-Advanced
A repository that teaches Rag concepts from scratch with coding.
GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
9
techtheist/knowledgedrift
KnowledgeDrift - Second Generation AI Memory benchmark
GitHub · Rust · 17 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07
-
10
dokimos-dev/dokimos
LLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.
GitHub · Java · 61 stars · 5 forks · 0 stars in 24 hours · Trending score 0.04
-
11
SasanLabs/LLMForge
LLMForge is probably the most modern AI vulnerability lab for OWASP VulnerableApp — real-LLM-backed labs for prompt injection, LLM-orchestrated BOLA, and RAG attacks.
GitHub · Python · 15 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00
-
12
vectara/open-rag-eval
RAG evaluation without the need for "golden answers"
GitHub · Python · 420 stars · 30 forks · 0 stars in 24 hours · Trending score 0.00
-
13
skygazer42/MimirQ
中文优先的企业 RAG 知识库:可控解析、治理、切块、混合检索、重排、引用、图谱、评测与 Dify 接入。
GitHub · Python · 592 stars · 103 forks · 0 stars in 24 hours · Trending score 0.00
-
14
neskuchny/Tessbrain
The company brain: it remembers, thinks, and does the work. Meetings become a typed graph with sources — it answers with citations, spots divergence on its own, and returns reports, automations and specs for AI executors.
GitHub · Python · 8 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00
-
15
w93139/rag-eval-workflow
A framework-neutral RAG evaluation skill with golden sets, regression gates, and script-domain checks.
GitHub · Python · 10 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
16
TrustifAI/typed_evals
Fast, typed Python framework for Jev-as-a-Judge/Decision-model evaluation for LLMs, RAG, and AI agents along with human-label calibration.
GitHub · Python · 16 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
17
alphaparkinc/genpark-context-precision-recall-rag-metric-skill
RAG context precision and context recall evaluator measuring retrieved chunk relevance and rank quality
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
18
alphaparkinc/genpark-hallucination-factual-grounding-checker-skill
Factual grounding and citation overlap verifier measuring claim support against retrieved passages
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
19
sgyaqing/RAG-BenchLab
Build RAG evaluation testsets from documents and benchmark RAG systems.
GitHub · Python · 16 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
JEen-wang/Adaptive-rag
按问题复杂度自动分流的电商客服 RAG:简单问题直接回答;复杂问题经过多跳检索并自我纠错;查单、退改通过工具调用完成,且高风险写操作必须先经人工确认。基于 FastAPI 和 LangGraph,混合检索并附带引用,内置离线评测与 Prometheus 指标。涵盖简历写法和项目面试拷打
GitHub · Python · 186 stars · 21 forks · 0 stars in 24 hours · Trending score 0.00