rag-evaluation repositories

Trending repositories tagged rag-evaluation, ranked by trending score. Updated daily.

  1. 1
    Giskard-AI/giskard-oss

    🐢 Open-Source Evaluation & Testing library for LLM Agents

    GitHub · Python · 5,965 stars · 577 forks · +15 stars in 24 hours · Trending score 2.20

  2. 2
    future-agi/future-agi

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    GitHub · Python · 2,285 stars · 725 forks · +4 stars in 24 hours · Trending score 1.78

  3. 3
    dolev31/lasagna

    Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.

    GitHub · Python · 37 stars · 14 forks · +1 stars in 24 hours · Trending score 0.72

  4. 4
    ggozad/haiku.rag

    Agentic RAG for local and self-hosted document search: hybrid retrieval, reranking and multimodal RAG on embedded LanceDB, with Docling parsing and an MCP server

    GitHub · Python · 659 stars · 60 forks · 0 stars in 24 hours · Trending score 0.42

  5. 5
    OpenAgentHQ/openagent-eval

    Local-first evaluation framework for RAG systems and AI Agents. 18+ metrics, CLI + SDK, framework-agnostic. The pytest of AI evaluation.

    GitHub · Python · 16 stars · 32 forks · 0 stars in 24 hours · Trending score 0.32

  6. 6
    tonydzi/verbatim-citation-gate

    Catch fabricated RAG citations before they reach the user: a zero-token verbatim gate + a burden-of-proof judge, framework-agnostic.

    GitHub · Python · 6 stars · 4 forks · 0 stars in 24 hours · Trending score 0.10

  7. 7
    lizhiyao/oh-my-knowledge

    OMK helps people and agents build, maintain, and reuse valuable knowledge from real work and collaboration, with readable content, traceable sources, and revision history for future tasks.

    GitHub · TypeScript · 25 stars · 5 forks · 0 stars in 24 hours · Trending score 0.08

  8. 8
    HosseinHeydari2004/RAG-Tutorial-From-Zero-to-Advanced

    A repository that teaches Rag concepts from scratch with coding.

    GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  9. 9
    techtheist/knowledgedrift

    KnowledgeDrift - Second Generation AI Memory benchmark

    GitHub · Rust · 17 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07

  10. 10
    dokimos-dev/dokimos

    LLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.

    GitHub · Java · 61 stars · 5 forks · 0 stars in 24 hours · Trending score 0.04

  11. 11
    SasanLabs/LLMForge

    LLMForge is probably the most modern AI vulnerability lab for OWASP VulnerableApp — real-LLM-backed labs for prompt injection, LLM-orchestrated BOLA, and RAG attacks.

    GitHub · Python · 15 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    vectara/open-rag-eval

    RAG evaluation without the need for "golden answers"

    GitHub · Python · 420 stars · 30 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    skygazer42/MimirQ

    中文优先的企业 RAG 知识库:可控解析、治理、切块、混合检索、重排、引用、图谱、评测与 Dify 接入。

    GitHub · Python · 592 stars · 103 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    neskuchny/Tessbrain

    The company brain: it remembers, thinks, and does the work. Meetings become a typed graph with sources — it answers with citations, spots divergence on its own, and returns reports, automations and specs for AI executors.

    GitHub · Python · 8 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    w93139/rag-eval-workflow

    A framework-neutral RAG evaluation skill with golden sets, regression gates, and script-domain checks.

    GitHub · Python · 10 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    TrustifAI/typed_evals

    Fast, typed Python framework for Jev-as-a-Judge/Decision-model evaluation for LLMs, RAG, and AI agents along with human-label calibration.

    GitHub · Python · 16 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    alphaparkinc/genpark-context-precision-recall-rag-metric-skill

    RAG context precision and context recall evaluator measuring retrieved chunk relevance and rank quality

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    alphaparkinc/genpark-hallucination-factual-grounding-checker-skill

    Factual grounding and citation overlap verifier measuring claim support against retrieved passages

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    sgyaqing/RAG-BenchLab

    Build RAG evaluation testsets from documents and benchmark RAG systems.

    GitHub · Python · 16 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    JEen-wang/Adaptive-rag

    按问题复杂度自动分流的电商客服 RAG:简单问题直接回答;复杂问题经过多跳检索并自我纠错;查单、退改通过工具调用完成,且高风险写操作必须先经人工确认。基于 FastAPI 和 LangGraph,混合检索并附带引用,内置离线评测与 Prometheus 指标。涵盖简历写法和项目面试拷打

    GitHub · Python · 186 stars · 21 forks · 0 stars in 24 hours · Trending score 0.00