unstructured-data repositories

Trending repositories tagged unstructured-data, ranked by trending score. Updated daily.

  1. 1
    voxel51/fiftyone

    Refine high-quality datasets and visual AI models

    GitHub · TypeScript · 11,321 stars · 854 forks · +7 stars in 24 hours · Trending score 2.06

  2. 2
    ucbepic/docetl

    A system for agentic LLM-powered data processing and ETL

    GitHub · Python · 4,259 stars · 471 forks · +2 stars in 24 hours · Trending score 1.58

  3. 3
    fsdatalab/quail

    An open-source inference engine for AI functions in SQL

    GitHub · Python · 193 stars · 20 forks · +3 stars in 24 hours · Trending score 1.21

  4. 4
    docling-project/docling-pipelines

    Scalable Ingestion pipeline

    GitHub · Python · 54 stars · 47 forks · +1 stars in 24 hours · Trending score 1.00

  5. 5
    Oxen-AI/Oxen

    Lightning fast data version control system for large repositories of data. Feels like git, pushes and pulls like oxen.

    GitHub · Rust · 1,211 stars · 34 forks · +2 stars in 24 hours · Trending score 0.81

  6. 6
    treeverse/dvc

    🦉 Data Versioning and ML Experiments

    GitHub · Python · 15,978 stars · 1,344 forks · 0 stars in 24 hours · Trending score 0.52

  7. 7
    Open-Source-Legal/OpenContracts

    The open document intelligence platform for builders and hackers - DMS for the agentic world

    GitHub · Python · 1,550 stars · 199 forks · 0 stars in 24 hours · Trending score 0.51

  8. 8
    datachain-ai/datachain

    The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

    GitHub · Python · 2,832 stars · 180 forks · 0 stars in 24 hours · Trending score 0.32

  9. 9
    moksh-m9u/Multimodal-Rag

    Production-ready multimodal RAG pipeline for PDFs. Extracts text, tables, and images down to the atomic element level via unstructured, chunks and AI-enriches them with a vision LLM, stores them in ChromaDB, and answers queries with full multimodal context

    GitHub · Jupyter Notebook · 6 stars · 3 forks · 0 stars in 24 hours · Trending score 0.31

  10. 10
    aws-samples/sample-aws-idp-pipeline

    End-to-end Intelligent Document Processing (IDP) pipeline using Amazon Bedrock, LanceDB, Lambda, Strands Agents, and Step Functions. Supports multimodal document analysis for PDFs, images, videos, and audio.

    GitHub · TypeScript · 41 stars · 22 forks · 0 stars in 24 hours · Trending score 0.22

  11. 11
    nuclia/nucliadb

    NucliaDB, The AI Search database for RAG

    GitHub · Python · 722 stars · 59 forks · −1 stars in 24 hours · Trending score 0.10

  12. 12
    lotus-data/lotus

    Optimized Agentic and LLM Bulk Processing Over Your Data

    GitHub · Python · 1,731 stars · 158 forks · 0 stars in 24 hours · Trending score 0.03

  13. 13
    shcherbak-ai/contextgem

    Extract structured data and insights from documents using LLMs and decision models

    GitHub · Python · 2,080 stars · 191 forks · 0 stars in 24 hours · Trending score 0.03

  14. 14
    HKUSTDial/awesome-data-agents

    Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"

    GitHub · Python · 800 stars · 62 forks · 0 stars in 24 hours · Trending score 0.02

  15. 15
    Renumics/spotlight

    Interactively explore unstructured datasets from your dataframe.

    GitHub · TypeScript · 1,283 stars · 93 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    milvus-io/bootcamp

    Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.

    GitHub · Jupyter Notebook · 2,449 stars · 684 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    alphaparkinc/genpark-pdf-complex-merged-table-bbox-parser-skill

    GenPark AI Agent Skill - Heuristic 2D bounding-box spatial grid analyzer resolving multi-column spanning headers and borderless table cells.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    alphaparkinc/genpark-hierarchical-markdown-chunker-heading-anchor-skill

    GenPark AI Agent Skill - Hierarchical document section tree chunker preserving H1/H2/H3 semantic breadcrumbs and parent context for RAG.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    alphaparkinc/genpark-document-visual-reading-order-topological-sorter-skill

    GenPark AI Agent Skill - Multi-column newspaper layout reading order topological sorter converting 2D spatial text bboxes into natural flow.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    Alpha-Park/genpark-hierarchical-markdown-chunker-heading-anchor-skill

    GenPark AI Agent Skill - Hierarchical document section tree chunker preserving H1/H2/H3 semantic breadcrumbs and parent context for RAG.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    Alpha-Park/genpark-scanned-document-skew-orientation-angle-corrector-skill

    GenPark AI Agent Skill - Geometric text baseline projection profile skew angle estimator computing rotation corrections for scanned PDFs.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    alphaparkinc/genpark-ocr-confidence-score-spellcheck-regularizer-skill

    GenPark AI Agent Skill - Scans OCR token confidence scores, repairs character recognition artifacts and standardizes ligatures.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    alphaparkinc/genpark-scanned-document-skew-orientation-angle-corrector-skill

    GenPark AI Agent Skill - Geometric text baseline projection profile skew angle estimator computing rotation corrections for scanned PDFs.

    GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    dingodb/dingo

    A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.

    GitHub · Java · 1,703 stars · 263 forks · 0 stars in 24 hours · Trending score 0.00