unstructured-data repositories
Trending repositories tagged unstructured-data, ranked by trending score. Updated daily.
-
1
voxel51/fiftyone
Refine high-quality datasets and visual AI models
GitHub · TypeScript · 11,321 stars · 854 forks · +7 stars in 24 hours · Trending score 2.06
-
2
ucbepic/docetl
A system for agentic LLM-powered data processing and ETL
GitHub · Python · 4,259 stars · 471 forks · +2 stars in 24 hours · Trending score 1.58
-
3
fsdatalab/quail
An open-source inference engine for AI functions in SQL
GitHub · Python · 193 stars · 20 forks · +3 stars in 24 hours · Trending score 1.21
-
4
docling-project/docling-pipelines
Scalable Ingestion pipeline
GitHub · Python · 54 stars · 47 forks · +1 stars in 24 hours · Trending score 1.00
-
5
Oxen-AI/Oxen
Lightning fast data version control system for large repositories of data. Feels like git, pushes and pulls like oxen.
GitHub · Rust · 1,211 stars · 34 forks · +2 stars in 24 hours · Trending score 0.81
-
6
treeverse/dvc
🦉 Data Versioning and ML Experiments
GitHub · Python · 15,978 stars · 1,344 forks · 0 stars in 24 hours · Trending score 0.52
-
7
Open-Source-Legal/OpenContracts
The open document intelligence platform for builders and hackers - DMS for the agentic world
GitHub · Python · 1,550 stars · 199 forks · 0 stars in 24 hours · Trending score 0.51
-
8
datachain-ai/datachain
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
GitHub · Python · 2,832 stars · 180 forks · 0 stars in 24 hours · Trending score 0.32
-
9
moksh-m9u/Multimodal-Rag
Production-ready multimodal RAG pipeline for PDFs. Extracts text, tables, and images down to the atomic element level via unstructured, chunks and AI-enriches them with a vision LLM, stores them in ChromaDB, and answers queries with full multimodal context
GitHub · Jupyter Notebook · 6 stars · 3 forks · 0 stars in 24 hours · Trending score 0.31
-
10
aws-samples/sample-aws-idp-pipeline
End-to-end Intelligent Document Processing (IDP) pipeline using Amazon Bedrock, LanceDB, Lambda, Strands Agents, and Step Functions. Supports multimodal document analysis for PDFs, images, videos, and audio.
GitHub · TypeScript · 41 stars · 22 forks · 0 stars in 24 hours · Trending score 0.22
-
11
nuclia/nucliadb
NucliaDB, The AI Search database for RAG
GitHub · Python · 722 stars · 59 forks · −1 stars in 24 hours · Trending score 0.10
-
12
lotus-data/lotus
Optimized Agentic and LLM Bulk Processing Over Your Data
GitHub · Python · 1,731 stars · 158 forks · 0 stars in 24 hours · Trending score 0.03
-
13
shcherbak-ai/contextgem
Extract structured data and insights from documents using LLMs and decision models
GitHub · Python · 2,080 stars · 191 forks · 0 stars in 24 hours · Trending score 0.03
-
14
HKUSTDial/awesome-data-agents
Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"
GitHub · Python · 800 stars · 62 forks · 0 stars in 24 hours · Trending score 0.02
-
15
Renumics/spotlight
Interactively explore unstructured datasets from your dataframe.
GitHub · TypeScript · 1,283 stars · 93 forks · 0 stars in 24 hours · Trending score 0.00
-
16
milvus-io/bootcamp
Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
GitHub · Jupyter Notebook · 2,449 stars · 684 forks · 0 stars in 24 hours · Trending score 0.00
-
17
alphaparkinc/genpark-pdf-complex-merged-table-bbox-parser-skill
GenPark AI Agent Skill - Heuristic 2D bounding-box spatial grid analyzer resolving multi-column spanning headers and borderless table cells.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
18
alphaparkinc/genpark-hierarchical-markdown-chunker-heading-anchor-skill
GenPark AI Agent Skill - Hierarchical document section tree chunker preserving H1/H2/H3 semantic breadcrumbs and parent context for RAG.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
19
alphaparkinc/genpark-document-visual-reading-order-topological-sorter-skill
GenPark AI Agent Skill - Multi-column newspaper layout reading order topological sorter converting 2D spatial text bboxes into natural flow.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
Alpha-Park/genpark-hierarchical-markdown-chunker-heading-anchor-skill
GenPark AI Agent Skill - Hierarchical document section tree chunker preserving H1/H2/H3 semantic breadcrumbs and parent context for RAG.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
21
Alpha-Park/genpark-scanned-document-skew-orientation-angle-corrector-skill
GenPark AI Agent Skill - Geometric text baseline projection profile skew angle estimator computing rotation corrections for scanned PDFs.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
22
alphaparkinc/genpark-ocr-confidence-score-spellcheck-regularizer-skill
GenPark AI Agent Skill - Scans OCR token confidence scores, repairs character recognition artifacts and standardizes ligatures.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
23
alphaparkinc/genpark-scanned-document-skew-orientation-angle-corrector-skill
GenPark AI Agent Skill - Geometric text baseline projection profile skew angle estimator computing rotation corrections for scanned PDFs.
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
24
dingodb/dingo
A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.
GitHub · Java · 1,703 stars · 263 forks · 0 stars in 24 hours · Trending score 0.00