data-lake repositories
Trending repositories tagged data-lake, ranked by trending score. Updated daily.
-
1
lakekeeper/lakekeeper
Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.
GitHub · Rust · 1,514 stars · 181 forks · +6 stars in 24 hours · Trending score 1.82
-
2
rootSunc/CNEquity
开源中国股市(A股)本地数据湖:沪深股票行情、A股股票数据与金融数据,面向量化研究、量化交易与回测,含财务数据、期货数据、资金流向、公告、指数行业与宏观。86个日更数据集,复权与历史成分内置,行级溯源、PIT,MCP原生。免注册、免 Token,自托管。Open-source China stock market data lake for quant research, backtesting and AI agents.
GitHub · Python · 1,028 stars · 114 forks · 0 stars in 24 hours · Trending score 1.51
-
3
apache/amoro
Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.
GitHub · Java · 1,207 stars · 402 forks · +4 stars in 24 hours · Trending score 1.48
-
4
dlt-hub/dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
GitHub · Python · 6,098 stars · 664 forks · 0 stars in 24 hours · Trending score 1.09
-
5
pixelsdb/pixels
An efficient storage and compute engine for both on-prem and cloud-native data analytics.
GitHub · Java · 918 stars · 154 forks · +1 stars in 24 hours · Trending score 0.73
-
6
treeverse/lakeFS
lakeFS - Data version control for your data lake | Git for data
GitHub · Go · 5,586 stars · 493 forks · −3 stars in 24 hours · Trending score 0.72
-
7
skuirrels/DuckDB.EFCoreProvider
DuckDB, DuckLake & Parquet EF Core Provider for analytics at cloud scale, for .NET 10 / EF Core 10 and .NET 11 / EF Core 11
GitHub · C# · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.57
-
8
tech-pw/cryo
Self-hosted Apache Iceberg maintenance and health platform — scans, grades A-F, and runs compaction, snapshot expiry, and orphan cleanup on Trino or Spark.
GitHub · Python · 12 stars · 2 forks · 0 stars in 24 hours · Trending score 0.51
-
9
68110923/xunlongjue-doc
寻龙诀 PRO · A股首板一进二 / 二进三研究 / 竞价打板 / 龙头接力 · 量化策略交易系统|全市场真实竞价 + 首板扫描 + 连板选股 + 自动复盘 + 本地数据湖 | A-share first-board & limit-up auction quant trading strategy
GitHub · HTML · 8 stars · 3 forks · +1 stars in 24 hours · Trending score 0.41
-
10
apache/kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
GitHub · Scala · 2,379 stars · 1,038 forks · 0 stars in 24 hours · Trending score 0.27
-
11
harn3ss/open-infra
A self-hosted, AWS-compatible cloud for your own hardware. Point the AWS CLI, SDKs, CloudFormation and Terraform at it to run Lambda, S3, RDS & SQL Server, DynamoDB, EC2-style VMs, IAM, Step Functions and 25+ AWS services — GitOps and Kubernetes underneath, AWS on the surface.
GitHub · Go · 15 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09
-
12
icegatetech/icegate
IceGate is an observability data lake engine
GitHub · Rust · 39 stars · 3 forks · 0 stars in 24 hours · Trending score 0.04
-
13
realdatadriven/etlx
ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.
GitHub · Go · 57 stars · 3 forks · 0 stars in 24 hours · Trending score 0.04
-
14
hyparam/icebird
Icebird: JavaScript Iceberg Client
GitHub · JavaScript · 131 stars · 8 forks · 0 stars in 24 hours · Trending score 0.02
-
15
samber/awesome-olap
🧊 A curated list of OLAP databases, data lake tools, columnar engines, and analytics frameworks for data engineers.
GitHub · Astro · 151 stars · 15 forks · 0 stars in 24 hours · Trending score 0.02
-
16
ravikiranpagidi/alibaba-cloud-blueprints
Role-based Alibaba Cloud blueprints with learning paths, labs, projects, diagrams, certification prep, interview guides, and enterprise architecture templates.
GitHub · Mermaid · 15 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00
-
17
smart-data-lake/smart-data-lake
Smart Automation Tool for building modern Data Lakes and Data Pipelines
GitHub · Scala · 130 stars · 29 forks · 0 stars in 24 hours · Trending score 0.00
-
18
D2IP-TUB/Matryoshka
Matryoshka: feature selection and data discovery in data lakes — find and select relevant features to augment a query table for ML (PVLDB 2026)
GitHub · Python · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
19
alphaparkinc/genpark-apache-avro-schema-evolution-resolver-skill
Production-grade genpark-apache-avro-schema-evolution-resolver-skill skill for AI agents
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
20
JeonDaehong/integrity-plane
Enforced PRIMARY KEY / UNIQUE / NOT NULL / FOREIGN KEY constraints for Apache Iceberg, at commit time, for any engine. An Iceberg REST catalog proxy in Rust with verifiable integrity certificates.
GitHub · Rust · 6 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00