data-lake repositories

Trending repositories tagged data-lake, ranked by trending score. Updated daily.

  1. 1
    lakekeeper/lakekeeper

    Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.

    GitHub · Rust · 1,514 stars · 181 forks · +6 stars in 24 hours · Trending score 1.82

  2. 2
    rootSunc/CNEquity

    开源中国股市(A股)本地数据湖:沪深股票行情、A股股票数据与金融数据,面向量化研究、量化交易与回测,含财务数据、期货数据、资金流向、公告、指数行业与宏观。86个日更数据集,复权与历史成分内置,行级溯源、PIT,MCP原生。免注册、免 Token,自托管。Open-source China stock market data lake for quant research, backtesting and AI agents.

    GitHub · Python · 1,028 stars · 114 forks · 0 stars in 24 hours · Trending score 1.51

  3. 3
    apache/amoro

    Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.

    GitHub · Java · 1,207 stars · 402 forks · +4 stars in 24 hours · Trending score 1.48

  4. 4
    dlt-hub/dlt

    data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

    GitHub · Python · 6,098 stars · 664 forks · 0 stars in 24 hours · Trending score 1.09

  5. 5
    pixelsdb/pixels

    An efficient storage and compute engine for both on-prem and cloud-native data analytics.

    GitHub · Java · 918 stars · 154 forks · +1 stars in 24 hours · Trending score 0.73

  6. 6
    treeverse/lakeFS

    lakeFS - Data version control for your data lake | Git for data

    GitHub · Go · 5,586 stars · 493 forks · −3 stars in 24 hours · Trending score 0.72

  7. 7
    skuirrels/DuckDB.EFCoreProvider

    DuckDB, DuckLake & Parquet EF Core Provider for analytics at cloud scale, for .NET 10 / EF Core 10 and .NET 11 / EF Core 11

    GitHub · C# · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.57

  8. 8
    tech-pw/cryo

    Self-hosted Apache Iceberg maintenance and health platform — scans, grades A-F, and runs compaction, snapshot expiry, and orphan cleanup on Trino or Spark.

    GitHub · Python · 12 stars · 2 forks · 0 stars in 24 hours · Trending score 0.51

  9. 9
    68110923/xunlongjue-doc

    寻龙诀 PRO · A股首板一进二 / 二进三研究 / 竞价打板 / 龙头接力 · 量化策略交易系统|全市场真实竞价 + 首板扫描 + 连板选股 + 自动复盘 + 本地数据湖 | A-share first-board & limit-up auction quant trading strategy

    GitHub · HTML · 8 stars · 3 forks · +1 stars in 24 hours · Trending score 0.41

  10. 10
    apache/kyuubi

    Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

    GitHub · Scala · 2,379 stars · 1,038 forks · 0 stars in 24 hours · Trending score 0.27

  11. 11
    harn3ss/open-infra

    A self-hosted, AWS-compatible cloud for your own hardware. Point the AWS CLI, SDKs, CloudFormation and Terraform at it to run Lambda, S3, RDS & SQL Server, DynamoDB, EC2-style VMs, IAM, Step Functions and 25+ AWS services — GitOps and Kubernetes underneath, AWS on the surface.

    GitHub · Go · 15 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09

  12. 12
    icegatetech/icegate

    IceGate is an observability data lake engine

    GitHub · Rust · 39 stars · 3 forks · 0 stars in 24 hours · Trending score 0.04

  13. 13
    realdatadriven/etlx

    ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.

    GitHub · Go · 57 stars · 3 forks · 0 stars in 24 hours · Trending score 0.04

  14. 14
    hyparam/icebird

    Icebird: JavaScript Iceberg Client

    GitHub · JavaScript · 131 stars · 8 forks · 0 stars in 24 hours · Trending score 0.02

  15. 15
    samber/awesome-olap

    🧊 A curated list of OLAP databases, data lake tools, columnar engines, and analytics frameworks for data engineers.

    GitHub · Astro · 151 stars · 15 forks · 0 stars in 24 hours · Trending score 0.02

  16. 16
    ravikiranpagidi/alibaba-cloud-blueprints

    Role-based Alibaba Cloud blueprints with learning paths, labs, projects, diagrams, certification prep, interview guides, and enterprise architecture templates.

    GitHub · Mermaid · 15 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    smart-data-lake/smart-data-lake

    Smart Automation Tool for building modern Data Lakes and Data Pipelines

    GitHub · Scala · 130 stars · 29 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    D2IP-TUB/Matryoshka

    Matryoshka: feature selection and data discovery in data lakes — find and select relevant features to augment a query table for ML (PVLDB 2026)

    GitHub · Python · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    alphaparkinc/genpark-apache-avro-schema-evolution-resolver-skill

    Production-grade genpark-apache-avro-schema-evolution-resolver-skill skill for AI agents

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    JeonDaehong/integrity-plane

    Enforced PRIMARY KEY / UNIQUE / NOT NULL / FOREIGN KEY constraints for Apache Iceberg, at commit time, for any engine. An Iceberg REST catalog proxy in Rust with verifiable integrity certificates.

    GitHub · Rust · 6 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00