lakehouse repositories

Trending repositories tagged lakehouse, ranked by trending score. Updated daily.

  1. 1
    ModernRelay/omnigraph

    Object-storage native graph database with branching and typed ontology

    GitHub · Rust · 3,108 stars · 340 forks · +136 stars in 24 hours · Trending score 4.32

  2. 2
    datazip-inc/olake-go

    OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.

    GitHub · Go · 2,062 stars · 314 forks · +196 stars in 24 hours · Trending score 4.21

  3. 3
    ClickHouse/ClickHouse

    ClickHouse® is a real-time analytics database management system

    GitHub · C++ · 51,034 stars · 9,303 forks · +51 stars in 24 hours · Trending score 3.42

  4. 4
    apache/gravitino

    World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

    GitHub · Java · 3,404 stars · 999 forks · +12 stars in 24 hours · Trending score 2.33

  5. 5
    StarRocks/starrocks

    The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

    GitHub · Java · 12,272 stars · 2,684 forks · +9 stars in 24 hours · Trending score 2.19

  6. 6
    apache/doris

    Apache Doris is a real-time analytics and hybrid search database for AI agents.

    GitHub · Java · 16,243 stars · 4,035 forks · +4 stars in 24 hours · Trending score 1.89

  7. 7
    lakekeeper/lakekeeper

    Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.

    GitHub · Rust · 1,514 stars · 181 forks · +6 stars in 24 hours · Trending score 1.82

  8. 8
    ssanjaychandra123/data-engineering-patterns

    600+ free patterns and concepts for data engineers on Azure Databricks, Microsoft Fabric, and PySpark. 12 books covering the full stack. Free forever.

    GitHub · 93 stars · 39 forks · +10 stars in 24 hours · Trending score 1.67

  9. 9
    starlake-ai/qod

    Production-grade SQL gateway in front of DuckDB Quack + DuckLake + Iceberg. Multi-tenant pools, pluggable auth (DB/JWT/OIDC), table-level ACLs, role-aware routing, and a live admin console

    GitHub · Scala · 154 stars · 11 forks · +9 stars in 24 hours · Trending score 1.59

  10. 10
    prestodb/presto

    The official home of the Presto distributed SQL query engine for big data

    GitHub · Java · 16,778 stars · 5,556 forks · +5 stars in 24 hours · Trending score 1.51

  11. 11
    morainedb/moraine

    Run DuckLake entirely in object storage, no server required. A SlateDB-backed catalog, as a DuckDB extension and a Rust crate.

    GitHub · Rust · 21 stars · 0 forks · +15 stars in 24 hours · Trending score 1.47

  12. 12
    databendlabs/databend

    Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.

    GitHub · Rust · 9,501 stars · 902 forks · +4 stars in 24 hours · Trending score 1.26

  13. 13
    apache/polaris

    Apache Polaris, the interoperable, open source catalog for Apache Iceberg

    GitHub · Java · 2,123 stars · 575 forks · +1 stars in 24 hours · Trending score 1.16

  14. 14
    stardelt/stardelt

    The open-source data platform you actually own: SQL over Iceberg, notebooks, pipelines and dashboards on any Kubernetes cluster.

    GitHub · Rust · 13 stars · 0 forks · +6 stars in 24 hours · Trending score 1.02

  15. 15
    pivotlake/pivot

    Pivot is a high-performance real time analytics database on open data formats.

    GitHub · Rust · 177 stars · 13 forks · +2 stars in 24 hours · Trending score 1.01

  16. 16
    ClickHouse/ClickBench

    ClickBench: a Benchmark For Analytical Databases

    GitHub · Shell · 1,170 stars · 338 forks · +1 stars in 24 hours · Trending score 0.99

  17. 17
    apache/fluss

    Apache Fluss is a streaming storage built for real-time analytics.

    GitHub · Java · 2,249 stars · 673 forks · +1 stars in 24 hours · Trending score 0.96

  18. 18
    vaquarkhan/data-engineering-agent-skills

    Production-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.

    GitHub · Python · 65 stars · 9 forks · 0 stars in 24 hours · Trending score 0.80

  19. 19
    parqdb-io/parqdb

    Billion-scale embedded vector database built entirely on Parquet and Arrow.

    GitHub · Python · 117 stars · 10 forks · 0 stars in 24 hours · Trending score 0.69

  20. 20
    lakehq/sail

    Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

    GitHub · Rust · 3,504 stars · 243 forks · 0 stars in 24 hours · Trending score 0.69

  21. 21
    microsoft/LakeBench

    A multi-modal Python library for benchmarking lakehouse engines and ELT scenarios, supporting both industry-standard and novel benchmarks.

    GitHub · Python · 57 stars · 24 forks · 0 stars in 24 hours · Trending score 0.68

  22. 22
    ailake-io/ai-lakehouse

    AI-Lake Format: self-contained Parquet + HNSW index — unifying tabular data, embeddings, and vector search in a single Iceberg-compatible file

    GitHub · Rust · 46 stars · 4 forks · +1 stars in 24 hours · Trending score 0.54

  23. 23
    tech-pw/cryo

    Self-hosted Apache Iceberg maintenance and health platform — scans, grades A-F, and runs compaction, snapshot expiry, and orphan cleanup on Trino or Spark.

    GitHub · Python · 12 stars · 2 forks · 0 stars in 24 hours · Trending score 0.51

  24. 24
    slothflowlabs/duckle

    Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 446 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

    GitHub · Rust · 1,557 stars · 121 forks · −16 stars in 24 hours · Trending score 0.41