datalake repositories
Trending repositories tagged datalake, ranked by trending score. Updated daily.
-
1
apache/gravitino
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
GitHub · Java · 3,404 stars · 999 forks · +12 stars in 24 hours · Trending score 2.33
-
2
StarRocks/starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
GitHub · Java · 12,272 stars · 2,684 forks · +9 stars in 24 hours · Trending score 2.19
-
3
trinodb/trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
GitHub · Java · 13,529 stars · 3,882 forks · +8 stars in 24 hours · Trending score 2.11
-
4
ClickHouse/ClickBench
ClickBench: a Benchmark For Analytical Databases
GitHub · Shell · 1,170 stars · 338 forks · +1 stars in 24 hours · Trending score 0.99
-
5
nisshi-io/solace-nisshi
Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake
GitHub · Rust · 1,934 stars · 87 forks · +1 stars in 24 hours · Trending score 0.80
-
6
apache/hudi
Upserts, Deletes And Incremental Processing on Big Data.
GitHub · Java · 6,386 stars · 2,545 forks · 0 stars in 24 hours · Trending score 0.79
-
7
awslabs/visual-asset-management-system
Visual Asset Management System (VAMS) is a purpose-built, AWS native accelerator solution for the management and distribution of traditional to specialized visual assets used in physical AI and spatial computing.
GitHub · Python · 152 stars · 60 forks · 0 stars in 24 hours · Trending score 0.76
-
8
treeverse/lakeFS
lakeFS - Data version control for your data lake | Git for data
GitHub · Go · 5,586 stars · 493 forks · −3 stars in 24 hours · Trending score 0.72
-
9
linkedin/openhouse
Open Control Plane for Tables in Data Lakehouse
GitHub · Java · 405 stars · 86 forks · 0 stars in 24 hours · Trending score 0.33
-
10
apache/doris-thirdparty
Self-managed thirdparty dependencies for Apache Doris
GitHub · 52 stars · 69 forks · 0 stars in 24 hours · Trending score 0.32
-
11
apache/doris-website
Apache Doris Website
GitHub · MDX · 137 stars · 490 forks · 0 stars in 24 hours · Trending score 0.29
-
12
buoyant-data/oxbow
Collection of AWS Lambdas for creating and managing Delta tables
GitHub · Rust · 59 stars · 11 forks · 0 stars in 24 hours · Trending score 0.22
-
13
exasol-labs/lakehouse-engine-rs
In-place query engine for Lakehouses (Iceberg and Delta Lake) for Exasol. Written in Rust 🦀
GitHub · Rust · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
14
DataLinkDC/dinky
Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
GitHub · Java · 3,776 stars · 1,354 forks · 0 stars in 24 hours · Trending score 0.08
-
15
j2h4u/mcp-telegram
MCP server exposing Telegram as tools for LLMs — read history, search with context, look up entities by name
GitHub · Python · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.05
-
16
hyparam/icebird
Icebird: JavaScript Iceberg Client
GitHub · JavaScript · 131 stars · 8 forks · 0 stars in 24 hours · Trending score 0.02
-
17
samber/awesome-olap
🧊 A curated list of OLAP databases, data lake tools, columnar engines, and analytics frameworks for data engineers.
GitHub · Astro · 151 stars · 15 forks · 0 stars in 24 hours · Trending score 0.02
-
18
SkardiLabs/skardi
Skardi is a self-improving context framework for ai agents
GitHub · Rust · 111 stars · 10 forks · 0 stars in 24 hours · Trending score 0.02
-
19
HKUSTDial/awesome-data-agents
Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"
GitHub · Python · 800 stars · 62 forks · 0 stars in 24 hours · Trending score 0.02
-
20
DataWithBaraa/sql-data-warehouse-project
A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.
GitHub · TSQL · 1,062 stars · 750 forks · 0 stars in 24 hours · Trending score 0.00
-
21
nimtable/iceberg-compaction
Compaction runtime for Apache Iceberg.
GitHub · Rust · 145 stars · 31 forks · 0 stars in 24 hours · Trending score 0.00
-
22
zinggAI/zingg
Scalable master data management, identity resolution, entity resolution, and deduplication using ML
GitHub · Java · 1,256 stars · 178 forks · 0 stars in 24 hours · Trending score 0.00
-
23
neuralinkcorp/datarepo
GitHub · Python · 203 stars · 43 forks · 0 stars in 24 hours · Trending score 0.00