data-platform repositories
Trending repositories tagged data-platform, ranked by trending score. Updated daily.
-
1
qiantongtech/qData
qData is a lightweight, feature-complete, AI-native open-source data platform. It covers data integration, development, modeling, governance, assets and API services, with self-hosted deployment, flexible scaling and commercial use.
GitHub · Java · 940 stars · 140 forks · +21 stars in 24 hours · Trending score 2.59
-
2
ssanjaychandra123/data-engineering-patterns
600+ free patterns and concepts for data engineers on Azure Databricks, Microsoft Fabric, and PySpark. 12 books covering the full stack. Free forever.
GitHub · 93 stars · 39 forks · +10 stars in 24 hours · Trending score 1.67
-
3
bruin-data/bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
GitHub · Go · 1,815 stars · 101 forks · +6 stars in 24 hours · Trending score 1.55
-
4
yuyuejia/datay
DataY 是一套轻量、高性能的数据平台,一个 JAR、自研流批一体处理引擎,自研分布式调度框架,在 2 核 4G 的机器上 就能跑通 数据集成 → 数据建模 → 数据开发 → 任务调度 → 数据应用 的完整链路。
GitHub · Java · 50 stars · 23 forks · +2 stars in 24 hours · Trending score 1.28
-
5
clidey/whodb
Where data access meets operational intelligence
GitHub · Go · 5,061 stars · 243 forks · +2 stars in 24 hours · Trending score 1.04
-
6
stardelt/stardelt
The open-source data platform you actually own: SQL over Iceberg, notebooks, pipelines and dashboards on any Kubernetes cluster.
GitHub · Rust · 13 stars · 0 forks · +6 stars in 24 hours · Trending score 1.02
-
7
mosaico-labs/mosaico
Mosaico - The data platform for Physical AI
GitHub · Python · 1,134 stars · 80 forks · 0 stars in 24 hours · Trending score 0.69
-
8
tunjayoff/sofascore_scraper
Self-hosted SofaScore data platform: follow leagues, teams, players and matches in 21 sports, download their history within a request budget, and export CSV, JSONL, Parquet or SQLite. Python library, ssc CLI, HTTP API and web UI. Unofficial.
GitHub · Python · 52 stars · 15 forks · 0 stars in 24 hours · Trending score 0.62
-
9
Data-Masterclass/sovereign-agentic-os
Sovereign Agentic OS — self-hostable, EU-sovereign agentic data platform on Kubernetes (pre-beta). One Helm chart, runs in your own cluster.
GitHub · TypeScript · 6 stars · 7 forks · +1 stars in 24 hours · Trending score 0.56
-
10
RonaldHensbergen/composable-data-stack
Modular data platform building blocks wired through explicit contracts, not hidden dependencies
GitHub · Python · 8 stars · 14 forks · 0 stars in 24 hours · Trending score 0.38
-
11
renart-data/renart
Open source data platform for SQL and Python pipelines, notebooks and dashboards, with type checking, scheduling and definitions in Git.
GitHub · Go · 96 stars · 8 forks · 0 stars in 24 hours · Trending score 0.37
-
12
rocky-data/rocky
A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.
GitHub · Rust · 311 stars · 19 forks · 0 stars in 24 hours · Trending score 0.32
-
13
canonical/opensearch-operator
Operator charms for OpenSearch on VM and K8s
GitHub · HCL · 18 stars · 20 forks · 0 stars in 24 hours · Trending score 0.25
-
14
egret-data/platform
Open-source, multi-tenant data platform: isolated workspaces with BI, Data API, workflows and data apps on a shared Iceberg lakehouse, with access policy enforced in Trino and StarRocks. Written in Rust.
GitHub · Rust · 26 stars · 1 forks · 0 stars in 24 hours · Trending score 0.23
-
15
debezium/debezium-platform
An opinionated data-centric view of Debezium components. Please log issues at https://github.com/debezium/dbz/issues.
GitHub · TypeScript · 55 stars · 46 forks · 0 stars in 24 hours · Trending score 0.19
-
16
canonical/mongodb-operator
Operator charm for MongoDB on VM
GitHub · HCL · 14 stars · 17 forks · 0 stars in 24 hours · Trending score 0.19
-
17
Jiahong-Que-9527/SoloLakehouse
A Git-first Data & AI engineering initiative across Google Cloud, Databricks, and self-hosted infrastructure. One source of truth for independent projects, reproducible workflows, and automated delivery.
GitHub · Python · 63 stars · 13 forks · 0 stars in 24 hours · Trending score 0.18
-
18
stackabletech/hdfs-operator
Kubernetes operator for Apache Hadoop HDFS. Deploy and run HDFS NameNodes, DataNodes and JournalNodes with the Stackable Data Platform (SDP).
GitHub · Rust · 53 stars · 10 forks · 0 stars in 24 hours · Trending score 0.10
-
19
stackabletech/trino-operator
Kubernetes operator for Trino. Deploy and run Trino coordinators and workers with the Stackable Data Platform (SDP).
GitHub · Rust · 64 stars · 15 forks · 0 stars in 24 hours · Trending score 0.09
-
20
getdango/dango
Open-source data platform for small teams.
GitHub · Python · 13 stars · 2 forks · 0 stars in 24 hours · Trending score 0.08
-
21
stackabletech/spark-k8s-operator
Kubernetes operator for Apache Spark. Run Spark applications on Kubernetes with the Stackable Data Platform (SDP).
GitHub · Rust · 74 stars · 6 forks · 0 stars in 24 hours · Trending score 0.08
-
22
ostrium-labs/loams
One bucket, every index: open-source, AI-native data platform in Rust. Hybrid retrieval on object storage, plus reactive data (Live), graph, SQL, Postgres and durable agent runs. Preview.
GitHub · Rust · 38 stars · 1 forks · 0 stars in 24 hours · Trending score 0.07
-
23
keboola/mcp-server
Model Context Protocol (MCP) Server for the Keboola Platform
GitHub · Python · 85 stars · 23 forks · 0 stars in 24 hours · Trending score 0.02
-
24
opendatadiscovery/odd-platform
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
GitHub · Java · 1,441 stars · 152 forks · 0 stars in 24 hours · Trending score 0.00