data-integration repositories
Trending repositories tagged data-integration, ranked by trending score. Updated daily.
-
1
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
GitHub · Python · 47,569 stars · 18,419 forks · +46 stars in 24 hours · Trending score 3.37
-
2
HelixDB/helix-foundry
Connect your company's data, let an agent draft an ontology over it, and load it into HelixDB as one graph you can explore and ask questions of. Hosted at foundry.helix-db.com, or run it on your own machine.
GitHub · Go · 2,173 stars · 313 forks · +31 stars in 24 hours · Trending score 2.74
-
3
qiantongtech/qData
qData is a lightweight, feature-complete, AI-native open-source data platform. It covers data integration, development, modeling, governance, assets and API services, with self-hosted deployment, flexible scaling and commercial use.
GitHub · Java · 940 stars · 140 forks · +21 stars in 24 hours · Trending score 2.59
-
4
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
GitHub · Python · 16,444 stars · 2,427 forks · +9 stars in 24 hours · Trending score 2.36
-
5
airbytehq/airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
GitHub · Python · 22,411 stars · 5,550 forks · +5 stars in 24 hours · Trending score 2.32
-
6
apache/seatunnel
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
GitHub · Java · 9,819 stars · 2,471 forks · +6 stars in 24 hours · Trending score 1.96
-
7
morph-kgc/morph-kgc
Powerful RDF knowledge graph generation with RML mappings
GitHub · Python · 303 stars · 62 forks · +8 stars in 24 hours · Trending score 1.62
-
8
apache/hop
Hop Orchestration Platform
GitHub · Java · 1,543 stars · 493 forks · +4 stars in 24 hours · Trending score 1.59
-
9
apache/devlake
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
GitHub · Go · 3,204 stars · 842 forks · +5 stars in 24 hours · Trending score 1.50
-
10
oracle-samples/oracle-aidp-samples
Oracle AI Data Platform Workbench Samples
GitHub · Python · 61 stars · 44 forks · +5 stars in 24 hours · Trending score 1.46
-
11
bruin-data/ingestr
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
GitHub · Go · 4,048 stars · 170 forks · +5 stars in 24 hours · Trending score 1.34
-
12
jitsucom/jitsu
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
GitHub · TypeScript · 5,137 stars · 405 forks · +1 stars in 24 hours · Trending score 1.25
-
13
galaxy-io/filament
Pluggable data replication with checkpointing, batching, and integrity events
GitHub · Go · 335 stars · 47 forks · 0 stars in 24 hours · Trending score 1.06
-
14
clidey/whodb
Where data access meets operational intelligence
GitHub · Go · 5,061 stars · 243 forks · +2 stars in 24 hours · Trending score 1.04
-
15
TonyWang-hub/mcp-cn-commerce
中国电商 MCP 连接器:8 个平台、155 个已注册工具。开源标准版,含能力矩阵与实际工程验收记录;真实商家联调状态逐项公开。Chinese commerce MCP connectors with documented capabilities and validation status.
GitHub · Python · 101 stars · 18 forks · 0 stars in 24 hours · Trending score 0.88
-
16
RhinoLink-Tech/data-fabric
Data Fabric is a lightweight, self-hosted gateway for unified management and access across heterogeneous data sources.
GitHub · Go · 22 stars · 21 forks · 0 stars in 24 hours · Trending score 0.80
-
17
apache/hudi
Upserts, Deletes And Incremental Processing on Big Data.
GitHub · Java · 6,386 stars · 2,545 forks · 0 stars in 24 hours · Trending score 0.79
-
18
estuary/flow
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
GitHub · Rust · 992 stars · 101 forks · +1 stars in 24 hours · Trending score 0.73
-
19
armbian/armbian.github.io
This repository serves as the central automation, orchestration, and data backbone for the Armbian project’s CI/CD infrastructure. It manages and publishes critical workflows, build artifacts, metadata, and machine-readable content that power Armbian’s public services and infrastructure.
GitHub · Python · 15 stars · 70 forks · +1 stars in 24 hours · Trending score 0.65
-
20
cloudquery/cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
GitHub · Go · 6,560 stars · 566 forks · +1 stars in 24 hours · Trending score 0.61
-
21
apache/flink-cdc
Flink CDC is a streaming data integration tool
GitHub · Java · 6,495 stars · 2,209 forks · +1 stars in 24 hours · Trending score 0.56
-
22
ewiger/hql
HQL — Hyper Query Language — is a strongly typed language for querying, transforming, connecting and computing over data, knowledge and AI workflows.
GitHub · Rust · 6 stars · 0 forks · +1 stars in 24 hours · Trending score 0.54
-
23
faucet-hq/faucet-stream
The fast, config-driven way to move data in Rust — a native CLI and an embeddable Rust ETL library
GitHub · Rust · 23 stars · 8 forks · +1 stars in 24 hours · Trending score 0.54
-
24
seandavi/awesome-single-cell
Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.
GitHub · 3,894 stars · 1,100 forks · 0 stars in 24 hours · Trending score 0.43