etl-framework repositories
Trending repositories tagged etl-framework, ranked by trending score. Updated daily.
-
1
elastic/logstash
Logstash - transport and process your logs, events, or other data
GitHub · Java · 14,983 stars · 3,501 forks · +1 stars in 24 hours · Trending score 0.87
-
2
cloudquery/cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
GitHub · Go · 6,560 stars · 566 forks · +1 stars in 24 hours · Trending score 0.61
-
3
cefriel/chimera
Composable Semantic Transformation Pipelines
GitHub · Java · 43 stars · 4 forks · 0 stars in 24 hours · Trending score 0.32
-
4
marciok/gust
A Task-Based Workflow Orchestration Engine
GitHub · Elixir · 393 stars · 25 forks · 0 stars in 24 hours · Trending score 0.17
-
5
wp-labs/warp-parse
Focusing on building industry-leading ETL engines.
GitHub · Rust · 186 stars · 13 forks · 0 stars in 24 hours · Trending score 0.17
-
6
pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
GitHub · Python · 61,982 stars · 1,704 forks · −8 stars in 24 hours · Trending score 0.10
-
7
frankframework/frankframework
The Frank!Framework is an easy-to-use, stateless integration framework which allows (transactional) messages to be modified and exchanged between different systems.
GitHub · Java · 168 stars · 90 forks · 0 stars in 24 hours · Trending score 0.09
-
8
halestudio/hale
(Spatial) data harmonisation with hale»studio (formerly HUMBOLDT Alignment Editor)
GitHub · Java · 156 stars · 44 forks · 0 stars in 24 hours · Trending score 0.09
-
9
swadhinbiswas/eu-air-traffic
Live and historical European air traffic: a VPS collector streams ADS-B, OpenSky movements, schedules and weather through Kafka into a Bronze/Silver lake, a dbt warehouse and a read-only serving copy behind a public dashboard. Budget-aware polling and atomic publishes keep it correct while unattended.
GitHub · Python · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04
-
10
noflo/noflo
Flow-based programming for JavaScript
GitHub · JavaScript · 3,558 stars · 265 forks · 0 stars in 24 hours · Trending score 0.01
-
11
apache/hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
GitHub · Jupyter Notebook · 2,625 stars · 229 forks · 0 stars in 24 hours · Trending score 0.01
-
12
globalbioticinteractions/globalbioticinteractions
Global Biotic Interactions provides access to existing species interaction datasets
GitHub · Java · 145 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00
-
13
ceumicrodata/mETL
mito ETL tool
GitHub · Python · 163 stars · 40 forks · 0 stars in 24 hours · Trending score 0.00
-
14
dalenewman/Transformalize
Configurable Extract, Transform, and Load
GitHub · C# · 162 stars · 31 forks · 0 stars in 24 hours · Trending score 0.00
-
15
maxim2266/csvplus
csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
GitHub · Go · 66 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00
-
16
emiliano-go/rypipe
Format- and source-agnostic ingestion framework: a common execution runtime for turning record-oriented data sources into typed columnar data. Rust core, Python bindings; adapters live in separate packages.
GitHub · Rust · 23 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00