etl-framework repositories

Trending repositories tagged etl-framework, ranked by trending score. Updated daily.

  1. 1
    elastic/logstash

    Logstash - transport and process your logs, events, or other data

    GitHub · Java · 14,983 stars · 3,501 forks · +1 stars in 24 hours · Trending score 0.87

  2. 2
    cloudquery/cloudquery

    Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

    GitHub · Go · 6,560 stars · 566 forks · +1 stars in 24 hours · Trending score 0.61

  3. 3
    cefriel/chimera

    Composable Semantic Transformation Pipelines

    GitHub · Java · 43 stars · 4 forks · 0 stars in 24 hours · Trending score 0.32

  4. 4
    marciok/gust

    A Task-Based Workflow Orchestration Engine

    GitHub · Elixir · 393 stars · 25 forks · 0 stars in 24 hours · Trending score 0.17

  5. 5
    wp-labs/warp-parse

    Focusing on building industry-leading ETL engines.

    GitHub · Rust · 186 stars · 13 forks · 0 stars in 24 hours · Trending score 0.17

  6. 6
    pathwaycom/pathway

    Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

    GitHub · Python · 61,982 stars · 1,704 forks · −8 stars in 24 hours · Trending score 0.10

  7. 7
    frankframework/frankframework

    The Frank!Framework is an easy-to-use, stateless integration framework which allows (transactional) messages to be modified and exchanged between different systems.

    GitHub · Java · 168 stars · 90 forks · 0 stars in 24 hours · Trending score 0.09

  8. 8
    halestudio/hale

    (Spatial) data harmonisation with hale»studio (formerly HUMBOLDT Alignment Editor)

    GitHub · Java · 156 stars · 44 forks · 0 stars in 24 hours · Trending score 0.09

  9. 9
    swadhinbiswas/eu-air-traffic

    Live and historical European air traffic: a VPS collector streams ADS-B, OpenSky movements, schedules and weather through Kafka into a Bronze/Silver lake, a dbt warehouse and a read-only serving copy behind a public dashboard. Budget-aware polling and atomic publishes keep it correct while unattended.

    GitHub · Python · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04

  10. 10
    noflo/noflo

    Flow-based programming for JavaScript

    GitHub · JavaScript · 3,558 stars · 265 forks · 0 stars in 24 hours · Trending score 0.01

  11. 11
    apache/hamilton

    Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

    GitHub · Jupyter Notebook · 2,625 stars · 229 forks · 0 stars in 24 hours · Trending score 0.01

  12. 12
    globalbioticinteractions/globalbioticinteractions

    Global Biotic Interactions provides access to existing species interaction datasets

    GitHub · Java · 145 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    ceumicrodata/mETL

    mito ETL tool

    GitHub · Python · 163 stars · 40 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    dalenewman/Transformalize

    Configurable Extract, Transform, and Load

    GitHub · C# · 162 stars · 31 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    maxim2266/csvplus

    csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

    GitHub · Go · 66 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    emiliano-go/rypipe

    Format- and source-agnostic ingestion framework: a common execution runtime for turning record-oriented data sources into typed columnar data. Rust core, Python bindings; adapters live in separate packages.

    GitHub · Rust · 23 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00