data-orchestration repositories

Trending repositories tagged data-orchestration, ranked by trending score. Updated daily.

  1. 1
    kestra-io/kestra

    Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

    GitHub · Java · 30,298 stars · 3,545 forks · +18 stars in 24 hours · Trending score 2.71

  2. 2
    goldener-data/goldener

    Goldener - Make your data even more valuable - Open source data-centric orchestration for the full AI lifecycle

    GitHub · Python · 18 stars · 29 forks · −1 stars in 24 hours · Trending score 0.88

  3. 3
    ozkary/data-engineering-mta-turnstile

    Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis

    GitHub · Jupyter Notebook · 34 stars · 7 forks · +1 stars in 24 hours · Trending score 0.45

  4. 4
    cubefs/cubefs

    cloud-native distributed storage

    GitHub · Go · 5,693 stars · 716 forks · 0 stars in 24 hours · Trending score 0.28

  5. 5
    dagster-io/skills

    A collection of AI skills for working with Dagster

    GitHub · Python · 219 stars · 16 forks · 0 stars in 24 hours · Trending score 0.22

  6. 6
    slothflowlabs/duckle

    Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 446 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

    GitHub · Rust · 1,557 stars · 121 forks · −20 stars in 24 hours · Trending score 0.19

  7. 7
    apache/incubator-graphar

    An open source, standard data file format for graph data storage and retrieval.

    GitHub · Java · 384 stars · 97 forks · 0 stars in 24 hours · Trending score 0.04

  8. 8
    GitBrincie212/ChronoGrapher

    Powerful, developer-experience centric, blazingly fast and extensible job scheduler and workflow orchestration platform

    GitHub · Rust · 12 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00

  9. 9
    dali-benothmen/woml

    Build automated workflows, apps, and AI agents with WOML

    GitHub · Rust · 173 stars · 13 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    amrelsawalhi/obelisk

    Self-hosted data platform and control plane. A Parquet lakehouse queried in-process by DuckDB, live Postgres federation in the same SQL, dbt, notebooks, and a built-in orchestrator on one machine, with no cloud tax.

    GitHub · Python · 34 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00