data-engineering repositories

Trending repositories tagged data-engineering, ranked by trending score. Updated daily.

  1. 1
    apache/airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    GitHub · Python · 47,569 stars · 18,419 forks · +46 stars in 24 hours · Trending score 3.37

  2. 2
    DataTalksClub/data-engineering-zoomcamp

    Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼

    GitHub · Jupyter Notebook · 46,985 stars · 9,082 forks · +36 stars in 24 hours · Trending score 3.25

  3. 3
    apache/superset

    Apache Superset is a Data Visualization and Data Exploration Platform

    GitHub · Python · 75,586 stars · 18,641 forks · +37 stars in 24 hours · Trending score 3.16

  4. 4
    kestra-io/kestra

    Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

    GitHub · Java · 30,292 stars · 3,544 forks · +34 stars in 24 hours · Trending score 3.01

  5. 5
    growthbook/growthbook

    Open Source Feature Flags, Experimentation, and Product Analytics

    GitHub · TypeScript · 8,632 stars · 913 forks · +26 stars in 24 hours · Trending score 2.77

  6. 6
    PrefectHQ/prefect

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    GitHub · Python · 24,190 stars · 2,671 forks · +16 stars in 24 hours · Trending score 2.48

  7. 7
    dagster-io/dagster

    An orchestration platform for the development, production, and observation of data assets.

    GitHub · Python · 16,444 stars · 2,427 forks · +9 stars in 24 hours · Trending score 2.36

  8. 8
    airbytehq/airbyte

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    GitHub · Python · 22,411 stars · 5,550 forks · +5 stars in 24 hours · Trending score 2.32

  9. 9
    GokuMohandas/Made-With-ML

    Learn how to develop, deploy and iterate on production-grade ML applications.

    GitHub · Jupyter Notebook · 50,097 stars · 7,824 forks · +16 stars in 24 hours · Trending score 2.19

  10. 10
    risingwavelabs/risingwave

    Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

    GitHub · Rust · 9,425 stars · 868 forks · +7 stars in 24 hours · Trending score 1.85

  11. 11
    argoproj/argo-workflows

    Workflow Engine for Kubernetes

    GitHub · Go · 17,107 stars · 3,741 forks · +5 stars in 24 hours · Trending score 1.81

  12. 12
    Kaelio/ktx

    ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Codex, or other AI agents to query analytical databases accurately and with full context of your company

    GitHub · TypeScript · 1,632 stars · 113 forks · +8 stars in 24 hours · Trending score 1.79

  13. 13
    ssanjaychandra123/data-engineering-patterns

    600+ free patterns and concepts for data engineers on Azure Databricks, Microsoft Fabric, and PySpark. 12 books covering the full stack. Free forever.

    GitHub · 93 stars · 39 forks · +10 stars in 24 hours · Trending score 1.67

  14. 14
    morph-kgc/morph-kgc

    Powerful RDF knowledge graph generation with RML mappings

    GitHub · Python · 303 stars · 62 forks · +8 stars in 24 hours · Trending score 1.62

  15. 15
    semantica-agi/semantica

    Graph-Native Semantic Layer for Trustworthy Enterprise AI

    GitHub · Python · 14,639 stars · 1,737 forks · 0 stars in 24 hours · Trending score 1.55

  16. 16
    apache/devlake

    Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

    GitHub · Go · 3,204 stars · 842 forks · +5 stars in 24 hours · Trending score 1.50

  17. 17
    oracle-samples/oracle-aidp-samples

    Oracle AI Data Platform Workbench Samples

    GitHub · Python · 61 stars · 44 forks · +5 stars in 24 hours · Trending score 1.46

  18. 18
    cocoindex-io/cocoindex

    Incremental engine for long horizon agents 🌟 Star if you like it!

    GitHub · Rust · 11,918 stars · 930 forks · +3 stars in 24 hours · Trending score 1.34

  19. 19
    DataWithBaraa/claude-code-data-engineering-skills

    16 Claude Code skills for data engineers: profile a new source, investigate a failed run, review a change, document the platform. Most end in a page you can share.

    GitHub · HTML · 106 stars · 38 forks · +2 stars in 24 hours · Trending score 1.27

  20. 20
    bitol-io/open-data-contract-standard

    Home of the Open Data Contract Standard (ODCS).

    GitHub · Shell · 1,234 stars · 103 forks · +1 stars in 24 hours · Trending score 1.13

  21. 21
    RyanJHamby/stock-screener

    Automated stock screener scanning 3,800+ stocks daily for confirmed Stage 2 uptrends passing 8 strict criteria. Features: smart caching (74% fewer API calls), market regime filtering, automated stop-loss calculation, and GitHub Actions automation. Follows Mark Minervini's Trend Template.

    GitHub · Python · 73 stars · 58 forks · 0 stars in 24 hours · Trending score 1.11

  22. 22
    dlt-hub/dlt

    data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

    GitHub · Python · 6,098 stars · 664 forks · 0 stars in 24 hours · Trending score 1.09

  23. 23
    DataRecce/recce

    The data-validation toolkit for enhanced dbt (data build tool) PR review

    GitHub · TypeScript · 484 stars · 31 forks · +3 stars in 24 hours · Trending score 1.09

  24. 24
    exmergo/dex

    Dex lets your agent build your analytics.

    GitHub · Python · 136 stars · 70 forks · 0 stars in 24 hours · Trending score 1.07