data-transformation repositories

Trending repositories tagged data-transformation, ranked by trending score. Updated daily.

  1. 1
    vectordotdev/vector

    A high-performance observability data pipeline.

    GitHub · Rust · 22,918 stars · 2,405 forks · +22 stars in 24 hours · Trending score 2.78

  2. 2
    bruin-data/bruin

    Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

    GitHub · Go · 1,815 stars · 101 forks · +6 stars in 24 hours · Trending score 1.55

  3. 3
    apache/camel

    Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.

    GitHub · Java · 6,416 stars · 5,186 forks · +2 stars in 24 hours · Trending score 1.32

  4. 4
    malloydata/publisher

    Publisher is the open-source analytics engine for Malloy. It lets you define data models once — and use them everywhere.

    GitHub · TypeScript · 134 stars · 33 forks · +1 stars in 24 hours · Trending score 0.63

  5. 5
    sqlstack-io/sqlbuild

    SQL transformation framework with custom compile-time checks, end-to-end testing and safe renames that keep your table history.

    GitHub · Rust · 50 stars · 3 forks · +1 stars in 24 hours · Trending score 0.55

  6. 6
    slothflowlabs/duckle

    Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 446 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

    GitHub · Rust · 1,557 stars · 121 forks · −16 stars in 24 hours · Trending score 0.41

  7. 7
    apache/camel-examples

    Apache Camel Examples

    GitHub · Java · 489 stars · 384 forks · 0 stars in 24 hours · Trending score 0.39

  8. 8
    apache/camel-kamelets

    Apache Camel Kamelets Repository

    GitHub · Java · 74 stars · 91 forks · 0 stars in 24 hours · Trending score 0.24

  9. 9
    xorq-labs/xorq

    The ledger for agentic data work.

    GitHub · Python · 559 stars · 40 forks · 0 stars in 24 hours · Trending score 0.24

  10. 10
    mahmoudparsian/big-data-modeling

    Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University

    GitHub · HTML · 167 stars · 144 forks · 0 stars in 24 hours · Trending score 0.20

  11. 11
    apache/camel-spring-boot

    Runs Camel on Spring Boot and provides starters for Camel components

    GitHub · Java · 189 stars · 207 forks · 0 stars in 24 hours · Trending score 0.10

  12. 12
    apache/camel-quarkus

    Apache Camel Quarkus

    GitHub · Java · 304 stars · 236 forks · −1 stars in 24 hours · Trending score 0.10

  13. 13
    dry-rb/dry-transformer

    Data transformation toolkit

    GitHub · Ruby · 89 stars · 10 forks · 0 stars in 24 hours · Trending score 0.09

  14. 14
    apache/camel-quarkus-examples

    Apache Camel Quarkus Examples

    GitHub · Java · 93 stars · 139 forks · 0 stars in 24 hours · Trending score 0.05

  15. 15
    apache/camel-spring-boot-examples

    Apache Camel Spring Boot Examples

    GitHub · Java · 362 stars · 377 forks · 0 stars in 24 hours · Trending score 0.03

  16. 16
    azukds/tubular

    Python package implementing ML feature engineering and pre-processing for polars or pandas dataframes.

    GitHub · Python · 109 stars · 30 forks · 0 stars in 24 hours · Trending score 0.03

  17. 17
    ToucanToco/weaverbird

    A visual data pipeline builder with various backends

    GitHub · TypeScript · 106 stars · 16 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    nicosuave/awesome-sqlmesh

    A curated list of awesome SQLMesh resources

    GitHub · 56 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    ciaren-labs/Ciaren

    Open-source, local-first visual ETL and data pipeline builder. Drag-and-drop data prep and ML workflows, preview every step, schedule runs, and export clean pandas or Polars Python code. Self-hosted, no lock-in.

    GitHub · Python · 37 stars · 12 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    microsoft/prose

    Microsoft Program Synthesis using Examples SDK is a framework of technologies for the automatic generation of programs from input-output examples. This repo includes samples and sample data for the Microsoft Program Synthesis using Example SDK.

    GitHub · C# · 665 stars · 101 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    fastverse/fastverse

    An Extensible Suite of High-Performance and Low-Dependency Packages for Statistical Computing and Data Manipulation in R

    GitHub · R · 344 stars · 25 forks · 0 stars in 24 hours · Trending score 0.00