dataflow repositories

Trending repositories tagged dataflow, ranked by trending score. Updated daily.

  1. 1
    marimo-team/marimo

    A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

    GitHub · Python · 23,657 stars · 1,413 forks · +37 stars in 24 hours · Trending score 3.15

  2. 2
    alldatacenter/alldata

    🔥🔥 AllData大模型与AI数据底座,以数据平台为底座,以数据中台为桥梁,以机器学习平台为工厂,以大模型应用为上游产品,提供全链路数字化解决方案。 产品手册:https://www.yuque.com/aolingdata/product 产品演示+AI社群+商务采购:https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo

    GitHub · Java · 3,138 stars · 983 forks · +34 stars in 24 hours · Trending score 2.54

  3. 3
    dora-rs/dora

    DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.

    GitHub · Rust · 4,100 stars · 484 forks · +5 stars in 24 hours · Trending score 1.79

  4. 4
    joernio/joern

    Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc

    GitHub · Scala · 3,656 stars · 476 forks · +4 stars in 24 hours · Trending score 1.42

  5. 5
    kestra-io/docs

    Documentation for Kestra — an event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

    GitHub · Astro · 193 stars · 214 forks · +1 stars in 24 hours · Trending score 1.21

  6. 6
    nipy/nipype

    Workflows and interfaces for neuroimaging packages

    GitHub · Python · 837 stars · 546 forks · +2 stars in 24 hours · Trending score 1.06

  7. 7
    nextflow-io/nextflow

    A workflow language for data-driven computational pipelines

    GitHub · Groovy · 3,530 stars · 824 forks · 0 stars in 24 hours · Trending score 0.61

  8. 8
    frank890417/WebToe

    Web-native dataflow engine for real-time visuals — patch in the browser, TouchDesigner-style, and import your .toe projects. WebGL2 + WebGPU, zero dependencies.

    GitHub · TypeScript · 27 stars · 3 forks · +1 stars in 24 hours · Trending score 0.45

  9. 9
    vectaport/flowgraph

    Flowgraph package for scalable asynchronous system development

    GitHub · Go · 68 stars · 9 forks · +1 stars in 24 hours · Trending score 0.45

  10. 10
    pathwaycom/pathway

    Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

    GitHub · Python · 61,981 stars · 1,684 forks · +1 stars in 24 hours · Trending score 0.41

  11. 11
    bytewax/bytewax

    Python Stream Processing

    GitHub · Python · 2,074 stars · 114 forks · 0 stars in 24 hours · Trending score 0.40

  12. 12
    receptron/graphai

    GraphAI is an asynchronous data flow execution engine, which allows developers to build agentic applications by describing agent workflows as declarative data flow graphs in YAML or JSON.

    GitHub · TypeScript · 375 stars · 54 forks · 0 stars in 24 hours · Trending score 0.40

  13. 13
    Bearer/bearer

    Code security scanning tool (SAST) to discover, filter and prioritize security and privacy risks.

    GitHub · Go · 2,794 stars · 159 forks · 0 stars in 24 hours · Trending score 0.35

  14. 14
    corail-labs/labcraft

    A graphical dataflow programming language and IDE, built in pure Rust. Early development (v0.3.0-m0): the command line reads, checks, runs and draws programs against simulated instruments, an AI agent drives it over MCP, and a read-only viewer runs on the desktop and in the browser.

    GitHub · Rust · 8 stars · 3 forks · 0 stars in 24 hours · Trending score 0.29

  15. 15
    cambra-dev/cambra

    A language and database substrate for coding agents

    GitHub · Rust · 24 stars · 0 forks · 0 stars in 24 hours · Trending score 0.24

  16. 16
    urban-toolkit/curio

    Curio: A Dataflow-Based Framework for Collaborative Urban Visual Analytics

    GitHub · Python · 37 stars · 36 forks · 0 stars in 24 hours · Trending score 0.09

  17. 17
    orhaugh/clink

    A stream processing engine that stays correct when processes die. SQL or typed C++ over event time and keyed state, with exactly-once delivery and twenty-plus connectors: brokers, CDC, databases, lakehouse tables, graphs. The same pipeline runs on a single machine, inside a service or scaled out across a highly available cluster. Arrow-native C++.

    GitHub · C++ · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  18. 18
    asyncvlsi/act

    ACT hardware description language and core tools.

    GitHub · C++ · 130 stars · 32 forks · 0 stars in 24 hours · Trending score 0.05

  19. 19
    kahliburke/KaimonSlate.jl

    A reactive Julia notebook built for ambitious work — distributed compute, agentic AI from day one, high-throughput low-latency streaming to the browser, an extension system that integrates anything, and beautiful rendering, publishing, and standalone exports.

    GitHub · Julia · 36 stars · 6 forks · 0 stars in 24 hours · Trending score 0.01

  20. 20
    microflo/microflo

    Live dataflow programming for microcontrollers and embedded

    GitHub · CoffeeScript · 220 stars · 28 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    nevalang/neva

    Dataflow programming language where you write a program as a message-passing graph and everything runs in parallel by default. It has strong static types, compiles to machine code, interoperates with Go, and supports visual programming with a node editor. Extremely LLM-friendly too.

    GitHub · Go · 1,087 stars · 40 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    wingfoil-io/wingfoil

    ultra low latency graph based stream processing framework

    GitHub · Rust · 230 stars · 35 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    autowarefoundation/callback_isolated_executor

    The ComponentContainer and Executor that assign a dedicated thread for each callback group.

    GitHub · C++ · 79 stars · 12 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    shaiwz/data-platform-open

    🔥🔥🔥可视化拖拽式大数据集成平台、大数据平台、大数据,包含数据流、数据源、数据对齐、查询模板、智能问数、AI集成、完善的监控等。像画流程图一样且无代码方式同步、清洗数据。

    GitHub · Java · 644 stars · 77 forks · 0 stars in 24 hours · Trending score 0.00