pipeline repositories

Trending repositories tagged pipeline, ranked by trending score. Updated daily.

  1. 1
    marimo-team/marimo

    A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

    GitHub · Python · 23,649 stars · 1,413 forks · +50 stars in 24 hours · Trending score 3.28

  2. 2
    kestra-io/kestra

    Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

    GitHub · Java · 30,294 stars · 3,545 forks · +34 stars in 24 hours · Trending score 3.01

  3. 3
    argoproj/argo-cd

    Declarative Continuous Deployment for Kubernetes

    GitHub · Go · 24,665 stars · 8,164 forks · +25 stars in 24 hours · Trending score 2.84

  4. 4
    PrefectHQ/prefect

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    GitHub · Python · 24,192 stars · 2,672 forks · +16 stars in 24 hours · Trending score 2.48

  5. 5
    airbytehq/airbyte

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    GitHub · Python · 22,411 stars · 5,550 forks · +5 stars in 24 hours · Trending score 2.32

  6. 6
    projectdiscovery/httpx

    httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.

    GitHub · Go · 10,633 stars · 1,133 forks · +6 stars in 24 hours · Trending score 2.03

  7. 7
    hexsyro/HonestyPipeline

    Orchestrate 8 data-quality audits into one pipeline and package the results with a data-health score, datasheet, and report.

    GitHub · Python · 77 stars · 1 forks · +9 stars in 24 hours · Trending score 1.75

  8. 8
    StarlightSearch/EmbedAnything

    Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

    GitHub · Rust · 1,329 stars · 140 forks · +10 stars in 24 hours · Trending score 1.75

  9. 9
    apache/hop

    Hop Orchestration Platform

    GitHub · Java · 1,543 stars · 493 forks · +4 stars in 24 hours · Trending score 1.59

  10. 10
    temple-compute/horus-runtime

    Run reproducible scientific workflows anywhere (laptop, remote, or HPC cluster) from a single YAML file. The open-source runtime behind Temple Compute.

    GitHub · Python · 49 stars · 3 forks · +5 stars in 24 hours · Trending score 1.41

  11. 11
    JuliaAI/MLJ.jl

    A Julia machine learning framework

    GitHub · Julia · 1,948 stars · 160 forks · +6 stars in 24 hours · Trending score 1.31

  12. 12
    GeiserX/OwnGenome

    Whole genome sequencing analysis pipeline for consumer hardware. 100% local, Docker-powered, free and open source.

    GitHub · Rust · 28 stars · 6 forks · +3 stars in 24 hours · Trending score 1.27

  13. 13
    kestra-io/docs

    Documentation for Kestra — an event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

    GitHub · Astro · 193 stars · 214 forks · +1 stars in 24 hours · Trending score 1.22

  14. 14
    huangchengsir/pipewright

    Lightweight self-hosted CI/CD + deployment + ops platform in a single Go binary | 轻量自托管 CI/CD·部署·运维一体化平台,单二进制零依赖

    GitHub · Go · 164 stars · 40 forks · +2 stars in 24 hours · Trending score 1.21

  15. 15
    galaxyproject/galaxy

    Data intensive science for everyone.

    GitHub · Python · 1,900 stars · 1,191 forks · +2 stars in 24 hours · Trending score 1.16

  16. 16
    nf-core/sarek

    Analysis pipeline to detect germline or somatic variants (pre-processing, variant calling and annotation) from WGS / targeted sequencing

    GitHub · Nextflow · 622 stars · 566 forks · 0 stars in 24 hours · Trending score 1.15

  17. 17
    andreapollastri/checkpoint

    Laravel Security Tool

    GitHub · PHP · 127 stars · 2 forks · +4 stars in 24 hours · Trending score 1.15

  18. 18
    google/xls

    XLS: Accelerated HW Synthesis

    GitHub · C++ · 1,991 stars · 328 forks · +1 stars in 24 hours · Trending score 1.12

  19. 19
    timeplus-io/proton

    The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.

    GitHub · C++ · 2,286 stars · 112 forks · +3 stars in 24 hours · Trending score 1.10

  20. 20
    dshovchko/job-ripper

    Rips through CPU-heavy file jobs on all cores via worker_threads. Zero deps, zero config. CLI + API

    GitHub · TypeScript · 22 stars · 0 forks · +3 stars in 24 hours · Trending score 0.91

  21. 21
    sametcelikbicak/opencode-team

    AI agent team that takes an idea from research to launch, built on opencode. No framework, no extra dependencies.

    GitHub · PowerShell · 71 stars · 9 forks · 0 stars in 24 hours · Trending score 0.88

  22. 22
    cgwire/kitsu

    Collaboration Platform for Animation and VFX Productions

    GitHub · JavaScript · 770 stars · 188 forks · +1 stars in 24 hours · Trending score 0.79

  23. 23
    tektoncd/pipeline

    A cloud-native Pipeline resource.

    GitHub · Go · 9,110 stars · 1,982 forks · 0 stars in 24 hours · Trending score 0.79

  24. 24
    GoogleCloudPlatform/vertex-ai-samples

    Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

    GitHub · Jupyter Notebook · 798 stars · 323 forks · 0 stars in 24 hours · Trending score 0.76