pipeline repositories
Trending repositories tagged pipeline, ranked by trending score. Updated daily.
-
1
marimo-team/marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
GitHub · Python · 23,649 stars · 1,413 forks · +50 stars in 24 hours · Trending score 3.28
-
2
kestra-io/kestra
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
GitHub · Java · 30,294 stars · 3,545 forks · +34 stars in 24 hours · Trending score 3.01
-
3
argoproj/argo-cd
Declarative Continuous Deployment for Kubernetes
GitHub · Go · 24,665 stars · 8,164 forks · +25 stars in 24 hours · Trending score 2.84
-
4
PrefectHQ/prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
GitHub · Python · 24,192 stars · 2,672 forks · +16 stars in 24 hours · Trending score 2.48
-
5
airbytehq/airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
GitHub · Python · 22,411 stars · 5,550 forks · +5 stars in 24 hours · Trending score 2.32
-
6
projectdiscovery/httpx
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
GitHub · Go · 10,633 stars · 1,133 forks · +6 stars in 24 hours · Trending score 2.03
-
7
hexsyro/HonestyPipeline
Orchestrate 8 data-quality audits into one pipeline and package the results with a data-health score, datasheet, and report.
GitHub · Python · 77 stars · 1 forks · +9 stars in 24 hours · Trending score 1.75
-
8
StarlightSearch/EmbedAnything
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
GitHub · Rust · 1,329 stars · 140 forks · +10 stars in 24 hours · Trending score 1.75
-
9
apache/hop
Hop Orchestration Platform
GitHub · Java · 1,543 stars · 493 forks · +4 stars in 24 hours · Trending score 1.59
-
10
temple-compute/horus-runtime
Run reproducible scientific workflows anywhere (laptop, remote, or HPC cluster) from a single YAML file. The open-source runtime behind Temple Compute.
GitHub · Python · 49 stars · 3 forks · +5 stars in 24 hours · Trending score 1.41
-
11
JuliaAI/MLJ.jl
A Julia machine learning framework
GitHub · Julia · 1,948 stars · 160 forks · +6 stars in 24 hours · Trending score 1.31
-
12
GeiserX/OwnGenome
Whole genome sequencing analysis pipeline for consumer hardware. 100% local, Docker-powered, free and open source.
GitHub · Rust · 28 stars · 6 forks · +3 stars in 24 hours · Trending score 1.27
-
13
kestra-io/docs
Documentation for Kestra — an event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
GitHub · Astro · 193 stars · 214 forks · +1 stars in 24 hours · Trending score 1.22
-
14
huangchengsir/pipewright
Lightweight self-hosted CI/CD + deployment + ops platform in a single Go binary | 轻量自托管 CI/CD·部署·运维一体化平台,单二进制零依赖
GitHub · Go · 164 stars · 40 forks · +2 stars in 24 hours · Trending score 1.21
-
15
galaxyproject/galaxy
Data intensive science for everyone.
GitHub · Python · 1,900 stars · 1,191 forks · +2 stars in 24 hours · Trending score 1.16
-
16
nf-core/sarek
Analysis pipeline to detect germline or somatic variants (pre-processing, variant calling and annotation) from WGS / targeted sequencing
GitHub · Nextflow · 622 stars · 566 forks · 0 stars in 24 hours · Trending score 1.15
-
17
andreapollastri/checkpoint
Laravel Security Tool
GitHub · PHP · 127 stars · 2 forks · +4 stars in 24 hours · Trending score 1.15
-
18
google/xls
XLS: Accelerated HW Synthesis
GitHub · C++ · 1,991 stars · 328 forks · +1 stars in 24 hours · Trending score 1.12
-
19
timeplus-io/proton
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
GitHub · C++ · 2,286 stars · 112 forks · +3 stars in 24 hours · Trending score 1.10
-
20
dshovchko/job-ripper
Rips through CPU-heavy file jobs on all cores via worker_threads. Zero deps, zero config. CLI + API
GitHub · TypeScript · 22 stars · 0 forks · +3 stars in 24 hours · Trending score 0.91
-
21
sametcelikbicak/opencode-team
AI agent team that takes an idea from research to launch, built on opencode. No framework, no extra dependencies.
GitHub · PowerShell · 71 stars · 9 forks · 0 stars in 24 hours · Trending score 0.88
-
22
cgwire/kitsu
Collaboration Platform for Animation and VFX Productions
GitHub · JavaScript · 770 stars · 188 forks · +1 stars in 24 hours · Trending score 0.79
-
23
tektoncd/pipeline
A cloud-native Pipeline resource.
GitHub · Go · 9,110 stars · 1,982 forks · 0 stars in 24 hours · Trending score 0.79
-
24
GoogleCloudPlatform/vertex-ai-samples
Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.
GitHub · Jupyter Notebook · 798 stars · 323 forks · 0 stars in 24 hours · Trending score 0.76