Pipeline GitHub Repositories (2026) · Open Source Tools

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Hop Orchestration Platform

httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.

Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

Plumber detects CI/CD security issues in your GitHub workflows and gives you a score

Declarative Continuous Deployment for Kubernetes

XLS: Accelerated HW Synthesis

Machine Learning Pipelines for Kubeflow

🏎️ Streams & Reactive Programming paradigm for Go: declarative and composable API for event-driven applications

bkit Vibecoding Kit - PDCA methodology + Claude Code mastery for AI-native development

A dashboard for Tekton!

A blazing fast tool for building data pipelines: read, process and output events. Our community: https://t.me/file_d_community

PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

A workflow language for data-driven computational pipelines

Kubernetes-native platform to run massively parallel data/streaming jobs

The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.

A micro-library of stream components for building custom JSON and JSONC processing pipelines with a minimal memory footprint — parse, filter, and transform JSON far larger than available memory with a SAX-inspired token API, on Node.js or Web Streams.

Collaboration Platform for Animation and VFX Productions

Kubernetes operator to manage installation, updation and uninstallation of tektoncd projects (pipeline, …)