Top PIPELINE GitHub Repositories & Tools (2026)

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

Workflow Engine for Kubernetes

A modular, extensible 2D game framework for .NET.

Preprocessing of diffusion MRI

A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.

A blazing fast tool for building data pipelines: read, process and output events. Our community: https://t.me/file_d_community

Kubernetes-native platform to run massively parallel data/streaming jobs

Where data access meets operational intelligence