Batch GitHub Repositories (2026) · Open Source Tools

Fast, reliable download accelerator and video downloader since 2013

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Spring Batch is a framework for writing batch applications using Java and Spring

Apache Beam is a unified programming model for Batch and Streaming data processing.

ActiveRecord PostgreSQL Adapter extension for using a cursor to return a large result set

A Java 11 port of Facebook DataLoader

JobSet: a k8s native API for distributed ML training and HPC workloads

Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake

Process millions of records across thousands of workers.

The Open Source 3D Reconstruction Toolbox for Gaussian Splats provides an end-to-end, pipeline-based guidance on AWS to reconstruct 3D scenes or objects from images or video inputs.

Flink CDC is a streaming data integration tool

Serverless batch computing made simple.