Data Collection GitHub Repositories (2026) · Open Source Tools

Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.

Pluggable data replication with checkpointing, batching, and integrity events

Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

Player Analytics plugin for Minecraft Server platforms - View player activity of your server with ease. :calendar:

99+ CLI tools to build, browse, and blend your media library

An electronic data capture platform for administering remote and in-person clinical instruments