Web Scraping GitHub Repositories (2026) · Open Source Tools

Free Proxy List Updated every 10 minutes

Self-hosted Google search scraper for Python. Scrape Google SERP results with a real Chrome browser and your own residential proxy. Self-hosted SERP API alternative with JSON output, an HTTP API and an MCP server for AI agents.

Apify API client for Python—Programmatically run Actors, manage and stream data from storages (datasets, key-value stores, request queues), schedule and monitor runs, and access the full Apify platform API. Sync and async interfaces with automatic retries and pagination.

Bypass the Cloudflare challenge (Just a moment / 5s) in Python and get a valid cf_clearance cookie via the Peak API - headless-friendly, proxy-aware.

Cloudflare Turnstile challenge internals: the live request flow, the challenge bundle, and a capture toolkit.

Local-first AI agent for Chrome: browser automation, web research, and data extraction with your own model.

A curated directory of job data APIs and scrapers for listings, hiring signals, salaries, and recruiting.

Reddrix is an open-source, blazing-fast Reddit Scraper for Python (No Login or API Key)