Discover the best Data Extraction open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
Turn any website into a structured API. Extract, automate, search and monitor the web.
Extract structured data and insights from documents using LLMs and decision models
Pure Rust PDF library for AI/RAG: structure-aware chunking, no ML, no C deps.
The "Missing GitHub Status Page" -- a Flat Data attempt at historically documenting GitHub statuses