LeadsPlus/scrapy
Scrapy, a fast high-level screen scraping and web crawling framework for Python.
All the patterns
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
Scrapy, a fast high-level screen scraping and web crawling framework for Python.
Extensions for using Scrapy on Amazon AWS
A redis-based parallel application
Use scrapy with mongodb to store the request queues (FIFO or LIFO)