LeadsPlus/scrapy
Scrapy, a fast high-level screen scraping and web crawling framework for Python.
Encode a set of form elements as a JSON object for manipulation/submission.
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
Scrapy, a fast high-level screen scraping and web crawling framework for Python.
Extensions for using Scrapy on Amazon AWS
A redis-based parallel application
Use scrapy with mongodb to store the request queues (FIFO or LIFO)