shirk3y/scrapylib
Collection of Scrapy extensions, middlewares, pipelines & helper functions
Website Fingerprinter
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
Collection of Scrapy extensions, middlewares, pipelines & helper functions
Scrapy, a fast high-level screen scraping and web crawling framework for Python.
A tool for manage website extraction configs
cyclone is a low-level network toolkit, which provides support for HTTP 1.1 in an API very similar to the one implemented by the Tornado web server.