darthbear/goryproxy
Public repository.
Public GitHub Catalog
Discovered Sep 26, 2026
darthbear / scrapy-simple-http-queue
Scrapy Plugin to use the simple http queue as the queue for the URLs in order to allow distributed crawling
About this discovery
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
#7123110GitHub System ID
darthbearOrganization / User
PublicVisibility
ActiveCatalog Status
More from darthbear
darthbear/scrapy-source-ip
Simple scrapy downloader implemented using what is described in http://web.archive.org/web/20120316092048/http://dev.scrapy.org/ticket/153
darthbear/mongo-hadoop
MongoDB adapter for Hadoop. Small mongo hadoop pig patch to allow to use mongodb fields that starts with an underscore by prefixing them with u_ (e.g., u__id instead of _id).
darthbear/scrapy-mongodb-queue
Use scrapy with mongodb to store the request queues (FIFO or LIFO)