darthbear/goryproxy
Public repository.
Public GitHub Catalog
Discovered Sep 26, 2026
darthbear / scrapy-redis
Redis-based components for scrapy that allows distributed crawling. Small update to make it work for Scrapy 0.16+ and added QUEUE_TYPE and DUPE_FILTER options
About this discovery
Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.
#6816931GitHub System ID
darthbearOrganization / User
PublicVisibility
ActiveCatalog Status
More from darthbear
darthbear/scrapy-source-ip
Simple scrapy downloader implemented using what is described in http://web.archive.org/web/20120316092048/http://dev.scrapy.org/ticket/153
darthbear/mongo-hadoop
MongoDB adapter for Hadoop. Small mongo hadoop pig patch to allow to use mongodb fields that starts with an underscore by prefixing them with u_ (e.g., u__id instead of _id).
darthbear/scrapy-mongodb-queue
Use scrapy with mongodb to store the request queues (FIFO or LIFO)