demonlife/distribute_crawler
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
Public GitHub Catalog
Discovered Oct 7, 2026
demonlife / iosdev_sample
Public repository discovered through GitHub real-time crawl.
About this discovery
Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.
#36534301GitHub System ID
demonlifeOrganization / User
PublicVisibility
ActiveCatalog Status
More from demonlife
demonlife/http-api-guide
Public repository.
demonlife/scrapy-redis
Redis-based components for scrapy that allows distributed crawling
demonlife/spacemacs
Emacs advanced Kit focused on Evil: The best editor is neither Emacs nor Vim, it's Emacs *and* Vim!