huhoo/distribute_crawler
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
The MongoDB Documentation Project Source.
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
a gae proxy forked from gappproxy/wallproxy
MongoDB Connector for Hadoop
USC Version of Hadoop that includes HDFS-RAID. Erasure codes like Simple Regenerating Code, Reed Solomon Code and XOR code are supported