tonyzhu/django-dynamic-scraper
Creating Scrapy scrapers via the Django admin interface
Redis-based components for scrapy that allows distributed crawling
Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.
Creating Scrapy scrapers via the Django admin interface
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
News, full-text, and article metadata extraction in python 2.6 - 3.4.
Godoc改进版, 支持动态加载翻译文件, 支持Windows后台服务模式运行.