yfann/dotnet
dotnet is the official home of .NET on GitHub. It's a starting point to find .NET OSS projects from Microsoft, including those that are part of the .NET Foundation.
Public repository discovered through GitHub real-time crawl.
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
dotnet is the official home of .NET on GitHub. It's a starting point to find .NET OSS projects from Microsoft, including those that are part of the .NET Foundation.
MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the items to MongoDB as soon as your spider finds data to extract.
使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现
Public repository.