Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / shangma / ScrapyCrawler
Public GitHub Catalog Discovered Oct 7, 2026

shangma / ScrapyCrawler

Spider to crawl web pages on special sites, developed base on Python + Scrapy.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.

#36214913GitHub System ID
shangmaOrganization / User
PublicVisibility
ActiveCatalog Status

More from shangma

↗

shangma/tushare

TuShare is a utility for crawling historical data of China stocks

Discovered
↗

shangma/python-webscraper

Built a web scraper using the scrapy web framework that scraped various web pages for their sale items and placed them into a mysql database that was utilized by a Django web application

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.