Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / markprovan / cobweb
Public GitHub Catalog Discovered Sep 29, 2026

markprovan / cobweb

Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.

#14305252GitHub System ID
markprovanOrganization / User
PublicVisibility
ActiveCatalog Status

More from markprovan

FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.