Built something? We create video reels & spotlights for GitHub projects.Promote your project →
>GitHubRepo
Promote your project
Catalog / lemig / cobweb
Public GitHub Catalog Discovered Oct 6, 2026

lemig / cobweb

Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.

#33819134GitHub System ID
lemigOrganization / User
PublicVisibility
ActiveCatalog Status

More from lemig

FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.

Promote your project