Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / etagwerker / cobweb
Public GitHub Catalog Discovered Oct 1, 2026

etagwerker / cobweb

Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.

#21678460GitHub System ID
etagwerkerOrganization / User
PublicVisibility
ActiveCatalog Status

More from etagwerker

↗

etagwerker/friendly_id

FriendlyId is the “Swiss Army bulldozer” of slugging and permalink plugins for ActiveRecord. It allows you to create pretty URL’s and work with human-friendly strings as if they were numeric ids for ActiveRecord models.

Discovered
↗

etagwerker/haml

HTML Abstraction Markup Language - A Markup Haiku

Discovered
↗

etagwerker/popcorn-app

An experiment using the peerflix module of nodejs and connecting a bunch of APIs.

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.