# darzuaga/cobweb

> Web crawler with very flexible crawling options.  Can either use standalone or can be used with resque to perform clustered crawls.

- **Canonical URL**: https://githubrepo.cloud/repo/darzuaga/cobweb
- **GitHub Repository**: https://github.com/darzuaga/cobweb
- **Maintainer / Creator**: https://github.com/darzuaga
- **Discovered On**: Oct 3, 2026

---
*Indexed by GitHubRepo (https://githubrepo.cloud). Real-time open-source discovery & telemetry.*