Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / st316 / dirbot
Public GitHub Catalog Discovered Sep 27, 2026

st316 / dirbot

Scrapy project to scrape public web directories (educational)

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.

#8998152GitHub System ID
st316Organization / User
PublicVisibility
ActiveCatalog Status

More from st316

↗

st316/scrapy

Scrapy, a fast high-level screen scraping and web crawling framework for Python.

Discovered
↗

st316/OXPath

XPath extension for extraction from interactive web sites. NOTE: This code is currently out of sync. A more recent, but precompiled version is available at http://code.google.com/p/oxpath/. We plan to update the code here soon.

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.