Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / gregpatton / RobotsReader
Public GitHub Catalog Discovered Sep 29, 2026

gregpatton / RobotsReader

A quick and dirty rewrite of Parsero for Python 2.7 that evaluates the Disallow entries of a robots.txt file for a given website.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.

#15423135GitHub System ID
gregpattonOrganization / User
PublicVisibility
ActiveCatalog Status

More from gregpatton

↗

gregpatton/XMLFileMerger

Simple VB.NET XML File Merge Applicaiton. The WinForm takes two .xml files as input and merges them into 1 output .xml file.

Discovered
↗

gregpatton/burpSaveUrlList

A Burp Suite jython extension that saves a URL List from the Burp Proxy History or Burp Target Site Map as a text file.

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.