aboutcode-org/reppy2
Modern robots.txt Parser for Python
URL Transformation, Sanitization
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
Modern robots.txt Parser for Python
:white_check_mark: AboutCode Toolkit provides a simple way to document provenance metadata (origin and license) about third-party code that you use in your project: it includes utilities to generate inventory/BOM or Attribution documentation.
Python PDF Parser based on https://github.com/pdfminer/pdfminer.six updated fork as used in ScanCode