netarchivesuite/heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
Public repository discovered through GitHub real-time crawl.
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
WARC and ARC indexing and discovery tools.
Adds DocValues to Solr index fields without full re-index
Small wrapper to start/stop and communicate with Heritrix 3.