netarchivesuite/heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
Adds DocValues to Solr index fields without full re-index
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
WARC and ARC indexing and discovery tools.
Small wrapper to start/stop and communicate with Heritrix 3.
Common web archive utility code.