netarchivesuite/heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
Public repository discovered through GitHub real-time crawl.
Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
WARC and ARC indexing and discovery tools.
Adds DocValues to Solr index fields without full re-index
Small wrapper to start/stop and communicate with Heritrix 3.