shriphani/untargeted-demo
Demo of untargeted crawling
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
Demo of untargeted crawling
Clojure API for Selenium-WebDriver
Simple utils to process corpora downloaded by heritrix and index them with berkeleydb
Sorry about the name