WebMole/crawler-benchmark
A Reference Framework for the Automated Exploration of Web Applications. Provides some general web features to let you test crawlers in a well defined environment.
Webmole's Website :)
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
A Reference Framework for the Automated Exploration of Web Applications. Provides some general web features to let you test crawlers in a well defined environment.
Catch ajax calls in an iframe
µ-Crawler is a basic and tiny crawler that uses the Web-State-Machine algorithms.
A tool to test temporal properties on page attributes using formal notation to express constraints along a sequence of states