sullvn/amerigo
A command-line website crawler which follows the Unix philosphy.
Use of three vector rules to simulate flocking behavior
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
A command-line website crawler which follows the Unix philosphy.
Use a discrete object data-store such as Amazon S3, Google Cloud Storage, or the local filesystem as a buffer.
WIP update of launchpad.net/~prudhvikrishna/goamz/sqs
Draw on websites with a number of sliding pucks