noscripter/hyphe
Websites crawler with built-in exploration and control web interface
Public repository discovered through GitHub real-time crawl.
Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.
Websites crawler with built-in exploration and control web interface
A web scraper with a web user interface which shows scraping stats in realtime. Uses Node.JS, jQuery, socket.io and Express.
A declarative HATEOAS API crawler for node.js
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.