arpit12/SparkMultiTool
Tools for spark which we use on the daily basis
A simple crawler in python
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
Tools for spark which we use on the daily basis
A python web crawler
Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py
MongoDB Ecosystem Documentation