noiano/ARCInputFormat
Packages the ARCInputFormat used in Common Crawl in a small jar file that can be used in MapReduce jobs. Implements HdfsARCSource. See README for details
Discovered public repositories for noiano in the GitHub catalog.
Packages the ARCInputFormat used in Common Crawl in a small jar file that can be used in MapReduce jobs. Implements HdfsARCSource. See README for details
CommonCrawl Project Repository
Simple utility to convert an existing compressed file in an Hadoop SequenceFile