caesar0301/mrmlf
MultilineInputFormat (MLF) for hadoop MapReduce (v2).
Discovered public repositories for caesar0301 in the GitHub catalog.
MultilineInputFormat (MLF) for hadoop MapReduce (v2).
Useful Pig UDFs including bag operations, HTTP analysis, UUID etc.
Similar to tcpdump, but it is just to dump packets header (up to HTTP header end) by sniffing NIC in a live mode.
A database of common file types on Internet. You can use the database files to determine file distirbution in your apps.
A Python wrapper for DetectRight Java API. DetectRight is a tool to extract information from User Agent string. This wrapper is based on Py4J to communicate with official Java library. For native Java API, please visit http://detectright.com/
Using nDPI/openDPI to detect flow protocols from a PCAP file or live NIC. This program was modified from example in nDPI and I added a periodically cleaning of flow tree to save memory.
A simple, cross-platform utility to classify packets into flows using only the essential 4-tuple.
A multi-threading tool to sniff TCP flow statistics and embedded HTTP headers from PCAP file. Each TCP flow carrying HTTP is exported to text file in json format.
A library to parse Wayback Machine of archive.org to get a historical views of web pages. It is a useful tool to research on the evolution of web pages, page structure analysis, and among other interesting topics.
An efficient implementation of tree data structure in pure python.
A collection of tools developed by other researchers in the Computer Science area to process network traces. All the right reserved for the original authors.
Feature generation for web page identification from network traffic with SVM.
This program intends to do the batch testing with WPT and records the results.