Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Home / Developers / feihugis
Developer Profile

feihugis

Discovered public repositories for feihugis in the GitHub catalog.

↗

feihugis/hdfs-raid

Keeping three copies of the same data is very costly, especially when the size of storage is huge. One idea is to reduce the replication factor and do erasure coding of a set of blocks so that the over probability of failure of a block remains the same as before. Many forms of error-correcting codes are available, see http://en.wikipedia.org/wiki/Erasure_code. Also, recent research from CMU has described DiskReduce https://opencirrus.org/system/files/Gibson-OpenCirrus-June9-09.ppt. An idea is to discuss implementation strategies that are not part of base HDFS, but is a layer on top of HDFS.

↗

feihugis/hadoop-20

Facebook's Realtime Distributed FS based on Apache Hadoop 0.20-append

↗

feihugis/weka

GitHub clone of SVN repo https://svn.cms.waikato.ac.nz/svn/weka/ (cloned by http://svn2github.com/)

↗

feihugis/SciHadoop

Integration code to enable Hadoop processing of data in NetCDF format

FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.