jwills/mrjob
Run MapReduce jobs on Hadoop or Amazon Web Services
Developer Profile
jwills
Discovered public repositories for jwills in the GitHub catalog.
jwills/exhibit
A prototype of Hive UDFs/UDTFs that execute nested SQL queries within rows.
jwills/scrunch-demo
Word count done with the Scrunch (Apache Crunch for Scala) library.
jwills/scalding
A Scala API for Cascading
jwills/brickhouse
Hive UDF's for the data warehouse
jwills/elephant-bird
Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.
jwills/impala-udf-devel
Impala SDK for UDF development
jwills/crunch-demo
A demo application for getting started with Apache Crunch.
jwills/incubator-spark
Mirror of Apache Spark
jwills/lineage
An R package for tracking the transformations applied to the vectors in a data frame.
jwills/oryx
Simple real-time large-scale machine learning infrastructure.
jwills/summingbird
Streaming MapReduce with Scalding and Storm
jwills/spark
Lightning-fast cluster computing in Java, Scala and Python.
jwills/driskill
Either[Hotel in Austin, Prototype of a Scala Distributed Collections API]
jwills/attribution
MapReduce job for creating multitouch attribution models.
jwills/parquet-mr
Java implementation to use with Map-Reduce
jwills/BlueSNP
BlueSNP
jwills/RHIPE
RHIPE: The R and Hadoop Integrated Processing Environment
jwills/spatial-framework-for-hadoop
The Spatial Framework for Hadoop allows developers and data scientists to use the Hadoop data processing system for spatial data analysis.
jwills/ml
The Cloudera Data Science Team's Machine Learning Toolkit and APIs.
jwills/seqserver
Experiments w/the Play Framework to create servers for performing lookups into SequenceFiles stored in HDFS.
jwills/avro-json
Utilities for converting to and from JSON from Avro records via Hadoop streaming or Hive.
jwills/avro-json-serde
A wrapper that uses the Hive AvroSerDe to deserialize data as JSON for use with Hive Streaming
jwills/avrostarter
A starter template for Avro + Maven projects
jwills/avro
Mirror of Apache Avro
jwills/crackle
Clojure wrapper for Apache Crunch
jwills/luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
jwills/RecordBreaker
Record Breaker
jwills/crunchR
Public repository.
jwills/gatk
GATK Official Release Repository
jwills/seismichadoop
System for performing seismic data processing on a Hadoop cluster.
jwills/kitten
The fast and fun way to write YARN applications.
jwills/trevni
a column file format
jwills/scoobi
A Scala productivity framework for Hadoop.
jwills/flume
Mirror of Apache Flume
jwills/hive
Mirror of Apache Hive
jwills/cdh-mapreduce-ext
Classes in the new mapreduce.* API that are not part of CDH3 yet.
jwills/datafu
Hadoop library for large-scale data processing
jwills/avroplay
Me messing around with some Avro stuff