josenavas / QIIME-Scaling

The goal of this project is to produce an estimator for runtime and memory consumption: (runtime, memory) = f(script_name, number_of_observations, number_of_samples, sparsity). This estimator will be based off of empirical results from standard test data sets (to be created, described below) and validated with real world datasets. Once in place, we can then use this estimator to a) improve resource utilization on both growler and compy b) determine what scripts to target for optimization.