Program to Perform Bootstrap Resampling
Resampling techniques incorporate the correlations of the original data set, and thus tend to be more powerful than their classical counterparts on certain types of data sets (skewed).
The bootstrap program resamples independently per listener (blocked analysis) by default. This increases power by assuming that the ratings a listener produces are correlated with each other, although the range of values used by a particular listener don't necessarily correspond to the range used by another.
The program adjusts the p-values to take into account that multiple measurements increase the chances that a significant result in a single comparison between two codecs may not be significant in the context of the overall experiment. The program currently uses a free step-down p-value adjustment, but in the future will use a more powerful restricted p-value adjustment technique.