Title :
Using Resampling Techniques to Compute Confidence Intervals for the Harmonic Mean of Rate-Based Performance Metrics
Author :
Patil, Shruti ; Lilja, David J.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Minnesota, Minneapolis, MN, USA
Abstract :
Rate-based metrics such as floating point operations per second, instructions per cycle and so forth are commonly used to measure computer performance. In addition to the average or mean performance of the metric, indicating the precision of the mean using confidence intervals helps to make informed decisions and comparisons with the data. In this paper, we discuss the determination of confidence intervals for the harmonic mean of rate-based metrics using two statistical resampling techniques - Jackknife and Bootstrap. We show using Monte Carlo simulations that resampling indeed works as expected, and can be used for generating confidence intervals for harmonic mean.
Keywords :
Monte Carlo methods; performance evaluation; statistical analysis; Monte Carlo simulations; bootstrap technique; computer performance measurement; confidence intervals; floating point operations; harmonic mean; jackknife technique; rate-based performance metrics; statistical resampling techniques; Nonparametric statistics; Performance of Systems;
Journal_Title :
Computer Architecture Letters
DOI :
10.1109/L-CA.2010.1