Title :
We have it easy, but do we have it right?
Author :
Mytkowicz, Todd ; Diwan, Amer ; Hauswirth, Matthias ; Sweeney, Peter
Author_Institution :
Univ. of Colorado, Boulder, CO
Abstract :
We show two severe problems with the state of the art in empirical computer system performance evaluation, observer effect and measurement context bias, and we outline the path toward a solution.
Keywords :
measurement; performance evaluation; computer system performance evaluation; measurement context bias; observer effect; Costs; Hardware; Humans; Measurement standards; Particle measurements; Performance analysis; Probes; System performance; Technological innovation; Time measurement;
Conference_Titel :
Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on
Conference_Location :
Miami, FL
Print_ISBN :
978-1-4244-1693-6
Electronic_ISBN :
1530-2075
DOI :
10.1109/IPDPS.2008.4536408
