Strategies for benchmarking with optimizing compilers

It is pointed out that better compiler optimizations often interfere with the intended operation of certain classes of benchmarks, leading to surprising results and rendering their interpretation a most difficult task. The authors present several such optimizations and show their effects on selected benchmarks. They also offer guidelines for the creation or selection of benchmarks that facilitate the interpretation of the measurements obtained