Title :
NOISEMINER: An algorithm for scalable automatic computational noise and software interference detection
Author :
Dooley, Isaac ; Mei, Chao ; Kale, Laxmikant
Author_Institution :
Dept. of Comput. Sci. Urbana, Univ. of Illinois at Urbana-Champaign, Urbana, IL
Abstract :
This paper describes a new scalable stream mining algorithm called NOISEMINER that analyzes parallel application traces to detect computational noise, operating system interference, software interference, or other irregularities in a parallel application´s performance. The algorithm detects these occurrences of noise during real application runs, whereas standard techniques for detecting noise use carefully crafted test programs to detect the problems. This paper concludes by showing the output of NOISEMINER for a real-world case in which 6 ms delays, caused by a bug in an MPI implementation, significantly limited the performance of a molecular dynamics code on a new supercomputer.
Keywords :
data mining; interference; NOISEMINER; operating system interference; scalable automatic computational noise; software interference detection; stream mining algorithm; Algorithm design and analysis; Application software; Concurrent computing; Interference; Operating systems; Performance analysis; Software algorithms; Software performance; Software systems; Testing;
Conference_Titel :
Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on
Conference_Location :
Miami, FL
Print_ISBN :
978-1-4244-1693-6
Electronic_ISBN :
1530-2075
DOI :
10.1109/IPDPS.2008.4536186