Title :
Automated performance analysis of load tests
Author :
Jiang, Zhen Ming ; Hassan, Ahmed E. ; Hamann, Gilbert ; Flora, Parminder
Author_Institution :
Software Anal. & Intell. Lab. (SAIL), Queen´´s Univ., Kingston, ON, Canada
Abstract :
The goal of a load test is to uncover functional and performance problems of a system under load. Performance problems refer to the situations where a system suffers from unexpectedly high response time or low throughput. It is difficult to detect performance problems in a load test due to the absence of formally defined performance objectives and the large amount of data that must be examined. In this paper, we present an approach which automatically analyzes the execution logs of a load test for performance problems. We first derive the system´s performance baseline from previous runs. Then we perform an in-depth performance comparison against the derived performance baseline. Case studies show that our approach produces few false alarms (with a precision of 77%) and scales well to large industrial systems.
Keywords :
computer network performance evaluation; systems analysis; automated performance analysis; execution log analyzation; in-depth performance comparison; large industrial system; load test; system performance baseline; system under load performance problem; unexpected high response time; Automatic testing; Computer bugs; Delay; Monitoring; Performance analysis; Software performance; Software testing; System performance; System testing; Throughput;
Conference_Titel :
Software Maintenance, 2009. ICSM 2009. IEEE International Conference on
Conference_Location :
Edmonton, AB
Print_ISBN :
978-1-4244-4897-5
Electronic_ISBN :
1063-6773
DOI :
10.1109/ICSM.2009.5306331