DocumentCode :
2210124
Title :
Automated performance analysis of load tests
Author :
Jiang, Zhen Ming ; Hassan, Ahmed E. ; Hamann, Gilbert ; Flora, Parminder
Author_Institution :
Software Anal. & Intell. Lab. (SAIL), Queen´´s Univ., Kingston, ON, Canada
fYear :
2009
fDate :
20-26 Sept. 2009
Firstpage :
125
Lastpage :
134
Abstract :
The goal of a load test is to uncover functional and performance problems of a system under load. Performance problems refer to the situations where a system suffers from unexpectedly high response time or low throughput. It is difficult to detect performance problems in a load test due to the absence of formally defined performance objectives and the large amount of data that must be examined. In this paper, we present an approach which automatically analyzes the execution logs of a load test for performance problems. We first derive the system´s performance baseline from previous runs. Then we perform an in-depth performance comparison against the derived performance baseline. Case studies show that our approach produces few false alarms (with a precision of 77%) and scales well to large industrial systems.
Keywords :
computer network performance evaluation; systems analysis; automated performance analysis; execution log analyzation; in-depth performance comparison; large industrial system; load test; system performance baseline; system under load performance problem; unexpected high response time; Automatic testing; Computer bugs; Delay; Monitoring; Performance analysis; Software performance; Software testing; System performance; System testing; Throughput;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Software Maintenance, 2009. ICSM 2009. IEEE International Conference on
Conference_Location :
Edmonton, AB
ISSN :
1063-6773
Print_ISBN :
978-1-4244-4897-5
Electronic_ISBN :
1063-6773
Type :
conf
DOI :
10.1109/ICSM.2009.5306331
Filename :
5306331
Link To Document :
بازگشت