DocumentCode :
2145858
Title :
Statistical Metamorphic Testing Testing Programs with Random Output by Means of Statistical Hypothesis Tests and Metamorphic Testing
Author :
Guderlei, Ralph ; Mayer, Johannes
Author_Institution :
Ulm Univ., Ulm
fYear :
2007
fDate :
11-12 Oct. 2007
Firstpage :
404
Lastpage :
409
Abstract :
Testing software with random output is a challenging task as the output corresponding to a given input differs from execution to execution. Therefore, the usual approaches to software testing are not applicable to randomized software. Instead, statistical hypothesis tests have been proposed for testing those applications. To apply these statistical hypothesis tests, either knowledge about the theoretical values of statistical characteristics of the program output (e. g. the mean) or a reference implementation (e. g. a legacy system) are required to apply statistical hypothesis tests. But often, both are not available. In the present paper, it is discussed how a testing method called Metamorphic Testing can be used to construct statistical hypothesis tests without knowing exact theoretical characteristics or having a reference implementation. For that purpose, two or more independent output sequences are generated by the implementation under test (IUT). Then, these sequences are compared according to the metamorphic relation using statistical hypothesis tests.
Keywords :
program testing; statistical analysis; implementation under test; program testing; random output; randomized software; software testing; statistical hypothesis tests; statistical metamorphic testing; Collaborative software; Context modeling; Error correction; Investments; Probability; Random variables; Software quality; Software testing; Statistical analysis; Statistical distributions;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Quality Software, 2007. QSIC '07. Seventh International Conference on
Conference_Location :
Portland, OR
ISSN :
1550-6002
Print_ISBN :
978-0-7695-3035-2
Type :
conf
DOI :
10.1109/QSIC.2007.4385527
Filename :
4385527
Link To Document :
بازگشت