Title :
The relationship between test coverage and reliability
Author :
Malaiya, Yashwant K. ; Li, Naixin ; Bieman, Jim ; Karcich, Rick ; Skibbe, Bob
Author_Institution :
Dept. of Comput. Sci., Colorado State Univ., Fort Collins, CO, USA
Abstract :
Models the relationship between testing effort, coverage and reliability, and presents a logarithmic model that relates testing effort to test coverage: statement (or block) coverage, branch (or decision) coverage, computation use (c-use) coverage, or predicate use (p-use) coverage. The model is based on the hypothesis that the enumerables (like branches or blocks) for any coverage measure have different detectability, just like the individual defects. This model allows us to relate a test coverage measure directly to the defect coverage. Data sets for programs with real defects are used to validate the model. The results are consistent with the known inclusion relationships among block, branch and p-use coverage measures. We show how the defect density controls the time-to-next-failure. The model can eliminate variables like the test application strategy from consideration. It is suitable for high-reliability applications where automatic (or manual) test generation is used to cover enemerables which have not yet been tested
Keywords :
program testing; software fault tolerance; software metrics; software reliability; automatic test generation; block coverage; branch coverage; c-use coverage; computation use coverage; decision coverage; defect coverage; defect density; enumerables detectability; high-reliability applications; inclusion relationships; logarithmic model; p-use coverage; predicate use coverage; software reliability; software test coverage; statement coverage; test application strategy; test coverage measure; testing effort; time-to-next-failure; Application software; Automatic control; Automatic testing; Computer science; Predictive models; Software measurement; Software systems; Software testing; Space technology; System testing;
Conference_Titel :
Software Reliability Engineering, 1994. Proceedings., 5th International Symposium on
Conference_Location :
Monterey, CA
Print_ISBN :
0-8186-6665-X
DOI :
10.1109/ISSRE.1994.341373