Defect coverage analysis of partitioned testing

Research in improving test quality has focused on identifying better fault models and coverage metrics and tools to achieve high coverage. The test generation and test application methodology is usually not considered. We attempt to understand the implication of a test generation and test application methodology, viz, partitioned testing, on product quality. In partitioned testing, patterns are applied to one part of the design while the other parts are maintained in a quiescent state. Quantitative data on several aspects of partitioned testing, using some industrial test cases, are presented. It highlights the need for generating patterns using different partition sizes, generating longer test sequences and the need to include functional testing in the test suite. In addition, we argue that a different metric is needed to evaluate functional pattern quality to cover the gaps identified.