Author_Institution :
Naval Postgrad. Sch., Monterey, CA, USA
Abstract :
A comprehensive metrics validation methodology is proposed that has six validity criteria, which support the quality functions assessment, control, and prediction, where quality functions are activities conducted by software organizations for the purpose of achieving project quality goals. Six criteria are defined and illustrated: association, consistency, discriminative power, tracking, predictability, and repeatability. The author shows that nonparametric statistical methods such as contingency tables play an important role in evaluating metrics against the validity criteria. Examples emphasizing the discriminative power validity criterion are presented. A metrics validation process is defined that integrates quality factors, metrics, and quality functions
Keywords :
program verification; quality control; software metrics; software reliability; comprehensive metrics validation methodology; contingency tables; discriminative power; discriminative power validity criterion; metrics validation process; nonparametric statistical methods; predictability; project quality goals; quality functions; repeatability; software metrics; software organizations; tracking; validity criteria; Performance analysis; Phase measurement; Power engineering and energy; Q factor; Quality assessment; Software measurement; Software metrics; Software quality; Statistical analysis; Time measurement;