Title :
Filtering, Robust Filtering, Polishing: Techniques for Addressing Quality in Software Data
Author :
Liebchen, G. ; Twala, Bhekisipho ; Shepperd, Martin
Author_Institution :
Brunel Univ., Uxbridge
Abstract :
Data quality is an important aspect of empirical analysis. This paper compares three noise handling methods to assess the benefit of identifying and either filtering or editing problematic instances. We compare a ´do nothing´ strategy with (i) filtering, (ii) robust filtering and (Hi) filtering followed by polishing. A problem is that it is not possible to determine whether an instance contains noise unless it has implausible values. Since we cannot determine the true overall noise level we use implausible val.ues as a proxy measure. In addition to the ability to identify implausible values, we use another proxy measure, the ability to fit a classification tree to the data. The interpretation is low misclassification rates imply low noise levels. We found that all three of our data quality techniques improve upon the ´do nothing´ strategy, also that the filtering and polishing was the most effective technique for dealing with noise since we eliminated the fewest data and had the lowest misclassification rates. Unfortunately the polishing process introduces new implausible values. We believe consideration of data quality is an important aspect of empirical software engineering. We have shown that for one large and complex real world data set automated techniques can help isolate noisy instances and potentially polish the values to produce better quality data for the analyst. However this work is at a preliminary stage and it assumes that the proxy measures of lity are appropriate.
Keywords :
pattern classification; software quality; tree data structures; classification tree; data cleaning; noise handling method; polishing process; robust filtering technique; software data quality; software engineering; Africa; Classification tree analysis; Filtering; Noise level; Noise measurement; Noise robustness; Software engineering; Software measurement; Software quality; Statistical analysis; data editing; data quality; filtering; polishing; pruning; robust algorithms.; software engineering;
Conference_Titel :
Empirical Software Engineering and Measurement, 2007. ESEM 2007. First International Symposium on
Conference_Location :
Madrid
Print_ISBN :
978-0-7695-2886-1
DOI :
10.1109/ESEM.2007.70