On the Consensus-Based Application of Fault Localization Techniques

A vast number of software fault localization techniques have been proposed recently with the growing realization that manual debugging is time-consuming, tedious and error-prone, and fault localization is one of the most expensive debugging activities. While some of these techniques perform better than one another on a large number of data sets, they do not do so on all data sets and therefore, the actual quality of fault localization can vary considerably by using just one technique. This paper proposes the use of a consensus-based strategy that combines the results of multiple fault localization techniques, to consistently provide high quality performance, irrespective of data set. Empirical evidence based on case studies conducted on three sets of programs (the seven programs of the Siemens suite, and the gzip and make programs) and three different fault localization techniques suggests that the consensus-based strategy holds merit and generally provides close to the best, if not the best, results. Additionally the consensus-based strategy makes use of techniques that all operate on the same set of input data, minimizing the overhead. It is also simple to include or exclude techniques from consensus, making it an easily extensible, or alternatively, tractable strategy.