Identifying and Correcting Mislabeled Training Instances

In order to form a good generalization from a set of training instances, a clean training dataset is important. Unfortunately, real world data is never as perfect as we would like it to be and can often suffered from corruptions. In this paper, a new approach is proposed to identify and correct mislabeled training instances. For a given instance, we employ a Bayesian classifier to evaluate the probabilities of the instance belonging to all considered class labels. Then information entropy calculated from the probability distributions is used to evaluate the typicality of the instance belonging to considered class labels. Finally, the instance with low entropy, but with error prediction result, would be identified as mislabeled instance. Experimental results indicate that our approach gains comparative or better performance than previous techniques.