Title :
Data Mining on Imbalanced Data Sets
Author :
Gu, Qiong ; Cai, Zhihua ; Zhu, Li ; Huang, Bo
Author_Institution :
Sch. of Comput., China Univ. of Geosci., Wuhan
Abstract :
The majority of machine learning algorithms previously designed usually assume that their training sets are well-balanced, and implicitly assume that all misclassification errors cost equally. But data in real-world is usually imbalanced. The class imbalance problem is pervasive and ubiquitous, causing trouble to a large segment of the data mining community. The tradition machine learning algorithms have bad performance when they learn from imbalanced data sets. Thus, machine learning on imbalanced data sets becomes an urgent problem. The importance of imbalanced data sets and their broad application domains in data mining are introduced, and then methods to deal with the class imbalance problem are discussed and their effectiveness are compared. Last but not least, the existing evaluation measures of class imbalance problem are systematically analyzed.
Keywords :
data analysis; data mining; learning (artificial intelligence); pattern classification; broad application domains; class imbalance problem; data mining; evaluation measures; imbalanced data sets; machine learning; misclassification errors; Algorithm design and analysis; Cancer; Classification algorithms; Costs; Data engineering; Data mining; Diseases; Machine learning; Machine learning algorithms; Radar detection; Cost-Sensitive Learning; Data Mining; Imbalanced data sets; over-sampling; under-sampling;
Conference_Titel :
Advanced Computer Theory and Engineering, 2008. ICACTE '08. International Conference on
Conference_Location :
Phuket
Print_ISBN :
978-0-7695-3489-3
DOI :
10.1109/ICACTE.2008.26