• DocumentCode
    75648
  • Title

    MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning

  • Author

    Barua, Simul ; Islam, Md Minarul ; Xin Yao ; Murase, K.

  • Author_Institution
    Dept. of Comput. Sci. & Eng., Bangladesh Univ. of Eng. & Technol. (BUET), Dhaka, Bangladesh
  • Volume
    26
  • Issue
    2
  • fYear
    2014
  • fDate
    Feb. 2014
  • Firstpage
    405
  • Lastpage
    425
  • Abstract
    Imbalanced learning problems contain an unequal distribution of data samples among different classes and pose a challenge to any classifier as it becomes hard to learn the minority class samples. Synthetic oversampling methods address this problem by generating the synthetic minority class samples to balance the distribution between the samples of the majority and minority classes. This paper identifies that most of the existing oversampling methods may generate the wrong synthetic minority samples in some scenarios and make learning tasks harder. To this end, a new method, called Majority Weighted Minority Oversampling TEchnique (MWMOTE), is presented for efficiently handling imbalanced learning problems. MWMOTE first identifies the hard-to-learn informative minority class samples and assigns them weights according to their euclidean distance from the nearest majority class samples. It then generates the synthetic samples from the weighted informative minority class samples using a clustering approach. This is done in such a way that all the generated samples lie inside some minority class cluster. MWMOTE has been evaluated extensively on four artificial and 20 real-world data sets. The simulation results show that our method is better than or comparable with some other existing methods in terms of various assessment metrics, such as geometric mean (G-mean) and area under the receiver operating curve (ROC), usually known as area under curve (AUC).
  • Keywords
    learning (artificial intelligence); pattern clustering; sampling methods; AUC; Euclidean distance; G-mean; MWMOTE-majority weighted minority oversampling technique; ROC; area under curve; clustering approach; geometric mean; hard-to-learn informative minority class samples; imbalanced data set learning; imbalanced learning problems; majority class; minority class cluster; receiver operating curve; synthetic minority class samples; synthetic oversampling methods; weighted informative minority class samples; Abstracts; Boosting; Complexity theory; Interpolation; Noise measurement; Sampling methods; Simulation; Imbalanced learning; clustering; oversampling; synthetic sample generation; undersampling;
  • fLanguage
    English
  • Journal_Title
    Knowledge and Data Engineering, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1041-4347
  • Type

    jour

  • DOI
    10.1109/TKDE.2012.232
  • Filename
    6361394