Title :
An entropy-based adaptive genetic algorithm for learning classification rules
Author :
Yang, Linyu ; Widyantoro, Dwi H. ; Ioerger, Thomas ; Yen, John
Author_Institution :
Dept. of Comput. Sci., Texas A&M Univ., College Station, TX, USA
Abstract :
The genetic algorithm is one of the commonly used approaches to data mining. We propose a genetic algorithm approach for classification problems. Binary coding is adopted in which an individual in a population consists of a fixed number of rules that stand for a solution candidate. The evaluation function considers four important factors which are error rate, entropy measure, rule consistency and hole ratio, respectively. Adaptive asymmetric mutation is applied by the self-adaptation of mutation inversion probability from 1-0 (0-1). The generated rules are not disjoint but can overlap. The final conclusion for prediction is based on the voting of rules and the classifier gives all rules equal weight for their votes. Based on three databases, we compared our approach with several other traditional data mining techniques including decision trees, neural networks and naive bayes learning. The results show that our approach outperformed others in both prediction accuracy and the standard deviation
Keywords :
data mining; genetic algorithms; learning systems; pattern classification; adaptive asymmetric mutation; binary coding; classification problems; data mining; decision trees; entropy measure; entropy-based adaptive genetic algorithm; error rate; genetic algorithm; hole ratio; learning classification rules; naive bayes learning; neural networks; prediction accuracy; rule consistency; standard deviation; Accuracy; Data mining; Databases; Decision trees; Entropy; Error analysis; Genetic algorithms; Genetic mutations; Neural networks; Voting;
Conference_Titel :
Evolutionary Computation, 2001. Proceedings of the 2001 Congress on
Conference_Location :
Seoul
Print_ISBN :
0-7803-6657-3
DOI :
10.1109/CEC.2001.934271