Title :
An incremental approach to genetic-algorithms-based classification
Author :
Guan, Sheng-Uei ; Zhu, Fangming
Author_Institution :
Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore
fDate :
4/1/2005 12:00:00 AM
Abstract :
Incremental learning has been widely addressed in the machine learning literature to cope with learning tasks where the learning environment is ever changing or training samples become available over time. However, most research work explores incremental learning with statistical algorithms or neural networks, rather than evolutionary algorithms. The work in this paper employs genetic algorithms (GAs) as basic learning algorithms for incremental learning within one or more classifier agents in a multiagent environment. Four new approaches with different initialization schemes are proposed. They keep the old solutions and use an "integration" operation to integrate them with new elements to accommodate new attributes, while biased mutation and crossover operations are adopted to further evolve a reinforced solution. The simulation results on benchmark classification data sets show that the proposed approaches can deal with the arrival of new input attributes and integrate them with the original input space. It is also shown that the proposed approaches can be successfully used for incremental learning and improve classification rates as compared to the retraining GA. Possible applications for continuous incremental training and feature selection are also discussed.
Keywords :
feature extraction; genetic algorithms; learning (artificial intelligence); multi-agent systems; neural nets; pattern classification; software agents; statistical analysis; classifier agent; evolutionary algorithm; feature selection; genetic-algorithms-based classification; incremental learning; machine learning; multiagent environment; neural network; statistical algorithm; Evolutionary computation; Genetic algorithms; Genetic mutations; Genetic programming; Machine learning; Machine learning algorithms; Neural networks; Pattern classification; Software agents; Training data; Classifier agents; genetic algorithms (GAs); incremental learning; Algorithms; Artificial Intelligence; Cluster Analysis; Computer Simulation; Models, Statistical; Numerical Analysis, Computer-Assisted; Pattern Recognition, Automated;
Journal_Title :
Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on
DOI :
10.1109/TSMCB.2004.842247