Title :
A training algorithm of incremental supprot vector machine with recombining method [supprot read support]
Author :
Yang, Jing ; Li, Zhong-Wei ; Zhang, Jian-pei
Author_Institution :
Coll. of Comput. Sci. & Technol., Harbin Eng. Univ., China
Abstract :
Support vector machine (SVM) has become a popular tool of pattern recognition in recent years for its outstanding learning performance. When dealing with large-scale learning problems, incremental SVM framework is generally used because SVM can summarize the data space in a concise way. This paper proposes a training algorithm of incremental SVM with recombining method. Considering the differences of data distribution and the impact of new training data on history data, the history training dataset and the new training one are divided into independent groups and are recombined to train a classifier. In fact, this method can be implemented in a parallel structure for the actions of dividing may decrease the computation complexity of training a SVM. Meanwhile, the actions of recombining may weaken the potential impact caused by the difference of data distribution. The experiment results on a text dataset show that this training algorithm is effective and the classification accuracy of proposed incremental algorithm is superior to that using batch SVM model.
Keywords :
computational complexity; learning (artificial intelligence); pattern classification; support vector machines; classifier training; computation complexity; data distribution; history training dataset; incremental learning; incremental supprot vector machine; parallel structure; pattern recognition; recombining method; History; Large-scale systems; Machine learning; Pattern recognition; Risk management; Space technology; Support vector machine classification; Support vector machines; Testing; Training data; Incremental learning; Support Vector Machine; data distribution; dataset recombining;
Conference_Titel :
Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on
Conference_Location :
Guangzhou, China
Print_ISBN :
0-7803-9091-1
DOI :
10.1109/ICMLC.2005.1527690