Title :
P-norm regularized SVM classifier by non-convex conjugate gradient algorithm
Author :
Zuo Xin ; Huang Hailong ; Li Haien ; Liu Jianwei
Author_Institution :
Res. Inst. of Autom., China Univ. of Pet., Beijing, China
Abstract :
Classical classification algorithm of SVM via p norm regularization usually takes p as 0, 1 or 2. However, these parameters can´t always achieve the best classification results. Some scholars have discussed the situations of p∈ (0,1, 2), where the problem is transformed into the standard quadratic programming. However, when p∈(0,1], the object is non-convex, and the method of quadratic programming is not suitable. From the point of optimization, we use Conjugate Gradient Algorithm to solve the problem. In this paper, two different kinds of SVM have been discussed and the classification results are shown by the experiments on three cancer datasets. At last, we discussed the problem of feature selection. The experiment results show that, feature selection can not only keep the precision of the prediction but also reduce model complexity.
Keywords :
concave programming; learning (artificial intelligence); pattern classification; quadratic programming; support vector machines; P-norm regularized SVM classifier; feature selection; nonconvex conjugate gradient algorithm; nonconvexprogramming; optimization; standard quadratic programming; Bladder; Classification algorithms; Colon; Error analysis; Fasteners; Linear programming; Support vector machines; 0<p<l; Conjugate gradient algorithm; Feature Selection; Lp-norm; SVM;
Conference_Titel :
Control and Decision Conference (CCDC), 2013 25th Chinese
Conference_Location :
Guiyang
Print_ISBN :
978-1-4673-5533-9
DOI :
10.1109/CCDC.2013.6561396