Title :
Unsupervised and Semi-supervised Lagrangian Support Vector Machines with Polyhedral Perturbations
Author :
Zhao, Kun ; Liu, Yongsheng ; Deng, Naiyang
Author_Institution :
Logistics Sch., Beijing Wuzi Univ., Beijing, China
Abstract :
Support vector machines (SVMs) have been dominant learning techniques for more than ten years, and mostly applied to supervised learning problems. These years two-class unsupervised and semi-supervised classification algorithms based on bounded C-SVMs, bounded ¿-SVMs and Lagrangian SVMs (LSVMs) respectively, which are relaxed to semi-definite programming (SDP), get good classification results. These support vector methods implicitly assume that training data in the optimization problems to be known exactly. But in practice, the training data are usually subjected to measurement noise. Zhao et al proposed robust version to Bounded C - SVMs, Bounded ¿-SVMs and Lagrangian SVMs (LSVMs) respectively with perturbations in convex polyhedrons and ellipsoids. The region of perturbation in the methods mentioned above is not general, and there are many perturbations in non-convex regions in practice. Therefore we proposed unsupervised and semi-supervised classification problems based on Lagrangian Support Vector Machines with general polyhedral perturbations. But the problem has difficulty to compute, we will find its semi-definite relaxation that can approximate it well. Numerical results confirm the robustness of the proposed method.
Keywords :
mathematical programming; pattern classification; support vector machines; unsupervised learning; convex polyhedrons; ellipsoids; learning technique; optimization problem; polyhedral perturbation; semidefinite programming; semidefinite relaxation; semisupervised Lagrangian support vector machines; semisupervised classification; supervised learning; unsupervised Lagrangian support vector machines; unsupervised classification; Classification algorithms; Lagrangian functions; Machine learning; Noise measurement; Noise robustness; Optimization methods; Supervised learning; Support vector machine classification; Support vector machines; Training data; Lagrangian Support Vector Machines; Semi-definite Programming; polyhedral perturbation; unsupervised;
Conference_Titel :
Intelligent Information Technology Application, 2009. IITA 2009. Third International Symposium on
Conference_Location :
Nanchang
Print_ISBN :
978-0-7695-3859-4
DOI :
10.1109/IITA.2009.200