Title :
Linear programs for automatic accuracy control in regression
Author :
Smola, Alex ; Scholkopf, Bernhard ; Ratsch, Gunnar
Author_Institution :
GMD FIRST, Berlin, Germany
Abstract :
We have recently proposed a new approach to control the number of basis functions and the accuracy in support vector machines. The latter is transferred to a linear programming setting, which inherently enforces sparseness of the solution. The algorithm computes a nonlinear estimate in terms of kernel functions and an ε>0 with the property that at most a fraction ν of the training set has an error exceeding ε. The algorithm is robust to local perturbations of these points´ target values. We give an explicit formulation of the optimization equations needed to solve the linear program and point out which modifications of the standard optimization setting are necessary to take advantage of the particular structure of the equations in the regression case
Keywords :
neural nets; LP; automatic accuracy control; basis functions; kernel functions; learning; linear programming; local perturbation robustness; neural nets; optimization equations; regression; support vector machines;
Conference_Titel :
Artificial Neural Networks, 1999. ICANN 99. Ninth International Conference on (Conf. Publ. No. 470)
Conference_Location :
Edinburgh
Print_ISBN :
0-85296-721-7
DOI :
10.1049/cp:19991171