Title :
A note on the classification error of an SVM in one dimension
Author_Institution :
CRC for Sensor Signals & Inf. Process., Mawson Lakes, SA, Australia
Abstract :
There are many algorithms available for detecting noise corrupted signals in background clutter. In cases where the exact statistics of the noise and clutter are unknown, the optimal detector may be estimated from a set of samples of each. One method for doing this is the support vector machine (SVM), which has a detection performance that is dependent on some regularisation parameter C, and cannot be determined a-priori. The standard method of choosing C is by trying values and choosing the one which minimises the detection error on a cross-validation set. It is often assumed that as the size of the training set increases, the resulting discriminant will give the best possible detection rate on an independent test set. This paper investigates two simple 1D examples: uniform and normal distributions. An example is provided where the optimum detection rate cannot be achieved by an SVM regardless of the C chosen value.
Keywords :
error detection; learning (artificial intelligence); learning automata; minimisation; pattern classification; performance evaluation; probability; signal detection; background clutter; clutter; detection error; infinite training sets; minimisation; noise corrupted signal detection; pattern classification; probability density functions; regularisation parameter; support vector machine; Australia; Background noise; Detectors; Gaussian distribution; Signal detection; Statistics; Support vector machine classification; Support vector machines; Testing;
Conference_Titel :
Information, Decision and Control, 2002. Final Program and Abstracts
Conference_Location :
Adelaide, SA, Australia
Print_ISBN :
0-7803-7270-0
DOI :
10.1109/IDC.2002.995376