Title :
RKHS Bayes Discriminant: A Subspace Constrained Nonlinear Feature Projection for Signal Detection
Author :
Ozertem, Umut ; Erdogmus, Deniz
Author_Institution :
Yahoo! Labs., Santa Clara, CA, USA
fDate :
7/1/2009 12:00:00 AM
Abstract :
Given the knowledge of class probability densities, a priori probabilities, and relative risk levels, Bayes classifier provides the optimal minimum-risk decision rule. Specifically, focusing on the two-class (detection) scenario, under certain symmetry assumptions, matched filters provide optimal results for the detection problem. Noticing that the Bayes classifier is in fact a nonlinear projection of the feature vector to a single-dimensional statistic, in this paper, we develop a smooth nonlinear projection filter constrained to the estimated span of class conditional distributions as does the Bayes classifier. The nonlinear projection filter is designed in a reproducing kernel Hilbert space leading to an analytical solution both for the filter and the optimal threshold. The proposed approach is tested on typical detection problems, such as neural spike detection or automatic target detection in synthetic aperture radar (SAR) imagery. Results are compared with linear and kernel discriminant analysis, as well as classification algorithms such as support vector machine, AdaBoost and LogitBoost.
Keywords :
Bayes methods; Hilbert spaces; filtering theory; nonlinear filters; probability; signal classification; signal detection; Bayes classifier; RKHS Bayes discriminant; a priori probability; automatic target detection; class probability density; classification algorithms; feature vector; kernel Hilbert space; kernel discriminant analysis; linear discriminant analysis; matched filters; neural spike detection; optimal minimum-risk decision rule; optimal threshold; relative risk levels; signal detection; single-dimensional statistic; smooth nonlinear projection filter; subspace constrained nonlinear feature projection; symmetry assumptions; synthetic aperture radar imagery; Classification; nonlinear detection filter; nonlinear dimensionality reduction; nonlinear matched filter; Action Potentials; Algorithms; Artificial Intelligence; Bayes Theorem; Computer Simulation; Neural Networks (Computer); Neurons; Nonlinear Dynamics; Pattern Recognition, Automated; Signal Detection, Psychological; Signal Processing, Computer-Assisted; Software;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2009.2021473