Title :
Kernel feature detector: extracting kernel features by minimizing α-information
Author :
Kamimura, Ryotaro ; Nakanishi, Sholiachiro
Author_Institution :
Inf. Sci. Lab., Tokai Univ., Kanagawa, Japan
Abstract :
In the present paper, we propose kernel feature detectors for extracting salient features of input patterns. Kernel feature detectors are generated by the information controllers. The information controllers are mainly used to minimize the α-information, difference between Shannon entropy and Renyi entropy, and to generate explicit kernel feature detectors. By minimizing the α-information, a few important features called kernel features are separated from many other unimportant units. We applied our method to two problems: F-H problem and twenty-six alphabet character recognition. In all these cases, we succeeded in extracting kernel features of input patterns, corresponding to our intuition about the input patterns
Keywords :
character recognition; encoding; entropy; feature extraction; information theory; minimisation; neural nets; F-H problem; Renyi entropy; Shannon entropy; autoencoder; character recognition; information controllers; kernel feature detectors; salient feature extraction; Computer vision; Data mining; Detectors; Entropy; Feature extraction; Kernel; Laboratories; Minimization methods; Postal services; Uncertainty;
Conference_Titel :
Neural Networks, 1996., IEEE International Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-3210-5
DOI :
10.1109/ICNN.1996.549240