Title :
A class of competitive learning models which avoids neuron underutilization problem
Author :
Choy, Clifford Sze-Tsan ; Siu, Wan-chi
Author_Institution :
Dept. of Electron. & Inf. Eng., Hong Kong Polytech., Hung Hom, Hong Kong
fDate :
11/1/1998 12:00:00 AM
Abstract :
We study a qualitative property of a class of competitive learning (CL) models, which is called the multiplicatively biased competitive learning (MBCL) model, namely that it avoids neuron underutilization with probability one as time goes to infinity. In the MBCL, the competition among neurons is biased by a multiplicative term, while only one weight vector is updated per learning step. This is of practical interest since its instances have computational complexities among the lowest in existing CL models. In addition, in applications like classification, vector quantizer design and probability density function estimation, a necessary condition for optimal performance is to avoid neuron underutilization. Hence, it is possible to define instances of MBCL to achieve optimal performance in these applications
Keywords :
computational complexity; probability; unsupervised learning; classification; computational complexities; multiplicatively biased competitive learning model; necessary condition; neuron underutilization; probability density function estimation; qualitative property; vector quantizer design; weight vector; Clustering algorithms; Computational complexity; Context modeling; Councils; H infinity control; Neurons; Probability density function; Prototypes; Speech recognition; Vector quantization;
Journal_Title :
Neural Networks, IEEE Transactions on