Title :
Quantization effects in digitally behaving circuit implementations of Kohonen networks
Author :
Thiran, Patrick ; Peiris, Vincent ; Heim, Pascal ; Hochet, Bertrand
Author_Institution :
Dept. of Electr. Eng., Swiss Federal Inst. of Technol., Lausanne, Switzerland
fDate :
5/1/1994 12:00:00 AM
Abstract :
Implementing a neural network on a digital or mixed analog and digital chip yields the quantization of the synaptic weights dynamics. This paper addresses this topic in the case of Kohonen´s self-organizing maps. We first study qualitatively how the quantization affects the convergence and the properties, and deduce from this analysis the way to choose the parameters of the network (adaptation gain and neighborhood). We show that a spatially decreasing neighborhood function is far more preferable than the usually rectangular neighborhood function, because of the weight quantization. Based on these results, an analog nonlinear network, integrated in a standard CMOS technology, and implementing this spatially decreasing neighborhood function is then presented. It can be used in a mixed analog and digital circuit implementation
Keywords :
CMOS integrated circuits; mixed analogue-digital integrated circuits; neural chips; quantisation; self-organising feature maps; CMOS; Kohonen networks; analog nonlinear network; convergence; digitally behaving circuit; neighborhood function; neural network; self organizing maps; spatially decreasing neighborhood function; synaptic weights dynamics; weight quantization; Biological neural networks; CMOS technology; Convergence; Digital circuits; Integrated circuit technology; Intelligent networks; Quantization; Self organizing feature maps; Stochastic processes; Very large scale integration;
Journal_Title :
Neural Networks, IEEE Transactions on