Title :
Dynamics analysis and analog associative memory of networks with LT neurons
Author :
Tang, Huajin ; Tan, K.C. ; Teoh, E.J.
Author_Institution :
Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore
fDate :
3/1/2006 12:00:00 AM
Abstract :
The additive recurrent network structure of linear threshold neurons represents a class of biologically-motivated models, where nonsaturating transfer functions are necessary for representing neuronal activities, such as that of cortical neurons. This paper extends the existing results of dynamics analysis of such linear threshold networks by establishing new and milder conditions for boundedness and asymptotical stability, while allowing for multistability. As a condition for asymptotical stability, it is found that boundedness does not require a deterministic matrix to be symmetric or possess positive off-diagonal entries. The conditions put forward an explicit way to design and analyze such networks. Based on the established theory, an alternate approach to study such networks is through permitted and forbidden sets. An application of the linear threshold (LT) network is analog associative memory, for which a simple design method describing the associative memory is suggested in this paper. The proposed design method is similar to a generalized Hebbian approach, but with distinctions of additional network parameters for normalization, excitation and inhibition, both on a global and local scale. The computational abilities of the network are dependent on its nonlinear dynamics, which in turn is reliant upon the sparsity of the memory vectors.
Keywords :
asymptotic stability; content-addressable storage; recurrent neural nets; transfer functions; additive recurrent network structure; analog associative memory; asymptotical stability; biologically-motivated models; dynamics analysis; linear threshold neurons; memory vector sparsity; nonlinear dynamics; nonsaturating transfer functions; Associative memory; Asymptotic stability; Biological system modeling; Computer networks; Convergence; Design methodology; Neurons; Stability analysis; Symmetric matrices; Transfer functions; Associative memory; continuous real-valued patterns; dynamics analysis; linear threshold (LT) network; Algorithms; Artificial Intelligence; Computer Simulation; Decision Support Techniques; Image Interpretation, Computer-Assisted; Models, Theoretical; Neural Networks (Computer); Numerical Analysis, Computer-Assisted; Pattern Recognition, Automated;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2005.863457