DocumentCode :
1355088
Title :
Structural stability of unsupervised learning in feedback neural networks
Author :
Kosko, Bart
Author_Institution :
Dept. of Electr. Eng., Southern California Univ, Los Angeles, CA, USA
Volume :
36
Issue :
7
fYear :
1991
fDate :
7/1/1991 12:00:00 AM
Firstpage :
785
Lastpage :
792
Abstract :
Structural stability is proved for a large class of unsupervised nonlinear feedback neural networks, adaptive bidirectional associative memory (ABAM) models. The approach extends the ABAM models to the random-process domain as systems of stochastic differential equations and appends scaled Brownian diffusions. It is also proved that this much larger family of models, random ABAM (RABAM) models, is globally stable. Intuitively, RABAM equilibria equal ABAM equilibria that vibrate randomly. The ABAM family includes many unsupervised feedback and feedforward neural models. All RABAM models permit Brownian annealing. The RABAM noise suppression theorem characterizes RABAM system vibration. The mean-squared activation and synaptic velocities decrease exponentially to their lower hounds, the respective temperature-scaled noise variances. The many neuronal and synaptic parameters missing from such neural network models are included, but as net random unmodeled effects. They do not affect the structure of real-time global computations
Keywords :
adaptive systems; content-addressable storage; feedback; learning systems; neural nets; random processes; stability; Brownian diffusions; adaptive bidirectional associative memory; feedback neural networks; mean-squared activation; random-process; stochastic differential equations; structural stability; synaptic velocities; unsupervised learning; Biological system modeling; Calculus; Differential equations; Intelligent networks; Neural networks; Neurofeedback; Stability; Stochastic processes; Structural engineering; Unsupervised learning;
fLanguage :
English
Journal_Title :
Automatic Control, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9286
Type :
jour
DOI :
10.1109/9.85058
Filename :
85058
Link To Document :
بازگشت