DocumentCode
1264250
Title
Unsupervised learning in noise
Author
Kosko, Bart
Author_Institution
Dept. of Electr. Eng., Univ. of Southern California, Los Angeles, CA, USA
Volume
1
Issue
1
fYear
1990
fDate
3/1/1990 12:00:00 AM
Firstpage
44
Lastpage
57
Abstract
A new hybrid learning law, the differential competitive law, which uses the neuronal signal velocity as a local unsupervised reinforcement mechanism, is introduced, and its coding and stability behavior in feedforward and feedback networks is examined. This analysis is facilitated by the recent Gluck-Parker pulse-coding interpretation of signal functions in differential Hebbian learning systems. The second-order behavior of RABAM (random adaptive bidirectional associative memory) Brownian-diffusion systems is summarized by the RABAM noise suppression theorem: the mean-squared activation and synaptic velocities decrease exponentially quickly to their lower bounds, the instantaneous noise variances driving the system. This result is extended to the RABAM annealing model, which provides a unified framework from which to analyze Geman-Hwang combinatorial optimization dynamical systems and continuous Boltzmann machine learning
Keywords
content-addressable storage; encoding; learning systems; neural nets; noise; Boltzmann machine learning; Brownian-diffusion systems; Gluck-Parker; Hebbian learning systems; RABAM; coding; differential competitive law; neural nets; neuronal signal velocity; noise suppression; random adaptive bidirectional associative memory; unsupervised learning; Associative memory; Biological system modeling; Large-scale systems; Neural networks; Neurofeedback; Stability; Stochastic resonance; Stochastic systems; Structural engineering; Unsupervised learning;
fLanguage
English
Journal_Title
Neural Networks, IEEE Transactions on
Publisher
ieee
ISSN
1045-9227
Type
jour
DOI
10.1109/72.80204
Filename
80204
Link To Document