DocumentCode
445885
Title
SCRAM: statistically converging recurrent associative memory
Author
Chartier, Sylvain ; Hélie, Sébastien ; Boukadoum, Mounir ; Proulx, Robert
Author_Institution
Dept. of Psychol., UQO, Gatineau, Que., Canada
Volume
2
fYear
2005
fDate
31 July-4 Aug. 2005
Firstpage
723
Abstract
Autoassociative memories are known for their capacity to learn correlated patterns, complete these patterns and, once the learning phase completed, filter noisy inputs. However, no autoassociative memory as of yet was able to learn noisy patterns without preprocessing or special procedure. In this paper, we show that a new unsupervised learning rule enables associative memory models to locally learn online noisy correlated patterns. The learning is carried out by a dual Hebbian rule and the convergence is asymptotic. The asymptotic convergence results in an unequal eigenvalues spectrum, which distinguish SCRAM from optimal linear associative memories (OLAMs). Therefore, SCRAM develops less spurious attractors and has better recall performance under noise degradation.
Keywords
Hebbian learning; content-addressable storage; recurrent neural nets; unsupervised learning; autoassociative memories; dual Hebbian rule; noisy correlated patterns; optimal linear associative memories; statistically converging recurrent associative memory; unsupervised learning rule; Associative memory; Computer science; Convergence; Degradation; Eigenvalues and eigenfunctions; Filters; Phase noise; Psychology; Unsupervised learning; Working environment noise;
fLanguage
English
Publisher
ieee
Conference_Titel
Neural Networks, 2005. IJCNN '05. Proceedings. 2005 IEEE International Joint Conference on
Print_ISBN
0-7803-9048-2
Type
conf
DOI
10.1109/IJCNN.2005.1555941
Filename
1555941
Link To Document