DocumentCode :
2707458
Title :
Self-enhancement learning: Self-supervised and target-creating learning
Author :
Kamimura, Ryotaro
Author_Institution :
IT Educ. Center, Tokai Univ., Tokai, Japan
fYear :
2009
fDate :
14-19 June 2009
Firstpage :
1503
Lastpage :
1509
Abstract :
In this paper, we propose a new learning method called ldquoself-enhancement learning.rdquo In this model, a network enhances its state by itself, and this enhanced state is to be imitated by another state of the network. The word ldquotargetrdquo in our model means that a target is created spontaneously by a network, which must try to attain the target. Enhancement is realized by changing the Gaussian width or enhancement parameter. With different enhancement parameters, we can set up the different states of a network. In particular, we set up an enhanced and a relaxed state, and the relaxed state tries to imitate the enhanced state as much as possible. To demonstrate the effectiveness of this method, we apply the self-enhancement learning to the SOM. For this purpose, we introduce collectiveness into an enhanced state in which all neurons collectively respond to input patterns. Then, this enhanced and collective state should be imitated by the other non-enhanced and relaxed state. We applied the method to the Iris problem. Experimental results showed that the U-matrices obtained were significantly similar to those produced by the conventional SOM. However, much better performance could be obtained in terms of quantitative and topological errors. The experimental results suggest the possibility for the self-enhancement learning to be applied to many different neural network models.
Keywords :
Gaussian processes; learning (artificial intelligence); self-organising feature maps; Gaussian width; SOM; relaxed state; self-enhancement learning; self-supervised learning; target-creating learning; Cooling; Entropy; Iris; Learning systems; Machine learning; Neural networks; Neurons; Probability; Semisupervised learning; Temperature;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks, 2009. IJCNN 2009. International Joint Conference on
Conference_Location :
Atlanta, GA
ISSN :
1098-7576
Print_ISBN :
978-1-4244-3548-7
Electronic_ISBN :
1098-7576
Type :
conf
DOI :
10.1109/IJCNN.2009.5178677
Filename :
5178677
Link To Document :
بازگشت