DocumentCode :
324528
Title :
Neural information processor
Author :
Kamimura, Ryotaro
Author_Institution :
Inf. Sci. Lab., Tokai Univ., Kanagawa, Japan
Volume :
2
fYear :
1998
fDate :
4-9 May 1998
Firstpage :
1030
Abstract :
We propose a neural information processor composed of an information filter and compressor. The information processor is introduced to unify information maximization and minimisation methods so far independently developed to control internal representations. The information filter and compressor of the information processor are simultaneously or sequentially applied. First, the information filter aims to decrease information contained in hidden units as much as possible and to capture information relevant to learning. The information compressor is used to compress information processed by the information minimisers into a small number of hidden units. To examine the performance of the information processor, it was applied to language acquisition problems. Experimental results confirmed that information can be maximised and minimized, and we could obtain simplified internal representations from redundant networks. In addition, generalization performance could significantly be improved. Thus, this neural information processor can be used not only to improve generalization and interpretation of internal representations but also to model human intelligent information processing in general
Keywords :
data compression; filtering theory; knowledge acquisition; maximum entropy methods; minimum entropy methods; natural languages; neural nets; generalization performance; human intelligent information processing; information compressor; information filter; information maximization; information minimisation; internal representations; language acquisition problems; neural information processor; redundant networks; Humans; Information filtering; Information filters; Information processing; Information science; Laboratories; Minimization methods; Neural networks; Noise figure;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks Proceedings, 1998. IEEE World Congress on Computational Intelligence. The 1998 IEEE International Joint Conference on
Conference_Location :
Anchorage, AK
ISSN :
1098-7576
Print_ISBN :
0-7803-4859-1
Type :
conf
DOI :
10.1109/IJCNN.1998.685913
Filename :
685913
Link To Document :
بازگشت