DocumentCode
2000702
Title
Information compression effect based on PCA for reinforcement learning agents´ communication
Author
Notsu, A. ; Honda, Kazuhiro ; Ichihashi, Hayato ; Ido, A. ; Komori, Y.
Author_Institution
Dept. of Comput. Sci. & Intell. Syst., Osaka Prefecture Univ., Sakai, Japan
fYear
2012
fDate
20-24 Nov. 2012
Firstpage
1318
Lastpage
1321
Abstract
In general, the amount of required memory and reduction of learning time with explosion of the number of states become problems in reinforcement learning. In this study, as a method of cutting information of the learning table, principal component analysis was used as an information compression method, which is well known. The principal component analysis was applied to the learning table directly. Also, the influence given by reducing the principal component vector extremely when restructuring state space and action space was reviewed. In a numerical experiment, it was confirmed that the proposed method cut the amount of information and without a big change to learning speed and agents´ minimal communication can had positive effect on the learning.
Keywords
learning (artificial intelligence); multi-agent systems; principal component analysis; vectors; PCA; action space; agent communication; information compression effect; learning speed; learning table; learning time; principal component analysis; principal component vector; reinforcement learning agent; state space; Information Compression; Principal Component Analysis; Reinforcement Learning;
fLanguage
English
Publisher
ieee
Conference_Titel
Soft Computing and Intelligent Systems (SCIS) and 13th International Symposium on Advanced Intelligent Systems (ISIS), 2012 Joint 6th International Conference on
Conference_Location
Kobe
Print_ISBN
978-1-4673-2742-8
Type
conf
DOI
10.1109/SCIS-ISIS.2012.6504999
Filename
6504999
Link To Document