• DocumentCode
    2000702
  • Title

    Information compression effect based on PCA for reinforcement learning agents´ communication

  • Author

    Notsu, A. ; Honda, Kazuhiro ; Ichihashi, Hayato ; Ido, A. ; Komori, Y.

  • Author_Institution
    Dept. of Comput. Sci. & Intell. Syst., Osaka Prefecture Univ., Sakai, Japan
  • fYear
    2012
  • fDate
    20-24 Nov. 2012
  • Firstpage
    1318
  • Lastpage
    1321
  • Abstract
    In general, the amount of required memory and reduction of learning time with explosion of the number of states become problems in reinforcement learning. In this study, as a method of cutting information of the learning table, principal component analysis was used as an information compression method, which is well known. The principal component analysis was applied to the learning table directly. Also, the influence given by reducing the principal component vector extremely when restructuring state space and action space was reviewed. In a numerical experiment, it was confirmed that the proposed method cut the amount of information and without a big change to learning speed and agents´ minimal communication can had positive effect on the learning.
  • Keywords
    learning (artificial intelligence); multi-agent systems; principal component analysis; vectors; PCA; action space; agent communication; information compression effect; learning speed; learning table; learning time; principal component analysis; principal component vector; reinforcement learning agent; state space; Information Compression; Principal Component Analysis; Reinforcement Learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Soft Computing and Intelligent Systems (SCIS) and 13th International Symposium on Advanced Intelligent Systems (ISIS), 2012 Joint 6th International Conference on
  • Conference_Location
    Kobe
  • Print_ISBN
    978-1-4673-2742-8
  • Type

    conf

  • DOI
    10.1109/SCIS-ISIS.2012.6504999
  • Filename
    6504999