• DocumentCode
    348861
  • Title

    Recognizing environmental change through multiplex reinforcement learning in group robot system

  • Author

    Fukuda, Toshio ; Funato, Daisuke ; Arai, Fumihito

  • Author_Institution
    Center for Cooperative Res. in Adv. Sci. & Technol., Nagoya Univ., Japan
  • Volume
    2
  • fYear
    1999
  • fDate
    1999
  • Firstpage
    972
  • Abstract
    In recent years, reinforcement learning has been used as one of methods for making decisions for autonomous robots. However, the algorithm for learning concludes a parameter, and has a fault that adaptation speed for unknown environment changes, according to the value of the parameter. Because of the fault, the robot with reinforcement learning is often delayed in adapting to environmental change. In this paper, we propose a method to reduce the adaptation delay. Our idea is to make it possible for the robot to know if environmental change has happened. We found that if the robot uses reinforcement learning with two different parameters, the correlation between the reinforcement values lowers due to environmental change. Thus, we use the correlation as an index showing environmental change. The effect is proved through computer simulation
  • Keywords
    correlation methods; delays; learning (artificial intelligence); mobile robots; multi-robot systems; adaptation delay reduction; autonomous robot decision-making; computer simulation; correlation; environmental change index; environmental change recognition; group robot system; multiplex reinforcement learning; Centralized control; Computer simulation; Concrete; Control systems; Delay; Equations; Large-scale systems; Learning systems; Robot kinematics; Systems engineering and theory;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Robots and Systems, 1999. IROS '99. Proceedings. 1999 IEEE/RSJ International Conference on
  • Conference_Location
    Kyongju
  • Print_ISBN
    0-7803-5184-3
  • Type

    conf

  • DOI
    10.1109/IROS.1999.812806
  • Filename
    812806