Title :
Recognizing environmental change through multiplex reinforcement learning in group robot system
Author :
Fukuda, Toshio ; Funato, Daisuke ; Arai, Fumihito
Author_Institution :
Center for Cooperative Res. in Adv. Sci. & Technol., Nagoya Univ., Japan
Abstract :
In recent years, reinforcement learning has been used as one of methods for making decisions for autonomous robots. However, the algorithm for learning concludes a parameter, and has a fault that adaptation speed for unknown environment changes, according to the value of the parameter. Because of the fault, the robot with reinforcement learning is often delayed in adapting to environmental change. In this paper, we propose a method to reduce the adaptation delay. Our idea is to make it possible for the robot to know if environmental change has happened. We found that if the robot uses reinforcement learning with two different parameters, the correlation between the reinforcement values lowers due to environmental change. Thus, we use the correlation as an index showing environmental change. The effect is proved through computer simulation
Keywords :
correlation methods; delays; learning (artificial intelligence); mobile robots; multi-robot systems; adaptation delay reduction; autonomous robot decision-making; computer simulation; correlation; environmental change index; environmental change recognition; group robot system; multiplex reinforcement learning; Centralized control; Computer simulation; Concrete; Control systems; Delay; Equations; Large-scale systems; Learning systems; Robot kinematics; Systems engineering and theory;
Conference_Titel :
Intelligent Robots and Systems, 1999. IROS '99. Proceedings. 1999 IEEE/RSJ International Conference on
Conference_Location :
Kyongju
Print_ISBN :
0-7803-5184-3
DOI :
10.1109/IROS.1999.812806