Title :
The efficacy of symmetric cognitive biases in robotic motion learning
Author :
Uragami, Daisuke ; Takahashi, Tatsuji ; Alsubeheen, Hisham ; Sekiguchi, Akinori ; Matsuo, Yoshiki
Author_Institution :
Sch. of Comput. Sci., Tokyo Univ. of Technol., Hachioji, Japan
Abstract :
We propose an application of human-like decision-making to robotic motion learning. Human is known to have illogical symmetric cognitive biases that induce “if p then q” and “if not q then not p” from “if q then p.” The loosely symmetric Shinohara model quantitatively represents the tendencies (Shinohara et al. 2007). Previous studies one of the authors have revealed that an agent with the model used as the action value function shows great performance in n-armed bandit problems, because of the illogical biases. In this study, we apply the model to reinforcement learning with Q-learning algorithm. Testing the model on a simulated giant-swing robot, we have confirmed its efficacy in convergence speed increase and avoidance of local optimum.
Keywords :
control engineering computing; learning (artificial intelligence); path planning; robots; Q-learning algorithm; Shinohara model; action value function; giant-swing robot; human-like decision-making; illogical symmetric cognitive biases; n-armed bandit problem; reinforcement learning; robotic motion learning; Estimation; Hip; Humans; Joints; Learning; Robot motion; Exploration-Exploitation Dilemma; Giant-Swing Motion; Reinforcement Learning; Speed-Accuracy Tradeoff; non-Markov Property;
Conference_Titel :
Mechatronics and Automation (ICMA), 2011 International Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4244-8113-2
DOI :
10.1109/ICMA.2011.5985693