Title :
Learning to acquire whole-body humanoid CoM movements to achieve dynamic tasks
Author :
Matsubara, Takamitsu ; Morimoto, Jun ; Nakanishi, Jun ; Hyon, Sang-Ho ; Hale, Joshua G. ; Cheng, Gordon
Author_Institution :
Nara Inst. of Sci. & Technol.
Abstract :
This paper presents a novel approach to acquire dynamic whole-body movements on humanoid robots focused on learning a control policy for the center of mass. A policy-gradient method is used to acquire a CoM movement as a control policy for achieving a desired dynamic task. A CoM-Jacobian-based redundancy resolution is then used to compute angular velocities for all joints in order to achieve a whole-body movement consistent with the CoM movement acquired through learning. To demonstrate the effectiveness of our method, we apply it in simulation to the learning of a strong punching movement on the Fujitsu humanoid robot, Hoap-2.
Keywords :
adaptive control; humanoid robots; learning (artificial intelligence); learning systems; mobile robots; motion control; CoM-Jacobian-based redundancy resolution; Fujitsu humanoid robot; Hoap-2; angular velocities; center of mass; policy-gradient method; reinforcement learning; whole-body humanoid CoM movements; Angular velocity; Computational modeling; Equations; Humanoid robots; Humans; Learning; Legged locomotion; Orbital robotics; Robotics and automation; Weight control; Humanoid robot; Policy-gradient method; Reinforcement learning; Whole-body movement;
Conference_Titel :
Robotics and Automation, 2007 IEEE International Conference on
Conference_Location :
Roma
Print_ISBN :
1-4244-0601-3
Electronic_ISBN :
1050-4729
DOI :
10.1109/ROBOT.2007.363871