Title :
Acquiring robot skills via reinforcement learning
Author :
Gullapalli, VijayKumar ; Franklin, Judy A. ; Benbrahim, Hamid
Author_Institution :
Dept. of Comput. Sci., Massachusetts Univ., Amherst, MA, USA
Abstract :
Skill acquisition is a difficult , yet important problem in robot performance. The authors focus on two skills, namely robotic assembly and balancing and on two classic tasks to develop these skills via learning: the peg-in hole insertion task, and the ball balancing task. A stochastic real-valued (SRV) reinforcement learning algorithm is described and used for learning control and the authors show how it can be used with nonlinear multilayer ANNs. In the peg-in-hole insertion task the SRV network successfully learns to insert to insert a peg into a hole with extremely low clearance, in spite of high sensor noise. In the ball balancing task the SRV network successfully learns to balance the ball with minimal feedback.<>
Keywords :
backpropagation; learning (artificial intelligence); robots; ball balancing; learning control; nonlinear multilayer neural networks; peg-in hole insertion task; robot skills; robotic assembly; skill acquisition; stochastic real-valued reinforcement learning algorithm; Adaptive control; Control design; Control systems; Delay; Feedback; Robot control; Robotic assembly; Robust control; Supervised learning; Uncertainty;
Journal_Title :
Control Systems, IEEE