DocumentCode
1014603
Title
Acquiring robot skills via reinforcement learning
Author
Gullapalli, VijayKumar ; Franklin, Judy A. ; Benbrahim, Hamid
Author_Institution
Dept. of Comput. Sci., Massachusetts Univ., Amherst, MA, USA
Volume
14
Issue
1
fYear
1994
Firstpage
13
Lastpage
24
Abstract
Skill acquisition is a difficult , yet important problem in robot performance. The authors focus on two skills, namely robotic assembly and balancing and on two classic tasks to develop these skills via learning: the peg-in hole insertion task, and the ball balancing task. A stochastic real-valued (SRV) reinforcement learning algorithm is described and used for learning control and the authors show how it can be used with nonlinear multilayer ANNs. In the peg-in-hole insertion task the SRV network successfully learns to insert to insert a peg into a hole with extremely low clearance, in spite of high sensor noise. In the ball balancing task the SRV network successfully learns to balance the ball with minimal feedback.<>
Keywords
backpropagation; learning (artificial intelligence); robots; ball balancing; learning control; nonlinear multilayer neural networks; peg-in hole insertion task; robot skills; robotic assembly; skill acquisition; stochastic real-valued reinforcement learning algorithm; Adaptive control; Control design; Control systems; Delay; Feedback; Robot control; Robotic assembly; Robust control; Supervised learning; Uncertainty;
fLanguage
English
Journal_Title
Control Systems, IEEE
Publisher
ieee
ISSN
1066-033X
Type
jour
DOI
10.1109/37.257890
Filename
257890
Link To Document