DocumentCode :
1014603
Title :
Acquiring robot skills via reinforcement learning
Author :
Gullapalli, VijayKumar ; Franklin, Judy A. ; Benbrahim, Hamid
Author_Institution :
Dept. of Comput. Sci., Massachusetts Univ., Amherst, MA, USA
Volume :
14
Issue :
1
fYear :
1994
Firstpage :
13
Lastpage :
24
Abstract :
Skill acquisition is a difficult , yet important problem in robot performance. The authors focus on two skills, namely robotic assembly and balancing and on two classic tasks to develop these skills via learning: the peg-in hole insertion task, and the ball balancing task. A stochastic real-valued (SRV) reinforcement learning algorithm is described and used for learning control and the authors show how it can be used with nonlinear multilayer ANNs. In the peg-in-hole insertion task the SRV network successfully learns to insert to insert a peg into a hole with extremely low clearance, in spite of high sensor noise. In the ball balancing task the SRV network successfully learns to balance the ball with minimal feedback.<>
Keywords :
backpropagation; learning (artificial intelligence); robots; ball balancing; learning control; nonlinear multilayer neural networks; peg-in hole insertion task; robot skills; robotic assembly; skill acquisition; stochastic real-valued reinforcement learning algorithm; Adaptive control; Control design; Control systems; Delay; Feedback; Robot control; Robotic assembly; Robust control; Supervised learning; Uncertainty;
fLanguage :
English
Journal_Title :
Control Systems, IEEE
Publisher :
ieee
ISSN :
1066-033X
Type :
jour
DOI :
10.1109/37.257890
Filename :
257890
Link To Document :
بازگشت