• DocumentCode
    1014603
  • Title

    Acquiring robot skills via reinforcement learning

  • Author

    Gullapalli, VijayKumar ; Franklin, Judy A. ; Benbrahim, Hamid

  • Author_Institution
    Dept. of Comput. Sci., Massachusetts Univ., Amherst, MA, USA
  • Volume
    14
  • Issue
    1
  • fYear
    1994
  • Firstpage
    13
  • Lastpage
    24
  • Abstract
    Skill acquisition is a difficult , yet important problem in robot performance. The authors focus on two skills, namely robotic assembly and balancing and on two classic tasks to develop these skills via learning: the peg-in hole insertion task, and the ball balancing task. A stochastic real-valued (SRV) reinforcement learning algorithm is described and used for learning control and the authors show how it can be used with nonlinear multilayer ANNs. In the peg-in-hole insertion task the SRV network successfully learns to insert to insert a peg into a hole with extremely low clearance, in spite of high sensor noise. In the ball balancing task the SRV network successfully learns to balance the ball with minimal feedback.<>
  • Keywords
    backpropagation; learning (artificial intelligence); robots; ball balancing; learning control; nonlinear multilayer neural networks; peg-in hole insertion task; robot skills; robotic assembly; skill acquisition; stochastic real-valued reinforcement learning algorithm; Adaptive control; Control design; Control systems; Delay; Feedback; Robot control; Robotic assembly; Robust control; Supervised learning; Uncertainty;
  • fLanguage
    English
  • Journal_Title
    Control Systems, IEEE
  • Publisher
    ieee
  • ISSN
    1066-033X
  • Type

    jour

  • DOI
    10.1109/37.257890
  • Filename
    257890