• DocumentCode
    1852693
  • Title

    Application of reinforcement learning control to a nonlinear dexterous robot

  • Author

    Bucak, Ihsan Omur ; Zohdy, Mohamed A.

  • Author_Institution
    Sch. of Eng. & Comput. Sci., Oakland Univ., Rochester, MI, USA
  • Volume
    5
  • fYear
    1999
  • fDate
    1999
  • Firstpage
    5108
  • Abstract
    In this paper, the effects of basic parameters in reinforcement learning control such as eligibility, action and critic network weights, system nonlinearities, gradient information, state-space partitioning, variance of exploration were studied in detail. We attempt to increase feasibility for practical applications, implementation, learning efficiency, and performance. Reinforcement learning is then applied for control of a nonlinear dexterous robot. This control problem dictates that the learning is performed online, based on binary and real valued reinforcement signal from a critic network, without knowing the system model nonlinearity. The learning algorithm consists of an action and critic networks that learn to keep the multifinger hand of the dexterous robot within desired limits
  • Keywords
    control nonlinearities; dexterous manipulators; learning (artificial intelligence); nonlinear control systems; state-space methods; critic networks; multifinger hand; nonlinear dexterous robot; nonlinearities; reinforcement learning; state-space partitioning; Application software; Backpropagation algorithms; Computer science; Control systems; Electronic mail; Neural networks; Nonlinear control systems; Robots; Supervised learning; Systems engineering and theory;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control, 1999. Proceedings of the 38th IEEE Conference on
  • Conference_Location
    Phoenix, AZ
  • ISSN
    0191-2216
  • Print_ISBN
    0-7803-5250-5
  • Type

    conf

  • DOI
    10.1109/CDC.1999.833361
  • Filename
    833361