• DocumentCode
    2465048
  • Title

    Reinforcement learning-based tracking control for wheeled mobile robot

  • Author

    Luy, Nguyen Tan

  • Author_Institution
    Div. of Autom. Electron., Ho Chi Minh Univ. of Ind., Ho Chi Minh City, Vietnam
  • fYear
    2012
  • fDate
    14-17 Oct. 2012
  • Firstpage
    462
  • Lastpage
    467
  • Abstract
    This paper proposes a new method to design a reinforcement learning-based integrated kinematic and dynamic tracking control scheme for a nonholonomic wheeled mobile robot. The scheme uses just only one neural network to design an online adaptive synchronous policy iteration algorithm implemented as an actor critic structure. Our tuning law for the single neural network not only learns online a tracking-HJB equation to approximate both the optimal cost and the optimal adaptive control law but also guarantees closed-loop stability in real-time. The convergence and stability of the overall system are proven by Lyapunov theory. The simulation results for wheeled mobile robot verify the effectiveness of the proposed controller.
  • Keywords
    Lyapunov methods; adaptive control; closed loop systems; iterative methods; learning (artificial intelligence); mobile robots; neurocontrollers; optimal control; robot dynamics; robot kinematics; stability; wheels; Lyapunov theory; actor critic structure; closed-loop stability; neural network; nonholonomic wheeled mobile robot; online adaptive synchronous policy iteration algorithm; optimal adaptive control law; optimal cost; reinforcement learning-based integrated dynamic tracking control scheme; reinforcement learning-based integrated kinematic tracking control scheme; tracking-HJB equation; Artificial neural networks; Equations; Kinematics; Mathematical model; Transmission line matrix methods; Tuning; Vectors; Adaptive critic; actor critic; mobile robot; neural network; policy iteration;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Systems, Man, and Cybernetics (SMC), 2012 IEEE International Conference on
  • Conference_Location
    Seoul
  • Print_ISBN
    978-1-4673-1713-9
  • Electronic_ISBN
    978-1-4673-1712-2
  • Type

    conf

  • DOI
    10.1109/ICSMC.2012.6377767
  • Filename
    6377767