DocumentCode :
2465048
Title :
Reinforcement learning-based tracking control for wheeled mobile robot
Author :
Luy, Nguyen Tan
Author_Institution :
Div. of Autom. Electron., Ho Chi Minh Univ. of Ind., Ho Chi Minh City, Vietnam
fYear :
2012
fDate :
14-17 Oct. 2012
Firstpage :
462
Lastpage :
467
Abstract :
This paper proposes a new method to design a reinforcement learning-based integrated kinematic and dynamic tracking control scheme for a nonholonomic wheeled mobile robot. The scheme uses just only one neural network to design an online adaptive synchronous policy iteration algorithm implemented as an actor critic structure. Our tuning law for the single neural network not only learns online a tracking-HJB equation to approximate both the optimal cost and the optimal adaptive control law but also guarantees closed-loop stability in real-time. The convergence and stability of the overall system are proven by Lyapunov theory. The simulation results for wheeled mobile robot verify the effectiveness of the proposed controller.
Keywords :
Lyapunov methods; adaptive control; closed loop systems; iterative methods; learning (artificial intelligence); mobile robots; neurocontrollers; optimal control; robot dynamics; robot kinematics; stability; wheels; Lyapunov theory; actor critic structure; closed-loop stability; neural network; nonholonomic wheeled mobile robot; online adaptive synchronous policy iteration algorithm; optimal adaptive control law; optimal cost; reinforcement learning-based integrated dynamic tracking control scheme; reinforcement learning-based integrated kinematic tracking control scheme; tracking-HJB equation; Artificial neural networks; Equations; Kinematics; Mathematical model; Transmission line matrix methods; Tuning; Vectors; Adaptive critic; actor critic; mobile robot; neural network; policy iteration;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Systems, Man, and Cybernetics (SMC), 2012 IEEE International Conference on
Conference_Location :
Seoul
Print_ISBN :
978-1-4673-1713-9
Electronic_ISBN :
978-1-4673-1712-2
Type :
conf
DOI :
10.1109/ICSMC.2012.6377767
Filename :
6377767
Link To Document :
بازگشت