Title :
Asymptotically stable reinforcement learning-based neural network controller using adaptive bounding technique
Author :
Cui Lili ; Zhang Huaguang ; Luo Yanhong ; Sun Ning
Author_Institution :
Sch. of Inf. Sci. & Eng., Northeastern Univ., Shenyang, China
Abstract :
In this paper, a novel asymptotically stable reinforcement learning-based neural network controller using adaptive bounding technique for the tracking problem of a class continuous nonlinear system is proposed. An actor-critic structure is adopted for designing the controller, in which the critic network is tuned by itself and generates the reinforcement learning signal to tune actor network which generates the input signal to the system. The designed controller can achieve asymptotic convergence of the tracking error and performance measurement signal to zero, while ensuring boundedness of parameter estimation errors. No a prior knowledge of bounds of unknown quantities in designing the controller is assumed. Simulation results on a two-link robot manipulator show the satisfactory performance of the proposed control scheme.
Keywords :
adaptive control; asymptotic stability; continuous systems; learning (artificial intelligence); neurocontrollers; nonlinear systems; parameter estimation; actor-critic structure; adaptive bounding technique; asymptotic convergence; asymptotically stable reinforcement learning-based neural network controller; continuous nonlinear system; parameter estimation; Adaptive systems; Artificial neural networks; Convergence; Learning; Lyapunov method; Measurement; Trajectory; Actor-critic; Adaptive Bounding Technique; Asymptotically Stable; Neural Network; Reinforcement Learning;
Conference_Titel :
Control Conference (CCC), 2010 29th Chinese
Conference_Location :
Beijing
Print_ISBN :
978-1-4244-6263-6