Title :
Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems
Author :
Vamvoudakis, Kyriakos G.
Author_Institution :
Center for Control, Dynamical-Syst. & Comput. (CCDC), Univ. of California, Santa Barbara, Santa Barbara, CA, USA
Abstract :
This paper proposes a novel optimal adaptive event-triggered control algorithm for nonlinear continuous-time systems. The goal is to reduce the controller updates, by sampling the state only when an event is triggered to maintain stability and optimality. The online algorithm is implemented based on an actor/critic neural network structure. A critic neural network is used to approximate the cost and an actor neural network is used to approximate the optimal event-triggered controller. Since in the algorithm proposed there are dynamics that exhibit continuous evolutions described by ordinary differential equations and instantaneous jumps or impulses, we will use an impulsive system approach. A Lyapunov stability proof ensures that the closed-loop system is asymptotically stable. Finally, we illustrate the effectiveness of the proposed solution compared to a time-triggered controller.
Keywords :
Lyapunov methods; adaptive control; asymptotic stability; closed loop systems; continuous time systems; neurocontrollers; nonlinear control systems; optimal control; Lyapunov stability proof; actor-critic neural network structure; asymptotic stability; closed-loop system; continuous-time nonlinear systems; controller updates; event-triggered optimal adaptive control algorithm; impulsive system approach; ordinary differential equations; time-triggered controller; Adaptive control; Bandwidth; Heuristic algorithms; Learning (artificial intelligence); Linear systems; Neural networks; Nonlinear systems; Event-triggered; adaptive control; optimal control; reinforcement learning;
Journal_Title :
Automatica Sinica, IEEE/CAA Journal of
DOI :
10.1109/JAS.2014.7004686