Title :
Data-Driven Neuro-Optimal Temperature Control of Water–Gas Shift Reaction Using Stable Iterative Adaptive Dynamic Programming
Author :
Qinglai Wei ; Derong Liu
Author_Institution :
State Key Lab. of Manage. & Control for Complex Syst., Inst. of Autom., Beijing, China
Abstract :
In this paper, a novel data-driven stable iterative adaptive dynamic programming (ADP) algorithm is developed to solve optimal temperature control problems for water-gas shift (WGS) reaction systems. According to the system data, neural networks (NNs) are used to construct the dynamics of the WGS system and solve the reference control, respectively, where the mathematical model of the WGS system is unnecessary. Considering the reconstruction errors of NNs and the disturbances of the system and control input, a new stable iterative ADP algorithm is developed to obtain the optimal control law. The convergence property is developed to guarantee that the iterative performance index function converges to a finite neighborhood of the optimal performance index function. The stability property is developed to guarantee that each of the iterative control laws can make the tracking error uniformly ultimately bounded (UUB). NNs are developed to implement the stable iterative ADP algorithm. Finally, numerical results are given to illustrate the effectiveness of the developed method.
Keywords :
chemical industry; coal; convergence; dynamic programming; iterative methods; neurocontrollers; optimal control; performance index; stability; temperature control; NNs; UUB; WGS reaction system; coal-based chemical industry; convergence property; data-driven neuro-optimal temperature control; data-driven stable iterative adaptive dynamic programming algorithm; iterative ADP algorithm; iterative performance index function; neural networks; optimal control law; optimal temperature control problems; reconstruction errors; stability property; tracking error; uniformly ultimately bounded; water-gas shift reaction system; Adaptive critic designs; adaptive dynamic programming (ADP); approximate dynamic programming; approximation errors; data-driven control; neural networks (NNs); optimal control; reinforcement learning; water??gas shift (WGS);
Journal_Title :
Industrial Electronics, IEEE Transactions on
DOI :
10.1109/TIE.2014.2301770