Title :
Gain-scheduling direct Heuristic Dynamic Programming, convergence analysis and application on Wind Turbine´s pitch control
Author :
Shao Zhizheng ; Luo Xiaochuan ; Yu Yang
Author_Institution :
State Key Lab. of Synthetically Autom. for Process Ind., Northeastern Univ., Shenyang, China
Abstract :
This paper focuses on a nonlinear on-line learning control system with some priori knowledge that can be represented with the functions of the gain scheduling. For this, we develop the Gain-Scheduling direct Heuristic Dynamic Programming (GSHDP) controller that is based on the fundamental principle of reinforcement learning. In order to improve the convergence speed of the on-line learning, DL-RM algorithm is proposed in this paper. Moreover, we analyse the convergence characteristic of the algorithm and develop a more general convergence theorem. We apply the GSHDP controller on Wind Turbine´s pitch control and the performance of the controller is measured in our simulation experiments. The simulation results show that DL-RM algorithm has faster convergence speed than RM algorithm and proper selection of reinforcement signal can achieve better performance.
Keywords :
convergence; dynamic programming; heuristic programming; learning (artificial intelligence); learning systems; nonlinear control systems; optimal control; wind turbines; DL-RM algorithm; GSHDP controller; convergence analysis; gain-scheduling direct heuristic dynamic programming; general convergence theorem; nonlinear online learning control system; optimal control; priori knowledge representation; reinforcement learning; reinforcement signal; wind turbine pitch control; Algorithm design and analysis; Convergence; Dynamic programming; Generators; Mathematical model; Torque; Wind turbines; Approximate dynamic programming (ADP); Direct Heuristic dynamic programming (direct HDP); Reinforcement learning; Wind Turbine; pitch control;
Conference_Titel :
Intelligent Control and Automation (WCICA), 2014 11th World Congress on
DOI :
10.1109/WCICA.2014.7052905