Title :
A Takagi-Sugeno fuzzy controller with reinforcement learning part
Author :
Xiaohua, Liu ; Dongming, Jin
Author_Institution :
Inst. of Microelectronics, Tsinghua Univ., Beijing, China
Abstract :
A Takagi-Sugeno fuzzy controller with reinforcement learning part is proposed in this paper, which is used to control a real inverted cart-pendulum system. The fuzzy controller part is a zero-order Takagi-Sugeno system with four inputs and one output. The learning part is based on the gradient-descent algorithm, which modifies the consequent parameters of the fuzzy rules. Because the expected output values are unknown, a reinforcement signal instead of the output error is used in learning process. The reinforcement signal is decided by the judgment of whether the action should be punished or rewarded and the degree of punishments or rewards. The performance of controlling a real inverted cart-pendulum system proves the validity and the superiority of the proposed fuzzy controller with reinforcement learning part.
Keywords :
fuzzy control; gradient methods; learning (artificial intelligence); nonlinear control systems; pendulums; position control; Takagi-Sugeno fuzzy controller; gradient-descent algorithm; inverted cart-pendulum system; reinforcement learning part; Control systems; Fuzzy control; Fuzzy systems; Humans; Nonlinear control systems; Signal processing; Supervised learning; Takagi-Sugeno model; Training data; Unsupervised learning;
Conference_Titel :
Neural Networks and Signal Processing, 2003. Proceedings of the 2003 International Conference on
Conference_Location :
Nanjing
Print_ISBN :
0-7803-7702-8
DOI :
10.1109/ICNNSP.2003.1279214