DocumentCode :
3158751
Title :
Autotuning of Fuzzy Inference System with RL
Author :
Pappa, N. ; Rama Krishnan, S.
Author_Institution :
Anna Univ., Chennai
fYear :
2007
fDate :
9-13 July 2007
Firstpage :
626
Lastpage :
631
Abstract :
Reinforcement learning refers to a class of learning tasks and algorithms in which the learning system learns an associative mapping by maximizing a scalar evaluation function by interacting with environment. Fuzzy actor critic learning (FACL) is a reinforcement learning method based on dynamic programming principle. A priori knowledge of the process either in the form of models or experts is required for tuning the conclusion part of the fuzzy inference system (FIS). This paper proposes a novel algorithm using FACL to automatically tune the conclusion part of the FIS. The only information available for learning is the system feedback that describes the rate of reward or punishment for the action performed at the previous state. Reinforcement learning problems are discrete time dynamic problems, in which the learner has classically a discrete state perception and trigger only discrete actions. It is planned to apply the same for the control of continuous processes. The generality of these methods allows the system to learn every kind of reinforcement learning problems. The experimental studies of these methods have also shown superiority of these methods over the related reinforcement methods as stated in the literature. In this paper, the proposed reinforcement learning algorithm was initially applied to boiler drum level system and the performance was studied. To show the generality of these methods, it was also applied to a number of linear processes.
Keywords :
containers; control engineering computing; discrete time systems; dynamic programming; fuzzy reasoning; learning (artificial intelligence); learning systems; level control; associative mapping; autotuning; boiler drum level system; discrete time dynamic problems; dynamic programming principle; feedback; fuzzy actor critic learning; fuzzy inference system; learning system; reinforcement learning; scalar evaluation function; Automatic control; Boilers; Cities and towns; Combustion; Control systems; Fuzzy control; Fuzzy logic; Fuzzy systems; Inference algorithms; Learning systems;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
American Control Conference, 2007. ACC '07
Conference_Location :
New York, NY
ISSN :
0743-1619
Print_ISBN :
1-4244-0988-8
Electronic_ISBN :
0743-1619
Type :
conf
DOI :
10.1109/ACC.2007.4282156
Filename :
4282156
Link To Document :
بازگشت