DocumentCode
3158751
Title
Autotuning of Fuzzy Inference System with RL
Author
Pappa, N. ; Rama Krishnan, S.
Author_Institution
Anna Univ., Chennai
fYear
2007
fDate
9-13 July 2007
Firstpage
626
Lastpage
631
Abstract
Reinforcement learning refers to a class of learning tasks and algorithms in which the learning system learns an associative mapping by maximizing a scalar evaluation function by interacting with environment. Fuzzy actor critic learning (FACL) is a reinforcement learning method based on dynamic programming principle. A priori knowledge of the process either in the form of models or experts is required for tuning the conclusion part of the fuzzy inference system (FIS). This paper proposes a novel algorithm using FACL to automatically tune the conclusion part of the FIS. The only information available for learning is the system feedback that describes the rate of reward or punishment for the action performed at the previous state. Reinforcement learning problems are discrete time dynamic problems, in which the learner has classically a discrete state perception and trigger only discrete actions. It is planned to apply the same for the control of continuous processes. The generality of these methods allows the system to learn every kind of reinforcement learning problems. The experimental studies of these methods have also shown superiority of these methods over the related reinforcement methods as stated in the literature. In this paper, the proposed reinforcement learning algorithm was initially applied to boiler drum level system and the performance was studied. To show the generality of these methods, it was also applied to a number of linear processes.
Keywords
containers; control engineering computing; discrete time systems; dynamic programming; fuzzy reasoning; learning (artificial intelligence); learning systems; level control; associative mapping; autotuning; boiler drum level system; discrete time dynamic problems; dynamic programming principle; feedback; fuzzy actor critic learning; fuzzy inference system; learning system; reinforcement learning; scalar evaluation function; Automatic control; Boilers; Cities and towns; Combustion; Control systems; Fuzzy control; Fuzzy logic; Fuzzy systems; Inference algorithms; Learning systems;
fLanguage
English
Publisher
ieee
Conference_Titel
American Control Conference, 2007. ACC '07
Conference_Location
New York, NY
ISSN
0743-1619
Print_ISBN
1-4244-0988-8
Electronic_ISBN
0743-1619
Type
conf
DOI
10.1109/ACC.2007.4282156
Filename
4282156
Link To Document