DocumentCode :
1158626
Title :
An approach to tune fuzzy controllers based on reinforcement learning for autonomous vehicle control
Author :
Dai, Xiaohui ; Li, Chi-Kwong ; Rad, A.B.
Author_Institution :
Rockwell Autom. Res. Center, Shanghai, China
Volume :
6
Issue :
3
fYear :
2005
Firstpage :
285
Lastpage :
293
Abstract :
In this paper, we suggest a new approach for tuning parameters of fuzzy controllers based on reinforcement learning. The architecture of the proposed approach is comprised of a Q estimator network (QEN) and a Takagi-Sugeno-type fuzzy inference system (TSK-FIS). Unlike other fuzzy Q-learning approaches that select an optimal action based on finite discrete actions, the proposed controller obtains the control output directly from TSK-FIS. With the proposed architecture, the learning algorithms for all the parameters of the QEN and the FIS are developed based on the temporal-difference (TD) methods as well as the gradient-descent algorithm. The performance of the proposed design technique is illustrated by simulation studies of a vehicle longitudinal-control system.
Keywords :
fuzzy control; fuzzy systems; gradient methods; inference mechanisms; learning (artificial intelligence); vehicles; Q estimator network; Takagi-Sugeno-type fuzzy inference system; autonomous vehicle control; fuzzy Q-learning; fuzzy controller tuning; gradient-descent algorithm; reinforcement learning; temporal-difference methods; Adaptive control; Control systems; Fuzzy control; Fuzzy systems; Intelligent transportation systems; Mobile robots; Optimal control; Programmable control; Remotely operated vehicles; Supervised learning; Autonomous vehicles; fuzzy controllers; longitudinal control; reinforcement learning;
fLanguage :
English
Journal_Title :
Intelligent Transportation Systems, IEEE Transactions on
Publisher :
ieee
ISSN :
1524-9050
Type :
jour
DOI :
10.1109/TITS.2005.853698
Filename :
1504788
Link To Document :
بازگشت