• DocumentCode
    1158626
  • Title

    An approach to tune fuzzy controllers based on reinforcement learning for autonomous vehicle control

  • Author

    Dai, Xiaohui ; Li, Chi-Kwong ; Rad, A.B.

  • Author_Institution
    Rockwell Autom. Res. Center, Shanghai, China
  • Volume
    6
  • Issue
    3
  • fYear
    2005
  • Firstpage
    285
  • Lastpage
    293
  • Abstract
    In this paper, we suggest a new approach for tuning parameters of fuzzy controllers based on reinforcement learning. The architecture of the proposed approach is comprised of a Q estimator network (QEN) and a Takagi-Sugeno-type fuzzy inference system (TSK-FIS). Unlike other fuzzy Q-learning approaches that select an optimal action based on finite discrete actions, the proposed controller obtains the control output directly from TSK-FIS. With the proposed architecture, the learning algorithms for all the parameters of the QEN and the FIS are developed based on the temporal-difference (TD) methods as well as the gradient-descent algorithm. The performance of the proposed design technique is illustrated by simulation studies of a vehicle longitudinal-control system.
  • Keywords
    fuzzy control; fuzzy systems; gradient methods; inference mechanisms; learning (artificial intelligence); vehicles; Q estimator network; Takagi-Sugeno-type fuzzy inference system; autonomous vehicle control; fuzzy Q-learning; fuzzy controller tuning; gradient-descent algorithm; reinforcement learning; temporal-difference methods; Adaptive control; Control systems; Fuzzy control; Fuzzy systems; Intelligent transportation systems; Mobile robots; Optimal control; Programmable control; Remotely operated vehicles; Supervised learning; Autonomous vehicles; fuzzy controllers; longitudinal control; reinforcement learning;
  • fLanguage
    English
  • Journal_Title
    Intelligent Transportation Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1524-9050
  • Type

    jour

  • DOI
    10.1109/TITS.2005.853698
  • Filename
    1504788