• DocumentCode
    1604413
  • Title

    An approach to tune fuzzy controllers based on reinforcement learning

  • Author

    Dai, Xiaohui ; Li, C.K. ; Rad, A.B.

  • Author_Institution
    Dept. of Electron. & Inf. Eng., Hong Kong Polytech. Univ., China
  • Volume
    1
  • fYear
    2003
  • Firstpage
    517
  • Abstract
    This paper proposes a new approach for the tuning of fuzzy controllers parameters based on reinforcement learning. The architecture of the proposed approach comprises of a Q estimator network (QEN) and a Takagi-Sugeno type fuzzy inference system (FIS). Unlike the most of the existing fuzzy Q-learning approaches, which select an optimal action based on finite discrete actions, while the proposed controller obtain the control output directly. With the proposed architecture, the learning algorithms for all the parameters of the Q estimator network and the FIS are developed based on the temporal difference methods as well as the gradient descent algorithm. The performance of the proposed design technique is illustrated by simulation studies of a vehicle longitudinal control system.
  • Keywords
    fuzzy control; fuzzy systems; gradient methods; inference mechanisms; learning (artificial intelligence); tuning; Q estimator network; Takagi-Sugeno type fuzzy inference system; fuzzy controllers; gradient descent algorithm; optimal action-value function; parameters tuning; reinforcement learning; temporal difference methods; vehicle longitudinal control system; Adaptive control; Control system synthesis; Control systems; Fuzzy control; Fuzzy systems; Learning; Optimal control; Programmable control; Takagi-Sugeno model; Vehicles;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Fuzzy Systems, 2003. FUZZ '03. The 12th IEEE International Conference on
  • Print_ISBN
    0-7803-7810-5
  • Type

    conf

  • DOI
    10.1109/FUZZ.2003.1209417
  • Filename
    1209417