• DocumentCode
    693159
  • Title

    A decision-making method for autonomous vehicles based on simulation and reinforcement learning

  • Author

    Rui Zheng ; Chunming Liu ; Qi Guo

  • Author_Institution
    Coll. of Mechatron. & Autom., Nat. Univ. of Defense Technol., Changsha, China
  • Volume
    01
  • fYear
    2013
  • fDate
    14-17 July 2013
  • Firstpage
    362
  • Lastpage
    369
  • Abstract
    There are still some problems need to be solved though there are a lot of achievements in the field of automatic driving. One of those problems is the difficulty of designing a decision-making system for complex traffic conditions. In recent years, reinforcement learning (RL) shows the potential in solving sequential decision optimization problems, which can be modeled as Markov decision processes (MDPs). In this paper, we establish a 14-DOF dynamic model of an autonomous vehicle and use RL to build a decision-making system for autonomous driving based on simulation. The decision-making process of the vehicle is modeled as an MDP, and the performance of the MDP is improved using an approximate RL. At last, we show the efficiency of the proposed method by simulation in a highway environment.
  • Keywords
    Markov processes; decision making; learning (artificial intelligence); learning systems; mobile robots; road vehicles; robot dynamics; 14-DOF dynamic model; MDP; Markov decision process; automatic driving; autonomous driving; autonomous vehicles; complex traffic conditions; decision-making method; decision-making system; highway environment; reinforcement learning; sequential decision optimization problem; Abstracts; DSL; Markov processes; Three-dimensional displays; Vehicles; Autonomous Vehicles; Autonomous driving; Decision-making; Markov Decision Process; Reinforcement learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Machine Learning and Cybernetics (ICMLC), 2013 International Conference on
  • Conference_Location
    Tianjin
  • Type

    conf

  • DOI
    10.1109/ICMLC.2013.6890495
  • Filename
    6890495