DocumentCode
693159
Title
A decision-making method for autonomous vehicles based on simulation and reinforcement learning
Author
Rui Zheng ; Chunming Liu ; Qi Guo
Author_Institution
Coll. of Mechatron. & Autom., Nat. Univ. of Defense Technol., Changsha, China
Volume
01
fYear
2013
fDate
14-17 July 2013
Firstpage
362
Lastpage
369
Abstract
There are still some problems need to be solved though there are a lot of achievements in the field of automatic driving. One of those problems is the difficulty of designing a decision-making system for complex traffic conditions. In recent years, reinforcement learning (RL) shows the potential in solving sequential decision optimization problems, which can be modeled as Markov decision processes (MDPs). In this paper, we establish a 14-DOF dynamic model of an autonomous vehicle and use RL to build a decision-making system for autonomous driving based on simulation. The decision-making process of the vehicle is modeled as an MDP, and the performance of the MDP is improved using an approximate RL. At last, we show the efficiency of the proposed method by simulation in a highway environment.
Keywords
Markov processes; decision making; learning (artificial intelligence); learning systems; mobile robots; road vehicles; robot dynamics; 14-DOF dynamic model; MDP; Markov decision process; automatic driving; autonomous driving; autonomous vehicles; complex traffic conditions; decision-making method; decision-making system; highway environment; reinforcement learning; sequential decision optimization problem; Abstracts; DSL; Markov processes; Three-dimensional displays; Vehicles; Autonomous Vehicles; Autonomous driving; Decision-making; Markov Decision Process; Reinforcement learning;
fLanguage
English
Publisher
ieee
Conference_Titel
Machine Learning and Cybernetics (ICMLC), 2013 International Conference on
Conference_Location
Tianjin
Type
conf
DOI
10.1109/ICMLC.2013.6890495
Filename
6890495
Link To Document