Title :
Predicting driving behavior using inverse reinforcement learning with multiple reward functions towards environmental diversity
Author :
Shimosaka, Masamichi ; Nishi, Kentaro ; Sato, Junichi ; Kataoka, Hirokatsu
Author_Institution :
Dept. of Mechano-Inf., Univ. of Tokyo, Tokyo, Japan
fDate :
June 28 2015-July 1 2015
Abstract :
Predicting defensive driving is a promising technology for novel advanced driver assistance systems. In recent years, modeling driving behavior in residential roads through inverse reinforcement learning (IRL) has been attracting attention in intelligent vehicle community thanks to the superiority of this approach providing long-term prediction of fine-grained driving behavior. However, it suffers from poor performance in diverse environment due to the fact that the single reward function could not handle all the environment with large diversity. Towards this issue, a novel IRL framework with multiple reward functions to deal with environmental diversity is proposed in the paper. Specifically, the model employs Dirichlet process mixtures as a flexible and powerful Bayesian model to divide the environment into clusters and learns the parameters in each cluster simultaneously. Experimental result with expert driver behavior data shows that our model with multiple reward functions provides superior performance over the IRL model with single reward function. It also suggests that the clustering of environments based on the driving behavior of professional drivers could be useful on evaluating driving environments.
Keywords :
Bayes methods; behavioural sciences; driver information systems; learning (artificial intelligence); road accidents; road safety; Bayesian model; Dirichlet process mixtures; IRL model; advanced driver assistance systems; defensive driving; driving behavior modeling; driving behavior prediction; driving environments; environmental diversity; environments clustering; intelligent vehicle community; inverse reinforcement learning; multiple reward functions; professional drivers; residential roads; Acceleration; Data models; Magnetohydrodynamics; Predictive models; Roads; Safety; Vehicles;
Conference_Titel :
Intelligent Vehicles Symposium (IV), 2015 IEEE
Conference_Location :
Seoul
DOI :
10.1109/IVS.2015.7225745