Title :
Freeway network traffic management based on distributed reinforcement learning
Author :
Wen, Kaige ; Yang, Wuganag ; Qu, Shiru
Author_Institution :
Sch. of Electron. & Control Eng., Chang´´an Univ., Xi´´an, China
Abstract :
A distributed machine learning approach in traffic flow control and dynamic route guidance is presented. The problem domain, a freeway network traffic flow integration control application considers multiple objectives of system, is formulated as a distributed reinforcement learning problem. The Gini coefficient is adopted in this study as an indicator of equity. The DRL approach was implemented via a multi-agent control architecture where the decision agent was assigned to each of the on-ramp or VMS. The reward of each agent is simultaneously updating a single shared policy. The control strategy´s effect is demonstrated through its application to the simple freeway network. Analyses of simulation results using this approach show the equity of the system have a significant improvement over traditional control, especially for the case of traffic peak hour. Using the DRL approach, the Gini coefficient of the network has been reduced by 28.99% compared to traditional method.
Keywords :
control engineering computing; learning (artificial intelligence); multi-agent systems; road traffic; traffic engineering computing; Gini coefficient; distributed machine learning; distributed reinforcement learning; dynamic route guidance; freeway network traffic management; multi-agent control architecture; traffic flow control; Analytical models; Communication system traffic control; Control engineering; Control systems; Electronic mail; Engineering management; Machine learning; Telecommunication traffic; Traffic control; Voice mail; equity; freeway; guidance; reinforcement learning; traffic control; traffic flow;
Conference_Titel :
Information Management and Engineering (ICIME), 2010 The 2nd IEEE International Conference on
Conference_Location :
Chengdu
Print_ISBN :
978-1-4244-5263-7
Electronic_ISBN :
978-1-4244-5265-1
DOI :
10.1109/ICIME.2010.5477875