Title :
A Cognitive Control Approach to Communication-Based Train Control Systems
Author :
Hongwei Wang ; Yu, F. Richard ; Li Zhu ; Tao Tang ; Bin Ning
Author_Institution :
Nat. Res. Center of Railway Safety Assessment, Beijing Jiaotong Univ., Beijing, China
Abstract :
Communication-based train control (CBTC) is an automated train control system using bidirectional train-ground wireless communications to ensure the safe operation of rail vehicles. Due to unreliable wireless communications and train mobility, the train control performance can be significantly affected by wireless networks. Although some works have been done to study CBTC systems from both train-ground communication and train control perspectives, these two important areas have traditionally been separately addressed. In this paper, with recent advances in cognitive dynamic systems, we take a cognitive control approach to CBTC systems considering both train-ground communication and train control. In our approach, the notion of information gap is adopted to quantitatively describe the effects of train-ground communication on train control. Moreover, unlike the existing works that use network capacity as the design measure, in this paper the linear quadratic cost for the train control performance in CBTC systems is considered in the performance measure. Reinforcement learning is applied to obtain the optimal policy based on the performance measure, which includes linear quadratic cost and information gap. In addition, the wireless channel is modeled as finite-state Markov chains with multiple state transition probability matrices, which can demonstrate the characteristics of both large-scale and small-scale fading. The channel state transition probability matrices are derived from real field measurement results. Simulation results show that the proposed cognitive control approach can significantly improve the train control performance in CBTC systems.
Keywords :
Markov processes; learning (artificial intelligence); probability; rail traffic control; wireless LAN; wireless channels; CBTC systems; automated train control system; bidirectional train-ground wireless communication; cognitive control approach; cognitive dynamic systems; communication-based train control system; finite-state Markov chain; information gap; linear quadratic cost; multiple state transition probability matrices; rail vehicle; reinforcement learning; train control performance; train mobility; unreliable wireless communication; wireless channel; wireless networks; Channel models; Control systems; Rail transportation; Rails; Safety; Wireless networks; Cognitive control; communication-based train control (CBTC); handoff; information gap; reinforcement learning (RL);
Journal_Title :
Intelligent Transportation Systems, IEEE Transactions on
DOI :
10.1109/TITS.2014.2377115