摘要
Although Reinforcement Learning (RL) has achieved significant success in the Traffic Signal Control (TSC), most of them focus on the design of RL elements while the impact of the phase duration is neglected. Due to the lack of exploring dynamic phase duration, the overall performance and convergence rate of RL-based TSC approaches cannot be guaranteed, which may result in poor adaptability of RL methods to different traffic conditions. To address these issues, in this paper, we formulate a novel phase-duration-aware TSC (PDA-TSC) problem and propose an effective RL-based TSC approach, named MonitorLight. Our approach adopts a new traffic indicator, mixed pressure, which enables RL agents to simultaneously analyze the impacts of stationary and moving vehicles on intersections. Based on the observed mixed pressure of intersections, RL agents can autonomously determine whether or not to change the current signals in real-time. In addition, MonitorLight can adjust the control method for scenarios with different real-time requirements and achieve excellent results in different situations. Extensive experiments on both real-world and synthetic datasets demonstrate that MonitorLight outperforms the current state-of-the-art IPDALight by up to 2.84% and 5.71% in average vehicle travel time, respectively. Moreover, our method significantly speeds up the convergence, leading IPDALight by 36.87% and 34.58% in the start to converge episode and jumpstart performance, respectively.
学科与关键词
- IPDALight: Intensity- and phase duration-aware traffic signal control based on Reinforcement LearningZhao, Wupan; Ye, Yutong; Ding, Jiepin; Wang, Ting; Wei, Tongquan; Chen, Mingsong*JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 123: 102374.被引 14
- FairLight: Fairness-Aware Autonomous Traffic Signal Control With Hierarchical Action SpaceYe, Yutong; Ding, Jiepin; Wang, Ting; Zhou, Junlong; Wei, Xian; Chen, Mingsong*IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2023, 42(8): 2434-2446.
- Reinforcement learning in urban network traffic signal control: A systematic literature reviewNoaeen, Mohammad*; Naik, Atharva; Goodman, Liana; Crebo, Jared; Abrar, Taimoor; Abad, Zahra Shakeri Hossein; Bazzan, Ana L. C.; Far, BehrouzEXPERT SYSTEMS WITH APPLICATIONS, 2022, 199: 116830.被引 92
