ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
会议论文

MonitorLight: Reinforcement Learning-based Traffic Signal Control Using Mixed Pressure Monitoring

Fang, Zekuan*; Zhang, Fan; Wang, Ting; Lian, Xiang; Chen, Mingsong
31st ACM International Conference on Information and Knowledge Management (CIKM)2022DOI: 10.1145/3511808.3557400
3被引17阅读
引用收藏
分享

摘要

Although Reinforcement Learning (RL) has achieved significant success in the Traffic Signal Control (TSC), most of them focus on the design of RL elements while the impact of the phase duration is neglected. Due to the lack of exploring dynamic phase duration, the overall performance and convergence rate of RL-based TSC approaches cannot be guaranteed, which may result in poor adaptability of RL methods to different traffic conditions. To address these issues, in this paper, we formulate a novel phase-duration-aware TSC (PDA-TSC) problem and propose an effective RL-based TSC approach, named MonitorLight. Our approach adopts a new traffic indicator, mixed pressure, which enables RL agents to simultaneously analyze the impacts of stationary and moving vehicles on intersections. Based on the observed mixed pressure of intersections, RL agents can autonomously determine whether or not to change the current signals in real-time. In addition, MonitorLight can adjust the control method for scenarios with different real-time requirements and achieve excellent results in different situations. Extensive experiments on both real-world and synthetic datasets demonstrate that MonitorLight outperforms the current state-of-the-art IPDALight by up to 2.84% and 5.71% in average vehicle travel time, respectively. Moreover, our method significantly speeds up the convergence, leading IPDALight by 36.87% and 34.58% in the start to converge episode and jumpstart performance, respectively.

学科与关键词

关键词
Reinforcement learningTraffic signal controlPhase durationAverage travel timeFairness
相关
加载中…

文献加载失败,请重试

重试

会议信息

会议名称
31st ACM International Conference on Information and Knowledge Management (CIKM)
会议日期
2022-10-17 至 2022-10-21
论文集名
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022
发表日期
2022
起止页码
478-487
DOI
10.1145/3511808.3557400
资助标注
National Key Research and Development Program of China [2018YFB2101300]; Natural Science Foundation of China [61872147]; Shanghai Trusted Industry Internet Software Collaborative Innovation Center
收录
ISTP

作者

  • F

    Fang, Zekuan (通讯) (第一作者)

  • Z

    Zhang, Fan

查看全部 5 位作者收起作者
  • W

    Wang, Ting

  • L

    Lian, Xiang

  • C

    Chen, Mingsong

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417