ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
会议论文

Mitigating Action Hysteresis in Traffic Signal Control with Traffic Predictive Reinforcement Learning

Han, Xiao; Zhao, Xiangyu*; Zhang, Liang*; Wang, Wanyu
29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)2023DOI: 10.1145/3580305.3599528
19阅读
引用收藏
分享

摘要

Traffic signal control plays a pivotal role in the management of urban traffic flow. With the rapid advancement of reinforcement learning, the development of signal control methods has seen a significant boost. However, a major challenge in implementing these methods is ensuring that signal lights do not change abruptly, as this can lead to traffic accidents. To mitigate this risk, a time-delay is introduced in the implementation of control actions, but usually has a negative impact on the overall efficacy of the control policy. To address this challenge, this paper presents a novel Traffic Signal Control Framework (PRLight), which leverages an On-policy Traffic Control Model (OTCM) and an Online Traffic Prediction Model (OTPM) to achieve efficient and real-time control of traffic signals. The framework collects multi-source traffic information from a local-view graph in real-time and employs a novel fast attention mechanism to extract relevant traffic features. To be specific, OTCM utilizes the predicted traffic state as input, eliminating the need for communication with other agents and maximizing computational efficiency while ensuring that the most relevant information is used for signal control. The proposed framework was evaluated on both simulated and real-world road networks and compared to various state-of-the-art methods, demonstrating its effectiveness in preventing traffic congestion and accidents.

学科与关键词

关键词
Traffic Signal ControlTraffic State PredictionReinforcement LearningGraph Convolutional NetworksAttention Mechanism
相关
加载中…
  • OAM: An Option-Action Reinforcement Learning Framework for Universal Multi-Intersection Control
    Liang, Enming; Su, Zicheng; Fang, Chilin; Zhong, Renxin*36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, ELECTR NETWORK, 2022-02-22 To 2022.被引 3
  • IPDALight: Intensity- and phase duration-aware traffic signal control based on Reinforcement Learning
    Zhao, Wupan; Ye, Yutong; Ding, Jiepin; Wang, Ting; Wei, Tongquan; Chen, Mingsong*JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 123: 102374.被引 14
  • Hierarchical control for stochastic network traffic with reinforcement learning
    Su, Z. C.; Chow, Andy H. F.*; Fang, C. L.; Liang, E. M.; Zhong, R. X.Transportation Research Part B: Methodological , 2023, 167: 196-216.被引 4
查看全部 →

会议信息

会议名称
29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
会议日期
2023-08-06 至 2023-08-10
论文集名
PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023
发表日期
2023
起止页码
673-684
DOI
10.1145/3580305.3599528
资助标注
APRC - CityU New Research Initiatives [9610565]; CityU - HKIDS Early Career Research Grant [9360163]; SIRG - CityU Strategic Interdisciplinary Research Grant [7020046, 7020074]; Tencent (CCF-Tencent Open Fund); Huawei (Huawei Innovation Research Program); Ant Group (CCF-Ant Research Fund, Ant Group Research Fund); Government of the HKSAR; Laboratory for AI-Powered Financial Technologies; InnoHK initiative
收录
ISTP

作者

  • H

    Han, Xiao (第一作者)

  • Z

    Zhao, Xiangyu (通讯)

查看全部 4 位作者收起作者
  • Z

    Zhang, Liang (通讯)

  • W

    Wang, Wanyu

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417