ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
会议论文

OAM: An Option-Action Reinforcement Learning Framework for Universal Multi-Intersection Control

Liang, Enming; Su, Zicheng; Fang, Chilin; Zhong, Renxin*中山大学
36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence2022
3被引12阅读
引用收藏
分享

摘要

Efficient traffic signal control is an important means to alleviate urban traffic congestion. Reinforcement learning (RL) has shown great potentials in devising optimal signal plans that can adapt to dynamic traffic congestion. However, several challenges still need to be overcome. Firstly, a paradigm of state, action, and reward design is needed, especially for an optimality-guaranteed reward function. Secondly, the generalization of the RL algorithms is hindered by the varied topologies and physical properties of intersections. Lastly, enhancing the cooperation between intersections is needed for large network applications. To address these issues, the Option-Action RL framework for universal Multi-intersection control (OAM) is proposed. Based on the wellknown cell transmission model, we first define a lane-celllevel state to better model the traffic flow propagation. Based on this physical queuing dynamics, we propose a regularized delay as the reward to facilitate temporal credit assignment while maintaining the equivalence with minimizing the average travel time. We then recapitulate the phase actions as the constrained combinations of lane options and design a universal neural network structure to realize model generalization to any intersection with any phase definition. The multiple-intersection cooperation is then rigorously discussed using the potential game theory. @@@ We test the OAM algorithm under four networks with different settings, including a city-level scenario with 2,048 intersections using synthetic and real-world datasets. The results show that the OAM can outperform the state-of-the-art controllers in reducing the average travel time.

相关
加载中…
  • IPDALight: Intensity- and phase duration-aware traffic signal control based on Reinforcement Learning
    Zhao, Wupan; Ye, Yutong; Ding, Jiepin; Wang, Ting; Wei, Tongquan; Chen, Mingsong*JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 123: 102374.被引 14
  • Mitigating Action Hysteresis in Traffic Signal Control with Traffic Predictive Reinforcement Learning
    Han, Xiao; Zhao, Xiangyu*; Zhang, Liang*; Wang, Wanyu29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Long Beach, CA, 2023-08-06 To 2023-08-10.
  • FairLight: Fairness-Aware Autonomous Traffic Signal Control With Hierarchical Action Space
    Ye, Yutong; Ding, Jiepin; Wang, Ting; Zhou, Junlong; Wei, Xian; Chen, Mingsong*IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2023, 42(8): 2434-2446.
查看全部 →

会议信息

会议名称
36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence
会议日期
2022-02-22 至 2022
论文集名
THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE
发表日期
2022
起止页码
4550-4558
资助标注
National Natural Science Foundation of China [72071214]; General Research Fund from Research Grants Council, Hong Kong Special Administrative Region of the People's Republic of China [11206821]
收录
ISTP

作者

  • L

    Liang, Enming (第一作者)

  • S

    Su, Zicheng

查看全部 4 位作者收起作者
  • F

    Fang, Chilin

    sun yat sen univ

  • Z

    Zhong, Renxin (通讯)

    sun yat sen univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417