ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Reinforcement learning in urban network traffic signal control: A systematic literature review

Noaeen, Mohammad*; Naik, Atharva; Goodman, Liana; Crebo, Jared; Abrar, Taimoor; Abad, Zahra Shakeri Hossein; Bazzan, Ana L. C.; Far, Behrouz
EXPERT SYSTEMS WITH APPLICATIONS2022-8-1DOI: 10.1016/j.eswa.2022.116830
92被引16阅读
引用收藏
分享

摘要

Improvement of traffic signal control (TSC) efficiency has been found to lead to improved urban transportation and enhanced quality of life. Recently, the use of reinforcement learning (RL) in various areas of TSC has gained significant traction; thus, we conducted a systematic literature review as a systematic, comprehensive, and reproducible review to dissect all the existing research that applied RL in the network-level TSC domain, called as RL in NTSC or RL-NTSC for brevity. The review only targeted the network-level articles that tested the proposed methods in networks with two or more intersections. This review covers 160 peer-reviewed articles from 30 countries published from 1994 to March 2020. The goal of this study is to provide the research community with statistical and conceptual knowledge, summarize existence evidence, characterize RL applications in NTSC domains, explore all applied methods and major first events in the defined scope, and identify areas for further research based on the explored research problems in current research. We analyzed the extracted data from the included articles in the following seven categories: (i) publication and authors' data, (ii) method identification and analysis, (iii) environment attributes and traffic simulation, (iv) application domains of RL-NTSC, (v) major first events of RL-NTSC and authors' key statements, (vi) code availability, and (vii) evaluation. This paper provides a comprehensive view of the past 26 years of research on applying RL to NTSC. It also reveals the role of advancing deep learning methods in the revival of the research area, the rise of using non-commercial microscopic traffic simulators, a lack of interaction between traffic and transportation engineering practitioners and researchers, and a lack of proposal and creation of testbeds which can likely bring different communities together around common goals.

学科与关键词

关键词
Reinforcement learningTraffic light controlUrban networkMulti-agent systemIntelligent transportation systemArtificial intelligence
相关
加载中…
  • Hierarchical control for stochastic network traffic with reinforcement learning
    Su, Z. C.; Chow, Andy H. F.*; Fang, C. L.; Liang, E. M.; Zhong, R. X.Transportation Research Part B: Methodological , 2023, 167: 196-216.被引 4
  • OAM: An Option-Action Reinforcement Learning Framework for Universal Multi-Intersection Control
    Liang, Enming; Su, Zicheng; Fang, Chilin; Zhong, Renxin*36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, ELECTR NETWORK, 2022-02-22 To 2022.被引 3
  • IPDALight: Intensity- and phase duration-aware traffic signal control based on Reinforcement Learning
    Zhao, Wupan; Ye, Yutong; Ding, Jiepin; Wang, Ting; Wei, Tongquan; Chen, Mingsong*JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 123: 102374.被引 14
查看全部 →

发表信息

论文状态
公开发表
期刊
EXPERT SYSTEMS WITH APPLICATIONS
发表日期
2022-08-01
卷期
第 199 卷
页码
116830
DOI
10.1016/j.eswa.2022.116830
语言
ENGLISH
期刊等级
1区
成果收录
SCIE

作者

  • N

    Noaeen, Mohammad (通讯) (第一作者)

  • N

    Naik, Atharva

查看全部 8 位作者收起作者
  • G

    Goodman, Liana

  • C

    Crebo, Jared

  • A

    Abrar, Taimoor

  • A

    Abad, Zahra Shakeri Hossein

  • B

    Bazzan, Ana L. C.

  • F

    Far, Behrouz

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417