ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Reinforcement Learning With Multiple Relational Attention for Solving Vehicle Routing Problems

Xu, Yunqiu; Fang, Meng; Chen, Ling*; Xu, Gangyan*; Du, Yali; Zhang, Chengqiharbin inst technol
IEEE Transactions on Cybernetics2022-10DOI: 10.1109/TCYB.2021.3089179
47被引12阅读
引用收藏
分享

摘要

In this article, we study the reinforcement learning (RL) for vehicle routing problems (VRPs). Recent works have shown that attention-based RL models outperform recurrent neural network-based methods on these problems in terms of both effectiveness and efficiency. However, existing RL models simply aggregate node embeddings to generate the context embedding without taking into account the dynamic network structures, making them incapable of modeling the state transition and action selection dynamics. In this work, we develop a new attention-based RL model that provides enhanced node embeddings via batch normalization reordering and gate aggregation, as well as dynamic-aware context embedding through an attentive aggregation module on multiple relational structures. We conduct experiments on five types of VRPs: 1) travelling salesman problem (TSP); 2) capacitated VRP (CVRP); 3) split delivery VRP (SDVRP); 4) orienteering problem (OP); and 5) prize collecting TSP (PCTSP). The results show that our model not only outperforms the learning-based baselines but also solves the problems much faster than the traditional baselines. In addition, our model shows improved generalizability when being evaluated in large-scale problems, as well as problems with different data distributions.

学科与关键词

关键词
Computational modelingVehicle routingOptimizationDecodingContext modelingVehicle dynamicsTask analysisAttention mechanismcombinatorial optimizationdeep reinforcement learning (DRL)traveling salesman problemvehicle routing problem (VRP)
相关
加载中…
  • Constraint-aware Policy Optimization to Solve the Vehicle Routing Problem with Time Windows
    Zhang, Renchi; Yu, Runsheng; Xia, Wei*Information Technology and Control, 2022, 51(1): 126-138.被引 1
  • Transformer-Based Reinforcement Learning for Pickup and Delivery Problems With Late Penalties
    Zhang, Ke; Lin, Xi; Li, Meng*IEEE Transactions on Intelligent Transportation Systems, 2022, 23(12): 24649-24661.被引 15
  • Reinforcement Learning for the Pickup and Delivery Problem
    Liu, Fagui; Lai, Chengqi*; Wang, Lvshengbiao31st International Conference on Artificial Neural Networks (ICANN), Univ W England, Bristol, ENGLAND, 2022-09-06 To 2022-09-09.被引 1
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Cybernetics
发表日期
2022-10
卷期
第 52 卷, 第 10 期
页码
11107-11120
DOI
10.1109/TCYB.2021.3089179
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
Australian Research Council [DP180100966]; National Natural Science Foundation of China [71804034]; Science and Technology Innovation Committee of Shenzhen [JCYJ20180306171958907]

作者

  • X

    Xu, Yunqiu (第一作者)

  • F

    Fang, Meng

查看全部 6 位作者收起作者
  • C

    Chen, Ling (通讯)

  • X

    Xu, Gangyan (通讯)

    harbin inst technol

  • D

    Du, Yali

  • Z

    Zhang, Chengqi

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417