ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Dynamic sub-route-based self-adaptive beam search Q-learning algorithm for traveling salesman problem

Zhang, Jin*; Liu, Qing; Han, XiaoHanghenan univ
PLoS One2023-3-21DOI: 10.1371/journal.pone.0283207
2被引2阅读
引用收藏
分享

摘要

In this paper, a dynamic sub-route-based self-adaptive beam search Q-learning (DSRABSQL) algorithm is proposed that provides a reinforcement learning (RL) framework combined with local search to solve the traveling salesman problem (TSP). DSRABSQL builds upon the Q-learning (QL) algorithm. Considering its problems of slow convergence and low accuracy, four strategies within the QL framework are designed first: the weighting function-based reward matrix, the power function-based initial Q-table, a self-adaptive epsilon-beam search strategy, and a new Q-value update formula. Then, a self-adaptive beam search Q-learning (ABSQL) algorithm is designed. To solve the problem that the sub-route is not fully optimized in the ABSQL algorithm, a dynamic sub-route optimization strategy is introduced outside the QL framework, and then the DSRABSQL algorithm is designed. Experiments are conducted to compare QL, ABSQL, DSRABSQL, our previously proposed variable neighborhood discrete whale optimization algorithm, and two advanced reinforcement learning algorithms. The experimental results show that DSRABSQL significantly outperforms the other algorithms. In addition, two groups of algorithms are designed based on the QL and DSRABSQL algorithms to test the effectiveness of the five strategies. From the experimental results, it can be found that the dynamic sub-route optimization strategy and self-adaptive epsilon-beam search strategy contribute the most for small-, medium-, and large-scale instances. At the same time, collaboration exists between the four strategies within the QL framework, which increases with the expansion of the instance scale.

学科与关键词

关键词
GENETIC ALGORITHMREINFORCEMENTSOLVELOGICGAME
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
PLoS One
发表日期
2023-03-21
卷期
第 18 卷, 第 3 期
页码
e0283207
DOI
10.1371/journal.pone.0283207
语言
ENGLISH
成果收录
SCIE

作者

  • Z

    Zhang, Jin (通讯) (第一作者)

    henan univ

  • L

    Liu, Qing

    henan univ

查看全部 3 位作者收起作者
  • H

    Han, XiaoHang

    henan univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417