ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

A multi-action deep reinforcement learning framework for flexible Job-shop scheduling problem

Lei, Kun; Guo, Peng*; Zhao, Wenchao; Wang, Yi; Qian, Linmao; Meng, Xiangyin; Tang, Liansheng西南交通大学
EXPERT SYSTEMS WITH APPLICATIONS2022-11-1DOI: 10.1016/j.eswa.2022.117796
107被引6阅读
引用收藏
分享

摘要

This paper presents an end-to-end deep reinforcement framework to automatically learn a policy for solving a flexible Job-shop scheduling problem (FJSP) using a graph neural network. In the FJSP environment, the reinforcement agent needs to schedule an operation belonging to a job on an eligible machine among a set of compatible machines at each timestep. This means that an agent needs to control multiple actions simultaneously. Such a problem with multi-actions is formulated as a multiple Markov decision process (MMDP). For solving the MMDPs, we propose a multi-pointer graph networks (MPGN) architecture and a training algorithm called multi-Proximal Policy Optimization (multi-PPO) to learn two sub-policies, including a job operation action policy and a machine action policy to assign a job operation to a machine. The MPGN architecture consists of two encoder-decoder components, which define the job operation action policy and the machine action policy for predicting probability distributions over different operations and machines, respectively. We introduce a disjunctive graph representation of FJSP and use a graph neural network to embed the local state encountered during scheduling. The computational experiment results show that the agent can learn a high-quality dispatching policy and outperforms handcrafted heuristic dispatching rules in solution quality and meta-heuristic algorithm in running time. Moreover, the results achieved on random and benchmark instances demonstrate that the learned policies have a good generalization performance on real-world instances and significantly larger scale instances with up to 2000 operations.

学科与关键词

关键词
Flexible job-shop scheduling problemMulti-action deep reinforcement learningGraph neural networkMarkov decision processMulti-proximal policy optimization
相关
加载中…
  • An end-to-end deep reinforcement learning method based on graph neural network for distributed job-shop scheduling problem
    Huang, Jiang-Ping; Gao, Liang; Li, Xin-Yu*EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238: 121756.被引 13
  • Solving flexible job shop scheduling problems via deep reinforcement learning
    Yuan, Erdong; Wang, Liejun*; Cheng, Shuli; Song, Shiji; Fan, Wei; Li, YongmingEXPERT SYSTEMS WITH APPLICATIONS, 2024, 245: 123019.被引 11
  • Multi-policy deep reinforcement learning for multi-objective multiplicity flexible job shop scheduling
    Ding, Linshan; Guan, Zailin; Rauf, Mudassar; Yue, Lei*Swarm and Evolutionary Computation, 2024, 87: 101550.被引 9
查看全部 →

发表信息

论文状态
公开发表
期刊
EXPERT SYSTEMS WITH APPLICATIONS
发表日期
2022-11-01
卷期
第 205 卷
页码
117796
DOI
10.1016/j.eswa.2022.117796
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
National Key Research and Development Program of China [2020YFB1712200]; MOE (Ministry of Education in China) Project of Humanities and Social Sciences [21YJC630034]; University Major Research Program of Humanities and Social Sciences of Zhejiang Province [2018QN060]

作者

  • L

    Lei, Kun (第一作者)

    southwest jiaotong univ

  • G

    Guo, Peng (通讯)

    southwest jiaotong univ

查看全部 7 位作者收起作者
  • Z

    Zhao, Wenchao

    southwest jiaotong univ

  • W

    Wang, Yi

  • Q

    Qian, Linmao

    southwest jiaotong univ

  • M

    Meng, Xiangyin

    southwest jiaotong univ

  • T

    Tang, Liansheng

    ningbo univ technol

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417