ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Real-Time Scheduling for Dynamic Partial-No-Wait Multiobjective Flexible Job Shop by Deep Reinforcement Learning

Luo, Shu; Zhang, Linxuan*; Fan, Yushun清华大学
IEEE Transactions on Automation Science and Engineering2022-10DOI: 10.1109/TASE.2021.3104716
89被引2阅读
引用收藏
分享

摘要

In modern discrete flexible manufacturing systems, dynamic disturbances frequently occur in real time and each job may contain several special operations in partial-no-wait constraint due to technological requirements. In this regard, a hierarchical multiagent deep reinforcement learning (DRL)-based real-time scheduling method named hierarchical multi-agent proximal policy optimization (HMAPPO) is developed to address the dynamic partial-no-wait multiobjective flexible job shop scheduling problem (DMOFJSP-PNW) with new job insertions and machine breakdowns. The proposed HMAPPO contains three proximal policy optimization (PPO)-based agents operating in different spatiotemporal scales, namely, objective agent, job agent, and machine agent. The objective agent acts as a higher controller periodically determining the temporary objectives to be optimized. The job agent and machine agent are lower actuators, respectively, choosing a job selection rule and machine assignment rule to achieve the temporary objective at each rescheduling point. Five job selection rules and six machine assignment rules are designed to select an uncompleted job and assign the next operation of which together with its successors in no-wait constraint on the corresponding processing machines. A hierarchical PPO-based training algorithm is developed. Extensive numerical experiments have confirmed the effectiveness and superiority of the proposed HMAPPO compared with other well-known dynamic scheduling methods.

学科与关键词

关键词
Dynamic schedulingJob shop schedulingReal-time systemsDispatchingProductionManufacturingSchedulesDeep reinforcement learning (DRL)flexible job shopmultiagentmultiobjectivepartial-no-wait
相关
加载中…
  • Multi-policy deep reinforcement learning for multi-objective multiplicity flexible job shop scheduling
    Ding, Linshan; Guan, Zailin; Rauf, Mudassar; Yue, Lei*Swarm and Evolutionary Computation, 2024, 87: 101550.被引 9
  • A modified multi-agent proximal policy optimization algorithm for multi-objective dynamic partial-re-entrant hybrid flow shop scheduling problem
    Wu, Jiawei; Liu, Yong*ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 140: 109688.被引 1
  • Deep reinforcement learning for dynamic distributed job shop scheduling problem with transfers
    Lei, Yong; Deng, Qianwang*; Liao, Mengqi; Gao, ShuochengEXPERT SYSTEMS WITH APPLICATIONS, 2024, 251: 123970.被引 4
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Automation Science and Engineering
发表日期
2022-10
卷期
第 19 卷, 第 4 期
页码
3020-3038
DOI
10.1109/TASE.2021.3104716
语言
ENGLISH
期刊等级
2区
成果收录
SCIE
资助标注
National Key Research and Development Program of China [2018YFB1703103]; Research and Development Program of Tsinghua University-Weichai Power Company Ltd., Intelligent Manufacturing Institute [JIM02/20182912121]; Dongguan Innovative Research Team Program [2018607202007]

作者

  • L

    Luo, Shu (第一作者)

    tsinghua univ

  • Z

    Zhang, Linxuan (通讯)

    tsinghua univ

查看全部 3 位作者收起作者
  • F

    Fan, Yushun

    tsinghua univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417