摘要
In modern discrete flexible manufacturing systems, dynamic disturbances frequently occur in real time and each job may contain several special operations in partial-no-wait constraint due to technological requirements. In this regard, a hierarchical multiagent deep reinforcement learning (DRL)-based real-time scheduling method named hierarchical multi-agent proximal policy optimization (HMAPPO) is developed to address the dynamic partial-no-wait multiobjective flexible job shop scheduling problem (DMOFJSP-PNW) with new job insertions and machine breakdowns. The proposed HMAPPO contains three proximal policy optimization (PPO)-based agents operating in different spatiotemporal scales, namely, objective agent, job agent, and machine agent. The objective agent acts as a higher controller periodically determining the temporary objectives to be optimized. The job agent and machine agent are lower actuators, respectively, choosing a job selection rule and machine assignment rule to achieve the temporary objective at each rescheduling point. Five job selection rules and six machine assignment rules are designed to select an uncompleted job and assign the next operation of which together with its successors in no-wait constraint on the corresponding processing machines. A hierarchical PPO-based training algorithm is developed. Extensive numerical experiments have confirmed the effectiveness and superiority of the proposed HMAPPO compared with other well-known dynamic scheduling methods.
学科与关键词
- Multi-policy deep reinforcement learning for multi-objective multiplicity flexible job shop schedulingDing, Linshan; Guan, Zailin; Rauf, Mudassar; Yue, Lei*Swarm and Evolutionary Computation, 2024, 87: 101550.被引 9
- A modified multi-agent proximal policy optimization algorithm for multi-objective dynamic partial-re-entrant hybrid flow shop scheduling problemWu, Jiawei; Liu, Yong*ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 140: 109688.被引 1
- Deep reinforcement learning for dynamic distributed job shop scheduling problem with transfersLei, Yong; Deng, Qianwang*; Liao, Mengqi; Gao, ShuochengEXPERT SYSTEMS WITH APPLICATIONS, 2024, 251: 123970.被引 4
