摘要
As industry rapidly shifts towards mass personalisation, the need for a decentralised multi-agent system capable of dynamic flexible job shop scheduling (FJSP) is evident. Traditional heuristic and meta-heuristic scheduling methods cannot achieve satisfactory results and have limited application to static environments. Recent Reinforcement Learning (RL) approaches that consider dynamic FJSP, lack flexibility and autonomy as they use a single-agent centralised model, assuming global observability. As such, we propose a Multi-Agent Reinforcement Learning (MARL) system for scheduling dynamically arriving assembly jobs in a robot assembly cell. We applied a Double DQN-based algorithm and proposed a generalised observation, action and reward design for the dynamic FJSP setting. Using a centralised training phase, each agent (i.e., robot) in the assembly cell executes decentralised scheduling decisions based on local observations. Our solution demonstrated improved performance against rule-based heuristic methods, for optimising makespan. We also reported the impact of different observation sizes of each agent on optimisation performance.
学科与关键词
- Dynamic production scheduling towards self-organizing mass personalization: A multi-agent dueling deep reinforcement learning approachQin, Zhaojun; Johnson, Dazzle; Lu, Yuqian*JOURNAL OF MANUFACTURING SYSTEMS, 2023, 68: 242-257.被引 23
- Multi-Agent Reinforcement Learning for Extended Flexible Job Shop SchedulingPeng, Shaoming; Xiong, Gang; Yang, Jing; Shen, Zhen; Tamir, Tariku Sinshaw; Tao, Zhikun; Han, Yunjun*; Wang, Fei-YueMachines, 2024, 12(1): 8.被引 4
- A cooperative hierarchical deep reinforcement learning based multi-agent method for distributed job shop scheduling problem with random job arrivalsHuang, Jiang-Ping; Gao, Liang; Li, Xin-Yu*; Zhang, Chun-JiangCOMPUTERS & INDUSTRIAL ENGINEERING, 2023, 185: 109650.被引 10
