ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Heuristics Integrated Deep Reinforcement Learning for Online 3D Bin Packing

Yang, Shuo; Song, Shuai; Chu, Shilei; Song, Ran; Cheng, Jiyu; Li, Yibin; Zhang, Wei*山东大学
IEEE Transactions on Automation Science and Engineering2024-1DOI: 10.1109/TASE.2023.3235742
21被引3阅读
引用收藏
分享

摘要

Online 3D Bin Packing Problem (3D-BPP) has a wide range of industrial applications and there is an emerging research interest in learning optimal bin packing policy and deploying it for real logistics applications. From the heuristic methods to the deep reinforcement learning (DRL) methods, the previous works have proposed many solutions to solve the online 3D-BPP. However, none of them have studied what and how heuristics can be modelled into DRL to build a more effective and practical bin packing pipeline. In this work, we thoroughly investigate what heuristics can be used in online 3D-BPP and how to effectively integrate the heuristics with the DRL. First, we design 3 different heuristics based on the physical rules of the real world and the experiences of the human packers, including the Physics-Heuristics, the Packing-Heuristics and the Unpacking-Heuristics. Second, we model the 3 types of heuristics into the DRL framework and propose a novel heuristic DRL method to solve the online 3D-BPP. Extensive experimental results show that our method achieves state-of-the-art bin packing performance and the resulting real-world system is able to reliably finish the bin packing task in real logistics scenarios.

学科与关键词

关键词
LogisticsThree-dimensional displaysTask analysisRobotsOptimizationReinforcement learningDeep learningBin packingroboticswarehouse automationdeep reinforcement learning
相关
加载中…
  • A Flexible Reinforced Bin Packing Framework with Automatic Slack Selection
    Yang, Ting; Luo, Fei*; Fuentes, Joel; Ding, Weichao; Gu, ChunhuaMATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021: 6653586.被引 3
  • Solving a 3D bin packing problem with stacking constraints
    Zhu, Weiwang; Chen, Sheng; Dai, Min; Tao, Jiping*COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 188: 109814.被引 6
  • The third party logistics provider freight management problem: a framework and deep reinforcement learning approach
    Abbasi-Pooya, Amin; Lash, Michael T.*Annals of Operations Research, 2024, 339(1-2): 965-1024.
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Automation Science and Engineering
发表日期
2024-01
卷期
第 21 卷, 第 1 期
页码
939-950
DOI
10.1109/TASE.2023.3235742
语言
ENGLISH
成果收录
SCIE
资助标注
National Key Research and Development Plan of China [2021ZD0112002]; National Natural Science Foundation of China [U1913204, 61991411]; Natural Science Foundation of Shandong Province for Distinguished Young Scholars [ZR2020JQ29]; Project for Self-Developed Innovation Team of Jinan City [2021GXRC038]

作者

  • Y

    Yang, Shuo (第一作者)

    shandong univ

  • S

    Song, Shuai

    shandong univ

查看全部 7 位作者收起作者
  • C

    Chu, Shilei

    shandong univ

  • S

    Song, Ran

    shandong univ

  • C

    Cheng, Jiyu

    shandong univ

  • L

    Li, Yibin

    shandong univ

  • Z

    Zhang, Wei (通讯)

    shandong univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417