ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Deep reinforcement learning control for non-stationary building energy management

Naug, Avisek; Quinones-Grueiro, Marcos*; Biswas, Gautam
ENERGY AND BUILDINGS2022-12-15DOI: 10.1016/j.enbuild.2022.112584
15被引12阅读
引用收藏
分享

摘要

Developing an optimal supervisory control policy for building energy management is a complex problem because the system exhibits non-stationary behaviors, and the target policy needs to evolve with changes in the state transition and reward functions. Non-stationary real-world problems often present a set of challenges: non-stationary changes are difficult to detect; and thermodynamic systems with larger time-constants can create sample-inefficiency problems for learning algorithms. In addition, the system may have to satisfy safety-critical constraints, and, therefore, the policy must be learned offline unless actuation rules are correctly designed. To address these challenges, we propose a data-driven deep reinforcement learning framework. A rein-forcement learning supervisory controller is firstly developed and deployed on the building for the heat-ing, ventilation and air conditioning (HVAC) system and monitored for performance degradation by tracking an aggregate metric. When degradation is detected, a relearning loop is triggered. Then, a set of data-driven models of the building behavior is updated with the latest real data. Subsequently, the deployed controller is re-tuned by letting it interact with the model and is then redeployed on the sys-tem. Our proposed approach is demonstrated extensively on the standard ASHRAE 5-zone testbed and a real building. It is benchmarked against state-of-the-art algorithms in building supervisory control: Guideline-36, Proximal Policy Optimization, Deep Deterministic Policy Gradient, and Model Predictive Path Integral control. Our approach performs significantly better than the previously mentioned supervi-sory control strategies and highlights the need for a condition-based offline relearning framework in dynamic systems.

学科与关键词

关键词
Smart building managementDeep reinforcement learningNon-stationary systemsContinuous adaptation
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
ENERGY AND BUILDINGS
发表日期
2022-12-15
卷期
第 277 卷
页码
112584
DOI
10.1016/j.enbuild.2022.112584
语言
ENGLISH
期刊等级
2区
成果收录
SCIE

作者

  • N

    Naug, Avisek (第一作者)

  • Q

    Quinones-Grueiro, Marcos (通讯)

查看全部 3 位作者收起作者
  • B

    Biswas, Gautam

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417