摘要
Considering the popularity of electric vehicles and the flexibility of household appliances, it is feasible to dispatch energy in home energy systems under dynamic electricity prices to optimize electricity cost and comfort residents. In this paper, a novel home energy management (HEM) approach is proposed based on a data-driven deep reinforcement learning method. First, to reveal the multiple uncertain factors affecting the charging behavior of electric vehicles (EVs), an improved mathematical model integrating driver's experience, unexpected events, and traffic conditions is introduced to describe the dynamic energy demand of EVs in home energy systems. Second, a decoupled advantage actor-critic (DA2C) algorithm is presented to enhance the energy optimization performance by alleviating the overfitting problem caused by the shared policy and value networks. Furthermore, separate networks for the policy and value functions ensure the generalization of the proposed method in unseen scenarios. Finally, comprehensive experiments are carried out to compare the proposed approach with existing methods, and the results show that the proposed method can optimize electricity cost and consider the residential comfort level in different scenarios.
学科与关键词
- Optimization Strategy Based on Deep Reinforcement Learning for Home Energy ManagementLiu, Yuankun*; Zhang, Dongxia; Gooi, Hoay BengCSEE Journal of Power and Energy systems, 2020, 6(3): 572-582.被引 108
- Reward Shaping-Based Actor-Critic Deep Reinforcement Learning for Residential Energy ManagementLu, Renzhi; Jiang, Zhenyu; Wu, Huaming; Ding, Yuemin*; Wang, Dong; Zhang, Hai-TaoIEEE Transactions on Industrial Informatics, 2023, 19(3): 2662-2673.被引 13
- Online Charging Strategy for Electric Vehicle Clusters Based on Multi-Agent Reinforcement Learning and Long-Short Memory NetworksShen, Xianhao; Zhang, Yexin; Wang, Decheng*Energies, 2022, 15(13): 4582.被引 1
