摘要
This paper develops a multi-timescale coordinated operation method for microgrids based on modern deep reinforcement learning. Considering the complementary characteristics of different storage devices, the proposed approach achieves multi-timescale coordination of battery and supercapacitor by introducing a hierarchical two-stage dispatch model. The first stage makes an initial decision irrespective of the uncertainties using the hourly predicted data to minimize the operational cost. For the second stage, it aims to generate corrective actions for the first-stage decisions to compensate for real-time renewable generation fluctuations. The first stage is formulated as a non-convex deterministic optimization problem, while the second stage is modeled as a Markov decision process solved by an entropy-regularized deep reinforcement learning method, i.e., the Soft Actor-Critic. The Soft Actor-Critic method can efficiently address the exploration-exploitation dilemma and suppress variations. This improves the robustness of decisions. Simulation results demonstrate that different types of energy storage devices can be used at two stages to achieve the multi-timescale coordinated operation. This proves the effectiveness of the proposed method.
学科与关键词
- A Data-Driven Energy Management Strategy Based on Deep Reinforcement Learning for Microgrid SystemsBao, Gang; Xu, Rui*Cognitive Computation, 2023, 15(2): 739-750.
- Reinforcement learning-based scheduling strategy for energy storage in microgridZhou, Kunshu; Zhou, Kaile*; Yang, ShanlinJournal of Energy Storage, 2022, 51: 104379.被引 13
- Optimal Distributed Coordinated Reinforcement Learning for Secondary Voltage Control in Time-Delayed MicrogridZhao, Chanjuan; Wang, Chao; Cheng, Zhiyou; Sun, Wei*; Zhao, BaoIEEE Systems Journal, 2023, 17(3): 3480-3491.被引 1
