Robust Proactive Power Smoothing Control of PV Systems Based on Deep Reinforcement Learning

Chen, Xiaoyang, Xu, Xu, Wang, Jia, Fang, Lurui, Du, Yang, Lim, Eng Gee, and Ma, Jieming (2023) Robust Proactive Power Smoothing Control of PV Systems Based on Deep Reinforcement Learning. IEEE Transactions on Sustainable Energy, 14. 1585 -1598.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website:


Efficient integration of photovoltaic (PV) energy into the power grid calls for a robust regulation of its intermittency. At present, the solar forecasting-assisted proactive power smoothing control (PPSC) has shown superiority in handling such PV intermittency due to its battery-less operations. However, the implementation of PPSC is largely dependent on the quality of solar forecasts, i.e, high accuracy over a long horizon, which has seriously limited its extensive application in practice. In this context, this paper proposes a novel PPSC method based on deep reinforcement learning (RL). In addition to the actor-critic structures, a new module, namely, compensator is developed to tackle the problems of sparse reward and state transition stochasticity that are typically associated with the PPSC control task. On top of it, a novel scenario recognized experience replay (SRER) is devised to deal with the data distribution mismatching issue in PPSC. The effectiveness of the proposed method is verified using real-world data from a solar measurement grid. Empirical studies show that compared with the conventional PPSC method, the proposed method can achieve more robust smoothing performance under various forecasting scenarios, rendering it more applicable to practical PV system operations.

Item ID: 78550
Item Type: Article (Research - C1)
ISSN: 1949-3037
Keywords: deep reinforcement learning (RL), Photovoltaics (PV), proactive power smoothing, solar forecasting
Copyright Information: © 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
Date Deposited: 28 Aug 2023 05:13
FoR Codes: 40 ENGINEERING > 4008 Electrical engineering > 400803 Electrical energy generation (incl. renewables, excl. photovoltaics) @ 20%
40 ENGINEERING > 4008 Electrical engineering > 400808 Photovoltaic power systems @ 80%
SEO Codes: 17 ENERGY > 1703 Energy storage, distribution and supply > 170309 Smart grids @ 20%
17 ENERGY > 1708 Renewable energy > 170804 Solar-photovoltaic energy @ 80%
Downloads: Total: 1
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page