Reinforcement learning for robust voltage control in distribution grids under uncertainties - APTIKAL Access content directly
Journal Articles Sustainable Energy, Grids and Networks Year : 2023

Reinforcement learning for robust voltage control in distribution grids under uncertainties

Abstract

Traditional optimization-based voltage controllers for distribution grid applications require consumption/production values from the meters as well as accurate grid data (i.e., line impedances) for modeling purposes. Those algorithms are sensitive to uncertainties, notably in consumption and production forecasts or grid models. This paper focuses on the latter. Indeed, line parameters gradually deviate from their original values over time due to exploitation and weather conditions. Also, those data are oftentimes not fully available at the low voltage side thus creating sudden changes between the datasheet and the actual value. To mitigate the impact of uncertain line parameters, this paper proposes the use of a deep reinforcement learning algorithm for voltage regulation purposes in a distribution grid with PV production by controlling the setpoints of distributed storage units as flexibilities. Two algorithms are considered, namely TD3PG and PPO. A two-stage strategy is also proposed, with offline training on a grid model and further online training on an actual system (with distinct impedance values). The controllers' performances are assessed concerning the algorithms' hyperparameters, and the obtained results are compared with a second-order conic relaxation optimization-based control. The results show the relevance of the RL-based control, in terms of accuracy, robustness to gradual or sudden variations on the line impedances, and significant speed improvement (once trained). Validation runs are performed on a simple 11-bus system before the method's scalability is tested on a 55-bus network.
Fichier principal
Vignette du fichier
2022_SEGAN.pdf (1.22 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03912935 , version 1 (26-12-2022)

Identifiers

Cite

Aleksandr Petrusev, Muhammad Andy Putratama, Rémy Rigo-Mariani, Vincent Debusschere, Patrick Reignier, et al.. Reinforcement learning for robust voltage control in distribution grids under uncertainties. Sustainable Energy, Grids and Networks, 2023, 33, pp.100959. ⟨10.1016/j.segan.2022.100959⟩. ⟨hal-03912935⟩
86 View
133 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More