Assessment of Deep Reinforcement Learning Algorithms for Three-Phase Inverter Control

Oswaldo Menéndez, Diana López-Caiza, Luca Tarisciotti, Felipe Ruiz, Fernando Auat-Cheein, José Rodríguez

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deep reinforcement learning (DRL) offers outstanding algorithms to develop optimal controllers for power converters with uncertainties and non-linear dynamics. This work comprehensively analyses a model-free control algorithm for three-phase inverters using DRL agents. To this end, different deep deterministic policy gradient (DDPG) agents with variable hyperparameters were conceptualized, designed, and tested. On average, DDPG agents were shown to have excellent performance in the control of power inverters. Indeed, DDPG agents reduce the impact of model uncertainties and non-linear dynamics. To validate the proposed control policy, the two-level voltage source power inverter is simulated. Also, the main features of the control strategy are analyzed in terms of computational cost, root medium square error (RMSE), and total harmonic distortion (THD). Simulated results reveal that the proposed control strategy exhibits strong performance in the current control task, achieving a maximum RMSE of 0.78 A and a THD of 3.17% for a 6 kHz sampling frequency.
Original languageEnglish
Title of host publication8th IEEE Southern Power Electronics Conference and 17th Brazilian Power Electronics Conference (SPEC/COBEP)
PublisherIEEE
ISBN (Electronic)9798350321128
DOIs
Publication statusPublished - 1 Feb 2024

Keywords

  • Neural network
  • artificial intelligence
  • deep reinforcement learning
  • non-linear control
  • power converter
  • voltage source inverter

ASJC Scopus subject areas

  • Mechanical Engineering
  • Control and Optimization
  • Energy Engineering and Power Technology
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Assessment of Deep Reinforcement Learning Algorithms for Three-Phase Inverter Control'. Together they form a unique fingerprint.

Cite this