Attentive convolutional deep reinforcement learning for optimizing solar-storage systems in real-time electricity markets

Research output: Contribution to journalArticleResearchpeer-review

2 Citations (Scopus)

Abstract

This article studies the synergy of solar-battery energy storage system (BESS) and develops a viable strategy for the BESS to unlock its economic potential by serving as a backup to reduce solar curtailments while also participating in the electricity market. We model the real-time bidding of the solar-battery system as two Markov decision processes for the solar farm and the BESS, respectively. We develop a novel deep reinforcement learning (DRL) algorithm to solve the problem by leveraging attention mechanism (AC) and multigrained feature convolution to process DRL input for better bidding decisions. Simulation results demonstrate that our AC-DRL outperforms two optimization-based and one DRL-based benchmarks by generating 23%, 20%, and 11% higher revenue, as well as improving curtailment responses. The excess solar generation can effectively charge the BESS to bid in the market, significantly reducing solar curtailments by 76% and creating synergy for the solar-battery system to be more viable.

Original languageEnglish
Pages (from-to)7205-7215
Number of pages11
JournalIEEE Transactions on Industrial Informatics
Volume20
Issue number5
DOIs
Publication statusPublished - May 2024

Keywords

  • Batteries
  • Battery energy storage system (BESS)
  • deep reinforcement learning (DRL)
  • Degradation
  • electricity market
  • Electricity supply industry
  • Nanoelectromechanical systems
  • Optimization
  • Real-time systems
  • solar curtailment
  • solar photovoltaic (PV)
  • Solar power generation

Cite this