Deposit and withdraw: Reinforcement learning-based incentive design for shared energy storage

Xin Lu; Junhua Zhao; Jing Qiu; Cuo Zhang; Gang Lei; Jianguo Zhu

doi:10.1049/enc2.70023

您当前的位置：

首页 >

文章列表页 >

Deposit and withdraw: Reinforcement learning-based incentive design for shared energy storage

更新时间：2026-03-24

- Deposit and withdraw: Reinforcement learning-based incentive design for shared energy storage
- Energy Conversion and Economics Vol. 6, Issue 5, (2025)
- 作者机构：
  
  1. School of Electrical and Computer Engineering, The University of Sydney,Sydney,Australia
  2. School of Science and Engineering, The Chinese University of Hong Kong,Shenzhen,China
  3. Contribution: Conceptualization, Methodology, Resources, Software, Writing - original draft
  4. Contribution: Resources, Supervision, Writing - review & editing
  5. Contribution: Supervision, Writing - review & editing
  6. Contribution: Supervision, Validation, Writing - review & editing
  7. School of Electrical and Data Engineering, University of Technology Sydney,Sydney,Australia
- 作者简介：
- 基金信息：
- DOI：10.1049/enc2.70023
  CLC：
- Published：2025
- 稿件说明：
移动端阅览
Xin Lu, Junhua Zhao, Jing Qiu, et al. Deposit and withdraw: Reinforcement learning-based incentive design for shared energy storage[J]. Energy Conversion and Economics, 2025, 6(5).
DOI：

Xin Lu, Junhua Zhao, Jing Qiu, et al. Deposit and withdraw: Reinforcement learning-based incentive design for shared energy storage[J]. Energy Conversion and Economics, 2025, 6(5). DOI： 10.1049/enc2.70023.

摘要

Abstract

Many residential prosumers exhibit a high price tolerance for household electricity bills and a low response to price incentives. This is because household electricity bills are not inherently high

and the potential for saving electricity bills through participation in conventional shared energy storage (SES) is limited

which diminishes their motivation to actively engage in SES. Additionally

existing SES models often require prosumers to take additional actions

such as optimising rental capacity and bidding prices

which happen to be capabilities that typical household prosumers do not possess. To incentivise these high-price-tolerance residential prosumers to participate in SES

a novel SES aggregation framework is proposed

which does not require prosumers to take additional actions and allows them to maintain existing energy storage patterns. Compared to the conventional long-term operation of SES

the proposed framework introduces an additional short-term construction step during which the energy service provider (ESP) acquires control of the energy storage systems (ESS) and offers electricity deposit and withdrawal services (DWS) with dynamic coefficients

enabling prosumers to withdraw more electricity than they deposit without additional actions. Additionally

a matching mechanism is proposed to align prosumers’ electricity consumption behaviours with ESP optimisation strategies. Finally

the dynamic coefficients in the DWS and SES trading strategies are jointly optimised using a modified deep reinforcement learning algorithm. Combining neighbouring experience pool replay modifies the twin delay deep deterministic policy gradient (CNEPR-TD3)

which introduces a multilabel neighbouring experience replay mechanism to improve learning efficiency and convergence stability. Simulation studies based on one-year real-world data validated the proposed approach. Ablation experiments showed that the inclusion of dynamic DWS and the matching mechanism increased the overall SES profit by 42.87%

confirming the effectiveness and economic value of the proposed framework.

关键词

Keywords

references

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Mobile battery energy storage system control with knowledge-assisted deep reinforcement learning

A data-driven method for microgrid bidding optimization in electricity market

Highly transferable adversarial attack against deep-reinforcement-learning-based frequency control

Related Author

Huan Zhao

Junhua Zhao

Yan Xu

Xu Wan

Related Institution

School of Electrical and Electronic Engineering, Nanyang Technological University

Junhua Zhao, School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS)

Contribution: Conceptualization, Investigation, Methodology, Writing - review & editing

Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS)

Huan Zhao, School of Electrical and Electronic Engineering, Nanyang Technological University

AI问答

⁰