Multi-source Frequency Modulation Strategies Based on Stackelberg Game and Deep Adaptive Dynamic Programming

SONG Shuting; TANG Zhen; WANG Wei; BAI Xueting; LI Hanning; ZHAO Zeyu

doi:10.19725/j.cnki.1007-2322.2023.0348

English Version Reader LoginJournal Login

您当前的位置：

首页 >

文章列表页 >

Multi-source Frequency Modulation Strategies Based on Stackelberg Game and Deep Adaptive Dynamic Programming

更新时间：2025-10-22

- Multi-source Frequency Modulation Strategies Based on Stackelberg Game and Deep Adaptive Dynamic Programming
- Vol. 42, Issue 5, Pages: 947-955(2025)
- 作者机构：
  
  1. 国网山西省电力公司,山西省,太原市,030021
  2. 国网山西省电力科学研究院,山西省,太原市,030001
  3. 中国电力科学研究院有限公司, 北京市海淀区,100192
- 作者简介：
- 基金信息：
- DOI：10.19725/j.cnki.1007-2322.2023.0348
  CLC： 5
- Published：2025
- 稿件说明：
移动端阅览
SONG Shuting, TANG Zhen, WANG Wei, et al. Multi-source Frequency Modulation Strategies Based on Stackelberg Game and Deep Adaptive Dynamic Programming[J]. 2025, 42(5): 947-955.
DOI：

SONG Shuting, TANG Zhen, WANG Wei, et al. Multi-source Frequency Modulation Strategies Based on Stackelberg Game and Deep Adaptive Dynamic Programming[J]. 2025, 42(5): 947-955. DOI： 10.19725/j.cnki.1007-2322.2023.0348.

摘要

为了解决新能源高渗透率下电网频率波动较大的问题，提出一种用于智能发电控制的博弈深度自适应动态规划(Stackelberg deep adaptive dynamic programming，SDADP)的多源调频协调策略。首先，采用自适应动态规划模型的3个深度神经网络结构，学习电网历史数据特征，顺序进行预测、评价、执行动作，预测总调频功率指令，以减小多源系统的区域控制误差。然后，基于主从博弈，合理调度风光水火储调频源的功率，提高调频收益。最后，通过仿真验证所提多源调频博弈策略的协调优化结果。结果表明，所提SDADP多源调频博弈协调策略可降低多源系统频率偏差，并提高调频整体经济收益。

Abstract

To address the issue of large frequency fluctuation in high penetration grid

a multi-source frequency regulation strategy of Stackelberg deep adaptive dynamic programming (SDADP) is proposed for smart generation control. Firstly

three deep neural network structures of the adaptive dynamic programming model are employed to acquire the characteristics from the historical data of the power grid and sequentially perform the prediction

evaluation

and execution actions for predicting the total frequency regulation power command

so as to minimize regional control error in a multi-source system. Based on the Stackelberg game

the power from wind

solar

hydropower

fire

and storage sources is subsequently reasonably scheduled to enhance the frequency regulation gain. Finally

the coordination optimization results of the proposed multi-source frequency regulation game strategy are verified through simulation analysis. The proposed SDADP multisource frequency regulation game strategy can mitigate the frequency deviation in the multisource system and improve the overall economic gain of frequency regulation.

关键词

Keywords

references

TAN Xiandong, LIU Jun, XU Zhicheng, et al. Power supply and demand balance during the 14th five-year plan period under the goal of carbon emission peak and carbon neutrality[J]. Electric Power, 2021, 54(05): 1−6(in Chinese).

谭显东, 刘俊, 徐志成, 等. “双碳”目标下“十四五”电力供需形势[J]. 中国电力, 2021, 54(05): 1−6.

BASU M. Multi-region dynamic economic dispatch of solar–wind–hydro–thermal power system incorporating pumped hydro energy storage[J]. Engineering Applications of Artificial Intelligence, 2019, 86: 182−196.

GUO M, ZHENG J, MEI F, et al. Double-layer AGC frequency regulation control method considering operating economic cost and energy storage SOC consistency[J]. International Journal of Electrical Power Energy Systems, 2023, 145: 108704.

SONG Xingrong, WU Jinbo, YANG Zhixue, et al. Multi-source AGC coordination optimization method with wind-PV-hydro-thermal based on multi-objective particle swarm optimization algorithm[J]. Journal of Chongqing University, 2022, 45(07): 13−23(in Chinese).

宋兴荣, 吴晋波, 杨志学, 等. 基于多目标粒子群算法的风光水火多源AGC协调优化方法[J]. 重庆大学学报, 2022, 45(07): 13−23.

YANG Lei, LI Shengnan, HUANG Wei, et al. Optimal coordinated control of multi-source for AGC with participation of wind and solar energy[J]. Power System Protection and Control, 2020, 48(19): 43−49(in Chinese).

杨蕾, 李胜男, 黄伟, 等. 考虑风光新能源参与二次调频的多源最优协同控制[J]. 电力系统保护与控制, 2020, 48(19): 43−49.

HU Yaping, NIE Yongquan, HE Yubin, et al. Improved frequency control strategy for power grid with high proportion of renewable energy based on ELM prediction model[J]. Power System and Clean Energy, 2022, 38(07): 98−106(in Chinese).

胡亚平, 聂涌泉, 何宇斌, 等. 基于ELM预测模型的高比例新能源电网改进频率控制策略[J]. 电网与清洁能源, 2022, 38(07): 98−106.

ZHANG G, ZHU Q. Event-triggered optimal control for nonlinear stochastic systems via adaptive dynamic programming[J]. Nonlinear Dynamics, 2021, 105(1): 387−401.

YIN L, YU T, YANG B, et al. Adaptive deep dynamic programming for integrated frequency control of multi-area multi-microgrid systems[J]. Neurocomputing (Amsterdam), 2019, 344: 49−60.

ZARINA P P, MISHRA S, SEKHAR P C. Exploring frequency control capability of a PV system in a hybrid PV-rotating machine-without storage system[J]. International Journal of Electrical Power Energy Systems, 2014, 60: 258−267.

CHANG-CHIEN L, SUN C, YEH Y. Modeling of wind farm participation in AGC[J]. IEEE Transactions on Power Systems, 2014, 29(3): 1204−1211.

HE Tingyi, LI Shengnan, CHEN Yiping, et al. Multi-source optimal coordinated frequency regulation for power grid with high penetration of renewable energy[J]. Electric Power Construction, 2021, 42(10): 51−59(in Chinese).

何廷一, 李胜男, 陈亦平, 等. 高比例新能源电网多源最优协同调频策略[J]. 电力建设, 2021, 42(10): 51−59.

YANG Yue, WANG Dan, HU Bo, et al. Multi-source optimal joint frequency modulation control strategy based on improved multi-agent Q-learning[J]. Power System Protection and Control, 2022, 50(07): 135−144(in Chinese).

杨悦, 王丹, 胡博, 等. 基于改进多智能体Q学习的多源最优联合调频控制策略研究[J]. 电力系统保护与控制, 2022, 50(07): 135−144.

AKRAM U, NADARAJAH M, SHAH R, et al. A review on rapid responsive energy storage technologies for frequency regulation in modern power systems[J]. Renewable and Sustainable Energy Reviews, 2020, 120: 109626.

SHIM J W, VERBIC G, ZHANG N, et al. Harmonious integration of faster-acting energy storage systems into frequency control reserves in power grid with high renewable generation[J]. IEEE Transactions on Power Systems, 2018, 33(6): 6193−6205.

ZENG Jun, HU Jiajian, XU Mingkang, et al. Collaborative optimization algorithm for aggregating energy storage in frequency modulation service[J]. Control Theory Applications, 2021, 38(07): 1051−1060(in Chinese).

曾君, 胡家健, 徐铭康, 等. 储能汇聚参与辅助调频服务的协同优化算法[J]. 控制理论与应用, 2021, 38(07): 1051−1060.

LU Q, LV S, LENG Y. A Nash-Stackelberg game approach in regional energy market considering users' integrated demand response[J]. Energy, 2019, 175: 456−470.

LI Y, ZHAO T, LIU C, et al. An interactive decision-making model based on energy and reserve for electric vehicles and power grid using generalized stackelberg game[J]. IEEE Transactions on Industry Applications, 2019, 55(4): 3301−3309.

LI Peng, WU Difan, LI Yuwei, et al. Optimal dispatch of multi-microgrids integrated energy system based on integrated demand response and Stackelberg game[J]. Proceedings of the CSEE, 2021, 41(04): 1307−1321(in Chinese).

李鹏, 吴迪凡, 李雨薇, 等. 基于综合需求响应和主从博弈的多微网综合能源系统优化调度策略[J]. 中国电机工程学报, 2021, 41(04): 1307−1321.

YIN L, WU Y. Deep Stackelberg heuristic dynamic programming for frequency regulation of interconnected power systems considering flexible energy sources[J]. Engineering Applications of Artificial Intelligence, 2021, 106: 104508.

LU Runge, CHEN Haoyong, YE Rong, et al. Feedback differential game cooperative control for primary and secondary frequency control of power system[J]. Control Theory Applications, 2014, 31(09): 1182−1189(in Chinese).

卢润戈, 陈皓勇, 叶荣, 等. 电力系统一二次调频的反馈微分博弈协同控制[J]. 控制理论与应用, 2014, 31(09): 1182−1189.

LIU Meng, CHU Xiaodong, ZHANG Wen, et al. A coordinated AGC strategy for interconnected power grid based on cooperative game theory[J]. Power System Technology, 2017, 41(05): 1590−1597(in Chinese).

刘萌, 褚晓东, 张文, 等. 基于合作博弈理论的互联电网AGC协调控制[J]. 电网技术, 2017, 41(05): 1590−1597.

SUN B, VAN KAMPEN E. Incremental model-based global dual heuristic programming with explicit analytical calculations applied to flight control[J]. Engineering Applications of Artificial Intelligence, 2020, 89: 103425.

YU M, HONG S H. A real-time demand-response algorithm for smart grids: A Stackelberg game approach[J]. IEEE Transactions on Smart Grid, 2015, 7(2): 879−888.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Electricity Trading Strategy of Microgrid Group Considering Alliance Priority Relationship

Coordinated Optimal Dispatching of Community-park Microgrid and Electric Vehicles Based on Mixed Game and Charging Pile Sharing

Research on Trading Strategy of Independent Energy Storage System Participating in Day Ahead Spot Joint Market Based on Master-slave Game

Game-based Operation Optimization for Photovoltaic Storage Charging Station Considering Photovoltaic Uncertainty and Carbon Trading

Energy Operator Operating Mode and Energy Management Based on Stackelberg Game

Related Author

Shunfu LIN

Jinsong LIU

Xiaolu LI

Jinyu ZHANG

Haohui SHAO

Kang YE

Zhongan YU

Xin AI

Related Institution

College of Electrical Engineering, Shanghai University of Electric Power, Yangpu District

State Grid Shanghai Electric Power Research Institute, Hongkou District

School of Electrical Engineering and Automation, Jiangxi University of Science and Technology

School of Electrical and Electronic Engineering, North China Electric Power University,Changping District

School of Economics and Management, North China Electric Power University, Changping District

AI问答

⁰