基于强化学习的风电场自适应调频控制方法

田盛; 刘永前; 田新首; 迟永宁

doi:10.19805/j.cnki.jcspe.2025.250268

欢迎来到能源电力期刊网！

English Version 期刊登录

您当前的位置：

首页 >

文章列表页 >

基于强化学习的风电场自适应调频控制方法

更新时间：2026-10-10

- 基于强化学习的风电场自适应调频控制方法
- Adaptive Frequency Regulation Control Method for Wind Farms Based on Deep Reinforcement Learning
- 动力工程学报 2025年45卷第10期页码：1689-1695
- 作者机构：
  
  1. 华北电力大学新能源学院,北京,102206
  2. 华北电力大学国家能源交通融合发展研究院,北京,102206
  3. 中国电力科学研究院,北京,100192
- 作者简介：
  
  田盛(1992—),男,辽宁大连人,博士研究生,研究方向为风电场调频控制,E-mail:me0411tian@126.com
- 基金信息：
  
  国家重点研发计划资助项目(2019YFE0104800)
- DOI：10.19805/j.cnki.jcspe.2025.250268
  中图分类号：
- 网络首发：2025-05-27，
  
  纸质出版：2025
- 稿件说明：
移动端阅览
田盛,刘永前,田新首,迟永宁. 基于强化学习的风电场自适应调频控制方法动力工程学报, 2025, 45(10): 1689-1695 https://doi.

org/10.19805/j.cnki.jcspe.2025.250268
田盛,刘永前,田新首,迟永宁. 基于强化学习的风电场自适应调频控制方法动力工程学报, 2025, 45(10): 1689-1695 https://doi. DOI： 10.19805/j.cnki.jcspe.2025.250268.

org/10.19805/j.cnki.jcspe.2025.250268 DOI：

摘要

针对传统自适应调频方法难以根据系统动态变化实时调整控制参数

限制调频性能提升的问题

提出了一种基于双延迟深度确定性策略梯度(twin delayed deep deterministic policy gradient

TD3)深度强化学习算法的风电场自适应调频控制方法。根据电网频率及风电场运行状态

智能体在训练过程中对调频参数进行学习和优化

实现对调频参数的动态自适应调整。结果表明:与传统自适应比例积分(PI)调频控制方法相比

所提方法在不同工况及负载扰动下的最大频率偏差显著降低

频率响应性能得到提升

验证了所提方法的有效性。

Abstract

To address the issue that traditional adaptive frequency regulation methods struggle to adjust control parameters in real time according to dynamic system changes

thereby limiting the enhancement of frequency modulation performance

an adaptive frequency regulation control method for wind farms was proposed

based on the twin delayed DDPG (TD3) deep reinforcement learning algorithm. According to grid frequency and wind farm operating conditions

the intelligent agent optimized and learned the frequency regulation parameters during the training process

achieving dynamic and adaptive adjustment of these parameters. Results show that compared with traditional adaptive proportional-integral (PI) frequency modulation control methods

the proposed approach significantly reduces the maximum frequency deviation under various operating conditions and load disturbances

and improves frequency response performance

validating the effectiveness of the method.

关键词

Keywords

references

刘中建, 周明, 李昭辉, 等. 高比例新能源电力系统的惯量控制技术与惯量需求评估综述[J]. 电力自动化设备, 2021, 41(12): 1-11, 53. LIU Zhongjian, ZHOU Ming, LI Zhaohui, et al. Review of inertia control technology and requirement evaluation in renewable-dominant power system[J]. Electric Power Automation Equipment, 2021, 41(12): 1-11, 53.

葛畅, 阎洁, 刘永前, 等. 海上风电场运行控制维护关键技术综述[J]. 中国电机工程学报, 2022, 42(12): 4278-4291. GE Chang, YAN Jie, LIU Yongqian, et al. Review of key technologies for operation control and maintenance of offshore wind farm[J]. Proceedings of the CSEE, 2022, 42(12): 4278-4291.

TIAN Sheng, LIU Yongqian, LI Baoliang, et al. An optimal operation strategy of wind farm for frequency regulation reserve considering wake effects[J]. Energy, 2024, 304: 131975.

李和明, 张祥宇, 王毅, 等. 基于功率跟踪优化的双馈风力发电机组虚拟惯性控制技术[J]. 中国电机工程学报, 2012, 32(7): 32-39. LI Heming, ZHANG Xiangyu, WANG Yi, et al. Virtual inertia control of DFIG-based wind turbines based on the optimal power tracking[J]. Proceedings of the CSEE, 2012, 32(7): 32-39.

张冠锋, 杨俊友, 孙峰, 等. 基于虚拟惯量和频率下垂控制的双馈风电机组一次调频策略[J]. 电工技术学报, 2017, 32(22): 225-232. ZHANG Guanfeng, YANG Junyou, SUN Feng, et al. Primary frequency regulation strategy of DFIG based on virtual inertia and frequency droop control[J]. Transactions of China Electrotechnical Society, 2017, 32(22): 225-232.

EKANAYAKE J, JENKINS N. Comparison of the response of doubly fed and fixed-speed induction generator wind turbines to changes in network frequency[J]. IEEE Transactions on Energy Conversion, 2004, 19(4): 800-802.

MORREN J, PIERIK J, DE HAAN S W H. Inertial response of variable speed wind turbines[J]. Electric Power Systems Research, 2006, 76(11): 980-987.

ZHANG Z S, SUN Y Z, LIN Jin, et al. Coordinated frequency regulation by doubly fed induction generator-based wind power plants[J]. IET Renewable Power Generation, 2012, 6(1): 38-47.

LEE J, JANG G, MULJADI E, et al. Stable short-term frequency support using adaptive gains for a DFIG-based wind power plant[J]. IEEE Transactions on Energy Conversion, 2016, 31(3): 1068-1079.

VAN DE VYVER J, DE KOONING J D M, MEERSMAN B, et al. Droop control as an alternative inertial response strategy for the synthetic inertia on wind turbines[J]. IEEE Transactions on Power Systems, 2016, 31(2): 1129-1138.

李想, 刘克天, 李军, 等. 基于风电机组转子动能的风电场一次调频功率分配优化[J]. 动力工程学报, 2023, 43(9): 1238-1246. LI Xiang, LIU Ketian, LI Jun, et al. Optimization of power distribution for primary frequency regulation of wind farm based on rotor kinetic energy of wind turbines[J]. Journal of Chinese Society of Power Engineering, 2023, 43(9): 1238-1246.

PRADHAN C, BHENDE C N, SAMANTA A K. Adaptive virtual inertia-based frequency regulation in wind power systems[J]. Renewable Energy, 2018, 115: 558-574.

JIANG Chao, CAI Guowei, YANG Dongfeng, et al. Multi-objective configuration and evaluation of dynamic virtual inertia from DFIG based wind farm for frequency regulation[J]. International Journal of Electrical Power & Energy Systems, 2024, 158: 109956.

GAO Haishu, ZHANG Feng, DING Lei, et al. Multi-segment droop control and optimal parameter setting strategy of wind turbine for frequency regulation[J]. International Journal of Electrical Power & Energy Systems, 2024, 158: 109968.

SENAPATI M K, PRADHAN C, NAYAK P K, et al. Lagrange interpolating polynomial-based deloading control scheme for variable speed wind turbines[J]. International Transactions on Electrical Energy Systems, 2019, 29(5): e2824.

GE Xiaolin, ZHU Xiaohe, FU Yang, et al. Optimization of reserve with different time scales for wind-thermal power optimal scheduling considering dynamic deloading of wind turbines[J]. IEEE Transactions on Sustainable Energy, 2022, 13(4): 2041-2050.

PRASAD R, PADHY N P. Synergistic frequency regulation control mechanism for DFIG wind turbines with optimal pitch dynamics[J]. IEEE Transactions on Power Systems, 2020, 35(4): 3181-3191.

TIAN Sheng, LIU Yongqian, TIAN Xinshou, et al. A wind farm control strategy for frequency regulation reserve: optimize wake loss and frequency support capability[J]. Renewable Energy, 2024, 237: 121645.

宋子秋, 余照国, 胡阳, 等. 海上漂浮式风电场高比例并网一次调频控制策略研究[J]. 动力工程学报, 2023, 43(1): 92-101. SONG Ziqiu, YU Zhaoguo, HU Yang, et al. Research on primary frequency regulation control strategy of high-penetration offshore floating wind farm[J]. Journal of Chinese Society of Power Engineering, 2023, 43(1): 92-101.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于深度策略梯度的综合能源系统优化调度研究

基于深度强化学习的风光耦合热电联产机组优化调度

基于自适应MPC的风电场多场景无功电压控制策略

煤-氨混燃锅炉建模及近邻传播-最小支持向量机多模态验证优化

奇异值分解用于早期摩擦故障诊断的研究