ZHU Jiebei, HUANG Minjie, YU Lujie, et al. Optimization Method of Control Parameters for VSC-HVDC Systems Based on Markov Transition Field and Deep Deterministic Policy Gradient Algorithm[J]. 2026, 46(5): 1821-1832.
DOI:
ZHU Jiebei, HUANG Minjie, YU Lujie, et al. Optimization Method of Control Parameters for VSC-HVDC Systems Based on Markov Transition Field and Deep Deterministic Policy Gradient Algorithm[J]. 2026, 46(5): 1821-1832.DOI: 10.13334/j.0258-8013.pcsee.241873.
Optimization Method of Control Parameters for VSC-HVDC Systems Based on Markov Transition Field and Deep Deterministic Policy Gradient Algorithm
针对柔性直流输电系统(voltage source converter based high voltage direct current transmission,VSC-HVDC)控制参数设计过程中存在的鲁棒性差、依赖已知电路参数、工程设计经验化等问题,提出一种基于马尔科夫转换场(Markov transition field,MTF)与深度确定性策略梯度算法(deep deterministic policy gradient,DDPG)结合的鲁棒性强、不依赖电路参数特性以及可视化的VSC-HVDC控制参数优化设计方法。首先,采用马尔科夫转换场将电路功率、电压等一维时序波形数据转换为二维马尔科夫转换场域图像并使用马尔科夫转换场损失函数(Markov transition field loss,MTFL)判断二维转换域图的数据波动性;其次,将MTFL损失函数与DDPG算法相结合,综合利用MTFL损失函数对系统输出时序数据动态特性评价能力更强的优点和DDPG算法泛化性能优秀的特点,实现VSC-HVDC系统控制参数优化;最后,通过MATLAB模拟和实验结果验证该方法的有效性。
Abstract
To improve the robustness and reduce reliance on circuit parameters and engineering experience in control parameters design for voltage source converter-based high voltage direct current transmission (VSC-HVDC) systems
this paper proposes a robust
circuit-parameter-independent
and visualizable optimization method for VSC-HVDC control parameter design based on the combination of Markov transition field (MTF) and deep deterministic policy gradient (DDPG) algorithms. Firstly
the Markov transition field is used to convert one-dimensional time series waveform data of circuit power and voltage into two-dimensional Markov transition field images
and the Markov transition field loss (MTFL) function is used to assess the volatility of the data in the two-dimensional transition domain. Secondly
by combining the MTFL function with the DDPG algorithm
the method takes advantage of the MTFL function’s strong ability to evaluate the dynamic characteristics of system output time series data and the excellent generalization performance of the DDPG algorithm
thereby enabling optimization of VSC-HVDC system control parameters. Finally
MATLAB simulations and experimental results validate the effectiveness of this method.
Transient Synchronization Stability Assessment and Parameter Design of Multiple Paralleled Renewable Energy Converter Systems
Modeling and Resonance Mechanism Analysis of MMC-HVDC Under Unload Condition Considering the High Frequency Characteristics of Electromagnetic Current Transformer Measurement Link
基于故障电流幅值和能量抑制贡献度的柔性直流限流设备参数优化
PID Neural Network Sliding-mode Controller for Three-level Offshore Wind Power VSC-HVDC Converter
含交流影响的MMC-HVDC直流故障电流递推计算方法
Related Author
ZHU Donghai
LI Xiangjinwen
WANG Yukun
ZOU Xudong
KANG Yong
HU Yinghong
SHEN Yuchen
YIN Guangzu
Related Institution
Jiaxing Power Supply Bureau of Zhejiang Power Grid
State Key Laboratory of Advanced Electromagnetic Technology (Huazhong University of Science and Technology)
Institute of Energy Power Innovation(North China Electric Power University), Changping District
Electric Power Research Institute of State Grid Jibei Electric Power Co., Ltd., Xicheng District