Research on Optimal Scheduling of Integrated Energy SystemsBased on Deep Deterministic Policy Gradient

WHANG Chenyu; YUAN Shufu; WANG Zhixiao; DING Ji; SUN Li

doi:10.19805/j.cnki.jcspe.2026.240740

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

Research on Optimal Scheduling of Integrated Energy SystemsBased on Deep Deterministic Policy Gradient

更新时间：2026-10-10

- Research on Optimal Scheduling of Integrated Energy SystemsBased on Deep Deterministic Policy Gradient
- Chinese Journal of Power Engineering Vol. 46, Issue 2, Pages: 193-201(2026)
- 作者机构：
  
  1. 东南大学能源与环境学院, 大型发电装备安全运行与智能测控国家工程研究中心,江苏,南京,210018
  2. 苏州同元软控信息技术有限公司,江苏,苏州,215000
- 作者简介：
- 基金信息：
- DOI：10.19805/j.cnki.jcspe.2026.240740
  CLC：
- Online First：10 February 2026，
  
  Published：10 February 2026
- 稿件说明：
移动端阅览
王臣宇,袁树福,王志霄,丁吉,孙立. 基于深度策略梯度的综合能源系统优化调度研究动力工程学报, 2026, 46(2): 193-201 https://doi.

org/10.19805/j.cnki.jcspe.2026.240740
王臣宇,袁树福,王志霄,丁吉,孙立. 基于深度策略梯度的综合能源系统优化调度研究动力工程学报, 2026, 46(2): 193-201 https://doi. DOI： 10.19805/j.cnki.jcspe.2026.240740.

org/10.19805/j.cnki.jcspe.2026.240740 DOI：

摘要

随着可再生能源的广泛应用

综合能源系统的运行复杂性和不确定性增大

传统的调度方法难以高效应对多能流、强耦合等问题。因此

构建了一个涵盖光伏、风力、氢气、蓄电池、热泵和燃料电池等设备的综合能源系统模型

结合深度强化学习深度策略梯度(DDPG)算法

以实现在不确定性工况下的能源调度优化。结果表明:DDPG算法能够有效解决多能流协同调度问题

在不同负荷需求和能源供应条件下

实现了电、热、冷、氢的供需平衡和能源高效利用;通过训练

系统在面对不同的不确定性工况下展现出良好的调度能力和适应性

能够灵活应对能源的波动。

Abstract

With the widespread application of renewable energy

the operational complexity and uncertainty of integrated energy systems have increased significantly. Traditional scheduling methods are insufficient to efficiently address issues such as multi-energy flows and strong coupling. Therefore

an integrated energy system model encompassing photovoltaic panels

wind turbines

hydrogen storage tanks

batteries

heat pumps

and fuel cells was developed. By combining the deep deterministic policy gradient (DDPG) algorithm

the energy scheduling optimization under uncertain conditions was achieved. Results show that the DDPG algorithm can effectively solve the problem of multi-energy flow coordinated scheduling

achieving supply-demand balance and efficient utilization of electricity

heat

cooling

and hydrogen under different load demands and energy supply conditions. Moreover

after training

the system exhibits excellent scheduling performance and adaptability when confronted with diverse uncertain scenarios

enabling flexible responses to energy fluctuations.

关键词

Keywords

references

李时, 王斌, 齐红涛, 等. 分布式园区综合能源系统经济调度监测与分析[J]. 电气自动化, 2024, 46(1):97-100, 103.LI Shi, WANG Bin, QI Hongtao, et al. Economic dispatch monitoring and analysis of integrated energy system in distributed park[J]. Electrical Automation, 2024, 46(1):97-100, 103.

王建. 煤电节能减排升级与改造行动启动[J]. 中国设备工程, 2014(10):10.WANG Jian. Launch of energy conservation and emission reduction upgrades and transformation actions for coal power[J]. China Plant Engineering, 2014(10):10.

苏艳. 双碳政策下产业园区的低碳模式探索[J]. 住宅与房地产, 2023(30):22-25.SU Yan. Exploration of low-carbon models for industrial parks under the dual-carbon policy[J]. Housing and Real Estate, 2023(30):22-25.

陈良. 考虑电热综合需求响应的园区综合能源系统协同优化配置研究[D]. 吉林:东北电力大学, 2023.

赵振宇, 邓涵予. 阶梯碳下考虑耦合电转气-碳捕集和热电联产灵活输出的综合能源系统优化调度[J]. 动力工程学报, 2024, 44(8):1287-1297.ZHAO Zhenyu, DENG Hanyu. Optimal scheduling of integrated energy systems considering coupled power to gas, carbon capture system, and combined heating and power flexible outputs under stepped carbon[J]. Journal of Chinese Society of Power Engineering, 2024, 44(8):1287-1297.

韩中合, 马立, 段宇轩, 等. 基于多元储能的分布式能源系统优化调度方法研究[J]. 动力工程学报, 2024, 44(2):317-327.HAN Zhonghe, MA Li, DUAN Yuxuan,et al. Research on optimal scheduling method of distributed energy system based on multi-energy storage[J]. Journal of Chinese Society of Power Engineering, 2024, 44(2):317-327.

邱勇, 王瑾, 张树斌, 等. 基于Modelica与Julia的气-热-电综合能源系统动态特性分析[J]. 软件导刊, 2023, 22(10):33-41.QIU Yong, WANG Jin, ZHANG Shubin, et al. Dynamic characteristics analysis of gas-heat-electricity integrated energy system based on Modelica and Julia[J]. Software Guide, 2023, 22(10):33-41.

SALAZAR A, BERZOY A, SONG Wenzhan, et al. Energy management of islanded nanogrids through nonlinear optimization using stochastic dynamic programming[J]. IEEE Transactions on Industry Applications, 2020, 56(3):2129-2137.

李俊. 风力发电机组发电性能影响因素分析[J]. 机械制造, 2024, 62(5):32-34, 43.LI Jun. Influencing factor analysis of power generation performance of wind turbine unit[J]. Machinery, 2024, 62(5):32-34, 43.

LISO V, SAVOIA G, ARAYA S S, et al. Modelling and experimental analysis of a polymer electrolyte membrane water electrolysis cell at different operating temperatures[J]. Energies, 2018, 11(12):3273.

STAFFELL I. Zero carbon infinite cop heat from fuel cell CHP[J]. Applied Energy, 2015, 147:373-385.

GONG Xianzhi, XIONG Rui, MI C C. Study of the characteristics of battery packs in electric vehicles with parallel-connected lithium-ion battery cells[J]. IEEE Transactions on Industry Applications, 2015, 51(2):1872-1879.

ZHENG Jinyang, ZHANG Xin, XU Ping, et al. Standardized equation for hydrogen gas compressibility factor for fuel consumption applications[J]. International Journal of Hydrogen Energy, 2016, 41(15):6610-6617.

TAHIR M F, CHEN Haoyong, MEHMOOD K, et al. Integrated energy system modeling of China for 2020 by incorporating demand response, heat pump and thermal storage[J]. IEEE Access, 2019, 7:40095-40108.

AKMAL M, FOX B. Modelling and simulation of underfloor heating system supplied from heat pump[C] //2016 UKSim-AMSS 18th International Conference on Computer Modelling and Simulation. Cambridge, UK:IEEE, 2016.

YU Chen, HUANG Yongping, ZHANG Chengbin. Role of metal foam in solidification performance for a latent heat storage unit[J]. International Journal of Energy Research, 2020, 44(1):2110-2125.

唐明, 李玉杰, 王林杰, 等. 冰蓄冷装置参与能量互补的微网自律协同控制研究[J]. 电力工程技术, 2022, 41(3):118-124, 132.TANG Ming, LI Yujie, WANG Linjie, et al. Autonomous coordinated control for microgrids considering multi-energy complementary with ice storage devices[J]. Electric Power Engineering Technology, 2022, 41(3):118-124, 132.

BINGOL M C. Investigation of the standard deviation of Ornstein-Uhlenbeck noise in the DDPG algorithm[J]. Gazi University Journal of Science Part C:Design and Technology, 2021, 9(2):200-210.

SUN Li, JIN Yuhui, SHEN Jiong, et al. Sustainable residential micro-cogeneration system based on a fuel cell using dynamic programming-based economic day-ahead scheduling[J]. ACS Sustainable Chemistry & Engineering, 2021, 9(8):3258-3266.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research on Optimal Regulation Method of Flexible Load Based on Users' Energy Consumption Behavior Prediction

Low-carbon Economic Dispatch of an Integrated Energy System Considering Flexible Carbon Capture and Hydrogen Energy Storage Systems

Dynamic Carbon Accounting and Multi-objective Low-carbon Synergy Optimization of Integrated Energy Systems

Dynamic Modelling of Carbon Energy Flow in Grid-connected Combined Cooling, Heating and Electricity Generation Energy Station and Optimization of Low-carbon Interaction Between Station and Network

Review and Prospect of Exergoeconomics' Theory, Method and Applications in Integrated Energy Systems

Related Author

HU Yubin

WU Shuzhou

ZHU Lin

LI Guiqiang

XI Changyuan

WU Di

HAN Shaofeng

SONG Han

Related Institution

Department of Thermal Science and Energy Engineering, University of Science and Technology of China (USTC)

Hebei Key Laboratory of Low Carbon and High Efficiency Power Generation Technology, North China Electric Power University

School of Energy Power and Mechanical Engineering, North China Electric Power University

Electric Power Research Institute of Guizhou Power Grid Co., Ltd.

College of Electrical Engineering, Guizhou University

AI问答

⁰