Qingkai Sun, Xiaojun Wang, Zhao Liu, 等. Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Constrained Reinforcement Learning[J]. 中国电机工程学会电力与能源系统学报(英文), 2025,11(5):2413-2426.
Qingkai Sun, Xiaojun Wang, Zhao Liu, et al. Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Constrained Reinforcement Learning[J]. CSEE Journal of Power and Energy Systems, 2025, 11(5): 2413-2426.
Qingkai Sun, Xiaojun Wang, Zhao Liu, 等. Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Constrained Reinforcement Learning[J]. 中国电机工程学会电力与能源系统学报(英文), 2025,11(5):2413-2426.DOI: 10.17775/CSEEJPES.2021.08770.
Qingkai Sun, Xiaojun Wang, Zhao Liu, et al. Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Constrained Reinforcement Learning[J]. CSEE Journal of Power and Energy Systems, 2025, 11(5): 2413-2426.DOI: 10.17775/CSEEJPES.2021.08770.
Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Constrained Reinforcement Learning
An integrated energy system includes multiple sub-systems of electricity
heating
and gas. It is difficult to achieve dynamic dispatch of multi-energy flows due to challenges in establishing detailed mathematical models and the impacts of uncertain factors. Reinforcement learning has the ability to fit non-convex and nonlinear problems. It avoids simplifying detailed mathematical models and complex
uncertain factors in the solution process
like traditional methods
which provides a new idea for achieving dynamic energy dispatch. However
existing research generally relies on soft constraints
such as reward function penalties
to obtain the dispatch strategy
which may violate the system's operational safety. This paper ensures the security of dynamic energy dispatch strategies by adding two constraint mechanisms on reinforcement learning. First
boundary conditions of the action security domain are established through continuous interaction and feedback between the agent and the environment. It can effectively restrict infeasible actions. Second
the strategy is constrained by the truncation function in the trust domain
and strategy update is always kept within a controllable range to improve convergence and stability of the IES dynamic energy dispatch model. Finally
simulation results indicate that the proposed method can effectively constrain agent action selections and strategy updates during the dynamic energy dispatch process. This is of great significance to ensure the safe and stable operation of the system.
Pricing Strategy for Regional Integrated Energy System Considering Privacy Based on Deep Reinforcement Learning
Distributionally Robust Economic Dispatch Using IDM for Integrated Electricity-heat-gas Microgrid Considering Wind Power
Coordinated Optimal Dispatching Approach for Integrated Energy System Cluster Based on Improved Deep Reinforcement Learning
Economic Dispatch in Microgrids with Photovoltaic and Load Communication Failures Using Deep Reinforcement Learning with Relative Entropy Regularized Asynchronous Update
Integrated Optimization Planning of Multiple Energy Stations for Low Carbon Operation
相关作者
Xiong Wu
Bingwen Liu
Shengqi Yuan
Binrui Cao
Ziyu Zhang
Yanhong Hu
Yang Liu
Xianbang Chen
相关机构
School of Electrical Engineering Department, Xi'an Jiaotong University
College of Electrical Engineering, Sichuan University
ECE Department, Stevens Institute of Technology, Hoboken
School of Electrical Engineering, Southeast University
Zhejiang Electric Power Corporation Research Institute