SU Kaiyan, ZHENG Bowen, ZHANG Jing, et al. Power Control and Demand Response Optimization Method for Direct Expansion Air Conditioning Systems Based on Deep Reinforcement Learning[J]. 2026, 46(13): 5420-5431.
SU Kaiyan, ZHENG Bowen, ZHANG Jing, et al. Power Control and Demand Response Optimization Method for Direct Expansion Air Conditioning Systems Based on Deep Reinforcement Learning[J]. 2026, 46(13): 5420-5431.DOI: 10.13334/j.0258-8013.pcsee.250398.
随着城市电力需求的不断增长,直膨式可变风量空调系统(direct expansion variable air volume system,DXVAV)可作为灵活调节负载,参与电力系统需求响应调控。然而,如何在满足温度舒适性和安全约束的同时,优化功率控制并避免功率峰值反弹,仍然是一个亟待解决的挑战。针对这些问题,该文提出一种基于深度强化学习(deep reinforcement learning,DRL)的无模型控制策略,利用其自学习和自适应能力,实现对DXVAV系统的智能调控;此外,引入一种基于非线性映射的安全层,以确保空调系统组件的安全性;同时,设计一种自适应奖励机制来应对恢复阶段可能出现的功率峰值反弹问题,维护了电网的平稳性;最后,通过引入累计奖励优化策略,更好地追踪和优化控制策略,解决了空调系统中的控制延迟问题。仿真结果表明,提出的策略能有效降低实时功率至需求响应目标,并确保恢复阶段功率平稳,有效提升系统灵活性和安全性。
Abstract
With the continuous growth of urban electricity demand
direct expansion variable air volume (DXVAV) air conditioning systems are investigated as flexible adjustable loads to participate in power system demand response regulation. However
it remains a challenge to optimize power control while satisfying thermal comfort and safety constraints
particularly in avoiding power peak rebound. This paper proposes a model-free control strategy based on deep reinforcement learning(DRL)
leveraging its self-learning and adaptive capabilities to achieve intelligent regulation of DXVAV systems. This study incorporates a safety layer based on nonlinear mapping to ensure component safety
designs an adaptive reward mechanism to address power peak rebound during recovery phases and maintain grid stability and develops a cumulative reward optimization strategy to track and optimize control policies
thereby resolving control delay issues. Simulation results demonstrate that the proposed strategy effectively reduces real-time power consumption to demand response targets while ensuring smooth power recovery
significantly enhancing system flexibility and safety.