YANG Di, WANG Hui, YANG Ruitong, et al. Spatio-temporal Dispatch Strategy of Mobile Energy Storage Based on Multi-agent Deep Reinforcement Learning With Adaptive Reward Function[J]. 2026, 46(17): 6235-6249.
YANG Di, WANG Hui, YANG Ruitong, et al. Spatio-temporal Dispatch Strategy of Mobile Energy Storage Based on Multi-agent Deep Reinforcement Learning With Adaptive Reward Function[J]. 2026, 46(17): 6235-6249.DOI: 10.13334/j.0258-8013.pcsee.251329.
移动储能系统(mobile energy storage systems,MESS)是缓解分布式可再生能源供需时空不匹配问题和促进其就近消纳的关键技术。在多源、多负荷的分布式能源系统中,MESS的高效调度面临移动节点抉择和充放电决策的时空复杂耦合、多重约束冲突等复杂问题,传统依赖精确模型的优化方法难以获得高效的调度策略。为此,该文提出一种基于自适应奖励函数-多智能体深度强化学习的MESS时空调度策略。该方法将MESS调度问题建模为多智能体马尔科夫决策过程,利用多智能体协同架构解耦时空强耦合的高维决策问题,并通过智能体与环境交互学习机制,实现MESS在复杂环境中的自适应调度。此外,所提策略引入自适应权重调整机制,引导MESS在复杂环境中逐步形成合理的决策偏好,从而显著提升学习效率与模型收敛性能。结果表明,所提策略能够让MESS在复杂场景中实现高效调度,表现出良好的稳定性和鲁棒性,为分布式能源系统中MESS的智能调度提供理论支持与实践参考。
Abstract
Mobile energy storage systems (MESS) are crucial technologies for alleviating the spatiotemporal mismatch between distributed renewable energy supply and demand
while promoting its local consumption. In systems characterized by multiple energy sources and loads
the efficient scheduling of MESS is challenged by the spatiotemporal coupling between mobile node selection and charge/discharge decisions
as well as multiple conflicting constraints. Traditional optimization approaches relying on precise mathematical models often fail to derive effective scheduling strategies under such conditions. To address this
this paper proposes a spatiotemporal scheduling strategy based on an adaptive reward function and multi-agent deep reinforcement learning. The problem is formulated as a multi-agent Markov decision process and cooperative multi-agent framework is used to decouple the high-dimensional problem with strong spatiotemporal coupling. Through agent-environment interaction
the system autonomously learns adaptive scheduling strategies in complex scenarios. Furthermore
this paper introduces an adaptive weight adjustment mechanism to guide MESS in developing rational decision-making preferences under dynamic conditions
significantly improving learning efficiency and model convergence. Simulation results demonstrate that the proposed strategy enables MESS to achieve efficient scheduling in complex scenarios
demonstrating strong stability and robustness
and providing theoretical support and practical reference for the intelligent scheduling of MESS in distributed energy systems.