
1.School of Information Science and Engineering, Northeastern University, Shenyang 110819, China
2.State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang 110819, China
3.Department of Computer Science, Aalborg University, 9220 Aalborg, Denmark
Xiaoyu Zhang received the B.S. degree in automation from North China Electric Power University, Beijing, China, in 2018, and the M.S. degree in electrical engineering from Northeastern University, Shenyang, China, in 2024. She is currently pursuing the Ph.D. degree in control science and engineering at Northeastern University. Her research interests include machine learning, integrated energy system, and optimal scheduling. Email: 2410400@stu.neu.edu.cn
email: sunqiuye@ise.neu.edu.cn
Tianyi Li received the B.S. and M.S. degrees in computer science from Northeastern University, Shenyang, China, in 2014 and 2017, respectively, and the Ph.D. degree in computer science from Aalborg University, Aalborg, Denmark, in 2022. She is currently an Associate Professor with Aalborg University. Her research interests include trajectory analysis, time series analysis, machine learning, and digital twin. email: tianyi@cs.aau.dk
Yumeng Song received the B.S. degree in computer science and technology, the M.S. degree in computer software and theory, and the Ph.D. degree in computer science and technology from Northeastern University, Shenyang, China, in 2017, 2019, and 2024, respectively. She is currently an Assistant Professor with Aalborg University, Aalborg, Denmark. Her research interests include machine learning for spatio-temporal data management and analytics, graph neural network, and hypergraph neural network. Email:yumengs@cs.aau.dk;
Zhongming Yao received the B.S. and Ph.D. degrees in computer science and technology from Northeastern University, Shenyang, China, in 2017 and 2025, respectively. He is currently a Postdoctoral Researcher with Aalborg University, Aalborg, Denmark. His research interests include trajectory data management and analysis, energy management, and blockchain technology. Email:zyao@cs.aau.dk
Yushuai Li received the B.S. degree in electrical engineering and automation and the Ph.D. degree in control theory and control engineering from Northeastern University, Shenyang, China, in 2014 and 2019, respectively. He is currently an Assistant Professor with Aalborg University, Aalborg, Denmark. His research interests include machine learning, digital twin, and integrated energy and transportation system. Email:yushuaili@ieee.org
Received:27 July 2025,
Revised:2025-11-18,
Accepted:03 March 2026,
Online First:30 March 2026,
Published:15 September 2026
移动端阅览
Zhang Xiaoyu,Sun Qiuye,Li Tianyi,et al.A Survey on Large Language Models Enhanced Reinforcement Learning for Smart Grid[J].Journal of Modern Power Systems and Clean Energy,2026,14(05):1549-1567.
Zhang Xiaoyu,Sun Qiuye,Li Tianyi,et al.A Survey on Large Language Models Enhanced Reinforcement Learning for Smart Grid[J].Journal of Modern Power Systems and Clean Energy,2026,14(05):1549-1567. DOI: 10.35833/MPCE.2025.000685.
The smart grid (SG) is a modern power system that leverages digital technologies to enhance the generation
delivery
and consumption of electric power. Reinforcement learning (RL) plays an important role in SG by helping make smart decisions. However
RL faces challenges such as sparse rewards
poor generalization
and difficulty in representing and interpreting regulatory constraints. Large language models (LLMs) offer new opportunities to address these challenges by understanding natural language
leveraging external knowledge
and enhancing reasoning. This paper presents a comprehensive review of LLM-enhanced RL for SG. It first analyzes the key challenges of RL and introduces how LLMs help enhance the performance
including a taxonomy based on the integration patterns and functions. It then reviews applications of LLM-enhanced RL for SG
with a focus on energy management
operational control
electricity market
and hardware design. Finally
it discusses research challenges and future directions of LLM-enhanced RL for SG. This paper aims to provide a clear framework for researchers to apply LLMs in RL and to promote the application of RL for SG.
R. Wang, D. Ma, M. Li et al. , “Accurate current sharing and voltage regulation in hybrid wind/solar systems: an adaptive dynamic programming approach,” IEEE Transactions on Consumer Electronics , vol. 68 , no. 3 , pp. 261 - 272 , Aug. 2022 .
X. Zhang, Y. Li, T. Li et al. , “Digital twin empowered PV power prediction,” Journal of Modern Power Systems and Clean Energy , vol. 12 , no. 5 , pp. 1472 - 1483 , Sept. 2024.
Z. Tian, X. Li, J. Niu et al. , “Enhancing operation flexibility of distributed energy systems: a flexible multi-objective optimization planning method considering long-term and temporary objectives,” Energy , vol. 288 , p. 129765 , Feb. 2024 .
Y. Li, J. Xu, T. Li et al. , “Digital twin-empowered autonomous driving for e-mobility: concept, framework, and modeling,” IEEE Electrification Magazine , vol. 12 , no. 3 , pp. 68 - 77 , Sept. 2024.
R. A. Jabr and I. Džafić, “Distribution management systems for smart grid: architecture, work flows, and interoperability,” Journal of Modern Power Systems and Clean Energy , vol. 10 , no. 2 , pp. 300 - 308 , Mar. 2022 .
M. Fotopoulou, D. Rakopoulos, S. Petridis et al. , “Assessment of smart grid operation under emergency situations,” Energy , vol. 287 , p. 129612 , Jan. 2024 .
Y. Tan, Y. Chen, Y. Li et al. , “Linearizing power flow model: a hybrid physical model-driven and data-driven approach,” IEEE Transactions on Power Systems , vol. 35 , no. 3 , pp. 2475 - 2478 , May 2020.
M. Ahmad, N. Javaid, I. A. Niaz et al. , “A bio-inspired heuristic algorithm for solving optimal power flow problem in hybrid power system,” IEEE Access , vol. 9 , pp. 159809 - 159826 , Nov. 2021 .
J. He, Z. Han, and J. Hu, “Advanced sensors towards ubiquitous power internet of things,” CSEE Journal of Power and Energy Systems , vol. 10 , no. 3 , pp. 871 - 890 , May 2024.
O. Malik, J. Liu, M. Simões et al. , “Smart grid origins, definitions, technologies, and emerging trends: a power community perspective,” Journal of Modern Power Systems and Clean Energy , vol. 13 , no. 6 , pp. 1845 - 1853 , Nov. 2025 .
M. Liang, Q. Luo, T. Yu et al. , “LLM-based exploitation of edge data in modern power systems,” Journal of Modern Power Systems and Clean Energy , vol. 14 , no. 1 , pp. 63 - 81 , Jan. 2026 .
W. Song and S. Tong, “Inverse reinforcement learning optimal control for Takagi-Sugeno fuzzy systems,” Artificial Intelligence Science and Engineering , vol. 1 , no. 2 , pp. 134 - 146 , Jun. 2025 .
J. Yao, J. Xu, N. Zhang et al. , “Model-based reinforcement learning method for microgrid optimization scheduling,” Sustainability , vol. 15 , no. 12 , p. 9523 , Jun. 2023 .
X. Feng, T. Yang, S. Cai et al. , “A model-free scheduling method for heterogeneous electric vehicle cryptographic task processing architecture,” IEEE Transactions on Smart Grid , vol. 16 , no. 1 , pp. 505 - 518 , Jan. 2025 .
L. Yang, Q. Sun, N. Zhang et al. , “Indirect multi-energy transactions of energy internet with deep reinforcement learning approach,” IEEE Transactions on Power Systems , vol. 37 , no. 5 , pp. 4067 - 4077 , Sept. 2022.
Y. Nie, J. Liu, X. Liu et al. , “Asynchronous multi-agent reinforcement learning-based framework for bi-level noncooperative game-theoretic demand response,” IEEE Transactions on Smart Grid , vol. 15 , no. 6 , pp. 5622 - 5637 , Nov. 2024 .
Q. Meng, S. Hussain, F. Luo et al. , “An online reinforcement learning-based energy management strategy for microgrids with centralized control,” IEEE Transactions on Industry Applications , vol. 61 , no. 1 , pp. 1501 - 1510 , Jan.-Feb. 2025.
J. Xu, Y. Li, T. B. Pedersen et al. , “Digital twin-empowered voltage control for power systems,” in Proceedings of the 2024 IEEE 8th Conference on Energy Internet and Energy System Integration , Shenyang, China, Dec. 2024 , pp. 5045 - 5050 .
S. Liu, Y. Yao, J. Jia et al. , “Rethinking machine unlearning for large language models,” Nature Machine Intelligence , vol. 7 , pp. 181 - 194 , Feb. 2025 .
T. Wu, S. He, J. Liu et al. , “A brief overview of ChatGPT: the history, status quo and potential future development,” IEEE/CAA Journal of Automatica Sinica , vol. 10 , no. 5 , pp. 1122 - 1136 , May 2023.
S. Majumder, L. Dong, F. Doudi et al. , “Exploring the capabilities and limitations of large language models in the electric energy sector,” Joule , vol. 8 , no. 6 , pp. 1544 - 1549 , Jun. 2024 .
S. Li, T. Azfar, and R. Ke, “ChatSUMO: large language model for automating traffic scenario generation in simulation of urban mobility,” IEEE Transactions on Intelligent Vehicles , vol. 10 , no. 11 , pp. 4962 - 4973 , Nov. 2025 .
X. Lu, J. Qiu, Y. Yang et al. , “Large language model-based bidding behavior agent and market sentiment agent-assisted electricity price prediction,” IEEE Transactions on Energy Markets, Policy and Regulation , vol. 3 , no. 2 , pp. 223 - 235 , Jun. 2025 .
J. Gallifant, M. Afshar, S. Ameen et al. , “The TRIPOD-LLM reporting guideline for studies using large language models,” Nature Medicine , vol. 31 , pp. 60 - 69 , Jan. 2025 .
S. Bhambri, A. Bhattacharjee, H. Liu et al. (2024). Efficient reinforcement learning via large language model-based search. [Online ] . Available: https://openreview.net/forum?id=LyKRHmZj6m
R. Shi, Y. Liu, Y. Ze et al. (2024, Feb.). Unleashing the power of pre-trained language models for offline reinforcement learning. [Online ] . Available: https://openreview.net/forum?id=AY6aM13gGF
Y. Cao, H. Zhao, Y. Cheng et al. , “Survey on large language model-enhanced reinforcement learning: concept, taxonomy, and methods,” IEEE Transactions on Neural Networks and Learning Systems , vol. 36 , no. 6 , pp. 9737 - 9757 , Jun. 2025 .
R. Wang, D. Zhao, Z. Yuan et al. , “PrefCLM: enhancing preference-based reinforcement learning with crowdsourced large language models,” IEEE Robotics and Automation Letters , vol. 10 , no. 3 , pp. 2486 - 2493 , Mar. 2025 .
Z. Li, R. Zhang, Z. Wang et al. , “LLM-guided decision-making toolkit for multi-agent reinforcement learning,” Neurocomputing , vol. 638 , p. 128982 , Jul. 2025 .
H. Tian, K. Reddy, Y. Feng et al. (2024, Apr.). Enhancing autonomous vehicle training with language model integration and critical scenario generation. [Online ] . Available: https://arxiv.org/abs/2404.08570
G. Xie, J. Xu, Y. Ding et al . (2025, Mar.). Never too prim to swim: an LLM-enhanced RL-based adaptive S-surface controller for AUVs under extreme sea conditions. [Online ] . Available: https://arxiv.org/abs/2503.00527
Q. Yin, Z. Xiong, and Y. Liu, “LLM-enhanced reinforcement learning for traffic control at on-ramp merging areas,” in Proceedings of the 2024 International Conference on Artificial Intelligence and Autonomous Transportation , Beijing, China, Dec. 2024 , pp. 372 - 382 .
M. Pternea, P. Singh, A. Chakraborty et al. , “The RL/LLM taxonomy tree: reviewing synergies between reinforcement learning and large language models,” Journal of Artificial Intelligence Research , vol. 80 , pp. 1263 - 1310 , Aug. 2024 .
S. Schoepp, M. Jafaripour, Y. Cao et al . (2025, Feb.). The evolving landscape of LLM- and VLM-integrated reinforcement learning. [Online ] . Available: https://arxiv.org/abs/2502.15214
A. R. Laleh and M. N. Ahmadabadi. (2024, Nov.). A survey on enhancing reinforcement learning in complex environments: insights from human and LLM feedback. [Online]. Available: https://arxiv.org/abs/2411.13410
H. Zhou, C. Hu, and X. Liu. (2024, May). An overview of machine learning-enabled optimization for reconfigurable intelligent surfaces-aided 6G networks: from reinforcement learning to large language models. [Online]. Available: https://arxiv.org/abs/2405.17439
P. Osborne, H. Nõmm, and A. Freitas, “A survey of text games for reinforcement learning informed by natural language,” Transactions of the Association for Computational Linguistics , vol. 10 , pp. 873 - 887 , Aug. 2022 .
C. Sun, S. Huang, and D. Pompili. (2024, May). LLM-based multi-agent reinforcement learning: current and future directions. [Online]. Available: https://arxiv.org/abs/2405.11106
T. Su, T. Wu, J. Zhao et al. , “A review of safe reinforcement learning methods for modern power systems,” Proceedings of the IEEE , vol. 113 , no. 3 , pp. 213 - 255 , Mar. 2025 .
S. Madani, A. Tavasoli, Z. K. Astaneh et al. , “Large language models integration in smart grids,” Energy Reports , vol. 14 , pp. 1562 - 1577 , Dec. 2025 .
D. Zhang, J. Zhang, G. Wu et al. , “Optimal power dispatch of active distribution network and P2P energy trading based on soft actor-critic algorithm incorporating distributed trading control,” Journal of Modern Power Systems and Clean Energy , vol. 13 , no. 2 , pp. 540 - 551 , Mar. 2025 .
X. Wang, S. Wang, X. Liang et al. , “Deep reinforcement learning: a survey,” IEEE Transactions on Neural Networks and Learning Systems , vol. 35 , no. 4 , pp. 5064 - 5078 , Apr. 2024 .
H. Kheddar, D. W. Dawoud, A. I. Awad et al. , “Reinforcement-learning-based intrusion detection in communication networks: a review,” IEEE Communications Surveys & Tutorials , vol. 27 , no. 4 , pp. 2420 - 2469 , Aug. 2025 .
Y. Li, C. Yu, M. Shahidehpour et al. , “Deep reinforcement learning for smart grid operations: algorithms, applications, and prospects,” Proceedings of the IEEE , vol. 111 , no. 9 , pp. 1055 - 1096 , Sept. 2023.
Z. Zhang, D. Zhang, and R. Qiu, “Deep reinforcement learning for power system applications: an overview,” CSEE Journal of Power and Energy Systems , vol. 6 , no. 1 , pp. 213 - 225 , Mar. 2020 .
J. B. Hamrick, A. L. Friesen, F. Behbahani et al . (2021, Jan.). On t he role of planning in model-based deep reinforcement learning. [Online ] . Available: https://openreview.net/forum?id=IrM64DGB21
N. A. Hansen, H. Su, and X. Wang, “Temporal difference learning for model predictive control,” in Proceedings of the 39th International Conference on Machine Learning , Baltimore, USA, Jul. 2022 , pp. 8387 - 8406 .
J. Schrittwieser, I. Antonoglou, T. Hubert et al. , “Mastering Atari, Go, chess and shogi by planning with a learned model,” Nature , vol. 588 , pp. 604 - 609 , Dec. 2020 .
M. Janner, Q. Li, and S. Levine, “Offline reinforcement learning as one big sequence modeling problem,” in Proceedings of the 35th International Conference on Neural Information Processing Systems , Virtual event, Dec. 2021 , pp. 1273 - 1286 .
M. Janner, Y. Du, J. Tenenbaum et al. , “Planning with diffusion for flexible behavior synthesis,” in Proceedings of the 39th International Conference on Machine Learning , Baltimore, USA, Jul. 2022 , pp. 9902 - 9915 .
D. Hafner, J. Pasukonis, J. Ba et al. , “Mastering diverse control tasks through world models,” Nature , vol. 640 , pp. 647 - 653 , Apr. 2025 .
T. Yu, A. Kumar, R. Rafailov et al. , “COMBO: conservative offline model-based policy optimization,” in Proceedings of the 35th International Conference on Neural Information Processing Systems , Virtual event, Dec. 2021 , pp. 28954 - 28967 .
M. Rigter, B. Lacerda, and N. Hawes, “RAMBO-RL: robust adversarial model-based offline reinforcement learning,” in Proceedings of the 36th International Conference on Neural Information Processing Systems , New Orleans, USA, Nov. 2022 , pp. 16082 - 16097 .
T. Yu, G. Thomas, L. Yu et al. , “MOPO: model-based offline policy optimization,” in Proceedings of the 34th International Conference on Neural Information Processing Systems , Virtual event, Dec. 2020 , pp. 14129 - 14142 .
X. Gong, S. Lü, J. Yu et al. , “Adaptive estimation Q -learning with uncertainty and familiarity,” in Proceedings of the 32nd International Joint Conference on Artificial Intelligence , Macau, China, Aug. 2023 , pp. 3750 - 3758 .
F. Fourati, V. Aggarwal, and M. S. Alouini, “Stochastic Q -learning for large discrete action spaces,” in Proceedings of the 41st International Conference on Machine Learning , Vienna, Austria, Jul. 2024 , pp. 13734 - 13759 .
J. Ma, “Discerning temporal difference learning,” in Proceedings of the 38th AAAI Conference on Artificial Intelligence , Vancouver, Canada, Feb. 2024 , pp. 14238 - 14245 .
J. Chen, J. Feng, W. Gao et al. , “Decentralized natural policy gradient with variance reduction for collaborative multi-agent reinforcement learning,” Journal of Machine Learning Research , vol. 25 , no. 172 , pp. 1 - 49 , Jan. 2024 .
Y. Gan, R. Yan, Z. Wu et al. , “Reflective policy optimization,” in Proceedings of the 41st International Conference on Machine Learning , Vienna, Austria, Jul. 2024 , pp. 14471 - 14490 .
H. Xu, J. Xuan, G. Zhang et al. , “Trust region policy optimization via entropy regularization for Kullback-Leibler divergence constraint,” Neurocomputing , vol. 589 , p. 127687 , Jul. 2024 .
T. Q. Dam, K. Panaganti, B. Driss et al. (2025, May). Online robust reinforcement learning through Monte-Carlo planning. [Online ] . Available: https://openreview.net/forum?id=m25ma7O7Ec
T. Li, R. Huang, L. Chen et al. , “Compression of uncertain trajectories in road networks,” Proceedings of the VLDB Endowment , vol. 13 , no. 7 , pp. 1050 - 1063 , Mar. 2020 .
T. Li, L. Chen, C. S. Jensen et al. , “TRACE: real-time compression of streaming trajectories in road networks,” Proceedings of the VLDB Endowment , vol. 14 , no. 7 , pp. 1175 - 1187 , Mar. 2021 .
C. Zhu, X. Wang, T. Han et al. , “Distributional successor features enable zero-shot policy optimization,” in Proceedings of the 38th International Conference on Neural Information Processing Systems , Vancouver, Canada, Dec. 2024 , pp. 124612 - 124639 .
F. Wu, R. Zhang, Q. Yi et al. , “OCEAN-MBRL: offline conservative exploration for model-based offline reinforcement learning,” Proceedings of the AAAI Conference on Artificial Intelligence , vol. 38 , no. 14 , pp. 15897 - 15905 , Mar. 2024 .
Y. Seo, K. Lee, S. L. James et al. , “Reinforcement learning with action-free pre-training from videos,” in Proceedings of the 39th International Conference on Machine Learning , Baltimore, USA, Jul. 2022 , pp. 19561 - 19579 .
C. Sun, W. Yang, T. Jiralerspong et al. , “Contrastive retrospection: honing in on critical steps for rapid learning and generalization in RL,” in Proceedings of the 37th International Conference on Neural Information Processing Systems , New Orleans, USA, Dec. 2023 , pp. 31117 - 31139 .
Y. Wang, S. Zhan, R. Jiao et al. , “Enforcing hard constraints with soft barriers: safe reinforcement learning in unknown stochastic environments,” in Proceedings of the 40th International Conference on Machine Learning , Honolulu, USA, Jul. 2023 , pp. 36593 - 36604 .
P. Altmann, F. Ritz, L. Feuchtinger et al. , “CROP: towards distributional-shift robust reinforcement learning using compact reshaped observation processing,” in Proceedings of the 32nd International Joint Conference on Artificial Intelligence , Macao, China, Aug. 2023 , pp. 3414 - 3422 .
Q. Delfosse, H. Shindo, D. Dhami et al. , “Interpretable and explainable logical policies via neurally guided symbolic abstraction,” in Proceedings of the 37th International Conference on Neural Information Processing Systems , New Orleans, USA, Dec. 2023 , pp. 50838 - 50858 .
Z. Tan, D. Li, S. Wang et al. , “Large language models for data annotation and synthesis: a survey,” in Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , Miami, USA, Nov. 2024 , pp. 930 - 957 .
A. Asai, S. Kudugunta, X. Yu et al. , “BUFFET: benchmarking large language models for few-shot cross-lingual transfer,” in Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Mexico City, Mexico, Jun. 2024 , pp. 1771 - 1800 .
J. Wei, X. Wang, D. Schuurmans et al. , “Chain-of-thought prompting elicits reasoning in large language models,” Advances in Neural Information Processing Systems , vol. 35 , pp. 24824 - 24837 , Nov. 2022 .
W. Yang, L. Some, M. Bain et al. , “A comprehensive survey on integrating large language models with knowledge-based methods,” Knowledge-based Systems , vol. 318 , p. 113079 , Jun. 2025 .
K. Lu, A. Grover, P. Abbeel et al. , “Frozen pretrained transformers as universal computation engines,” Proceedings of the AAAI Conference on Artificial Intelligence , vol. 36 , no. 7 , pp. 7628 - 7636 , Jun. 2022 .
H. W. Chung, L. Hou, S. Longpre et al. , “Scaling instruction-finetuned language models,” Journal of Machine Learning Research , vol. 25 , no. 70 , pp. 1 - 53 , Feb. 2024 .
M. L. Quatra, V. M. Salerno, Y. Tsao et al. , “FlanEC: exploring Flan-T5 for post-ASR error correction,” in Proceedings of the 2024 IEEE Spoken Language Technology Workshop , Macau, China, Dec. 2024 , pp. 608 - 615 .
H. Touvron, T. Lavril, G. Izacard et al . (2023, Feb.). LLaMA: open and efficient foundation language models. [Online ] . Available: https://arxiv.org/abs/2302.13971
E. J. Hu, Y. Shen, P. Wallis et al . (2022). LoRA: low-rank adaptation of large language models. [Online ] . Available: https://openreview.net/forum?id=nZeVKeeFYf9
V. Zhong, D. Misra, X. Yuan et al. , “Policy improvement using language feedback models,” in Proceedings of the 38th International Conference on Neural Information Processing Systems , Vancouver, Canada, Dec. 2024 , pp. 43730 - 43758 .
S. Rho, L. Smith, T. Li et al. (2025, May). Language guided skill discovery. [Online ] . Available: https://openreview.net/forum?id=i3e92uSZCp
N. Shinn, F. Cassano, A. Gopinath et al. , “Reflexion: language agents with verbal reinforcement learning,” in Proceedings of the 37th International Conference on Neural Information Processing Systems , New Orleans, USA, Dec. 2023 , pp. 8634 - 8652 .
J. Pang, S. Yang, K. Li et al. , “KALM: knowledgeable agent by offline reinforcement learning from large language model rollouts,” in Proceedings of the 38th International Conference on Neural Information Processing Systems , Vancouver, Canada, Dec. 2024 , pp. 126620 - 126652 .
J. Zhang, K. Pertsch, J. Zhang et al. , “SPRINT: scalable policy pre-training via language instruction relabeling,” in Proceedings of the 2024 IEEE International Conference on Robotics and Automation , Yokohama, Japan, May 2024, pp. 9168 - 9175 .
I. Singh, V. Blukis, A. Mousavian et al. , “ProgPrompt: program generation for situated robot task planning using large language models,” Autonomous Robots , vol. 47 , no. 8 , pp. 999 - 1012 , Aug. 2023 .
Y. Chen, R. Gandhi, Y. Zhang et al. , “NL2TL: transforming natural languages to temporal logics using large language models,” in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , Singapore, Dec. 2023 , pp. 15880 - 15903 .
J. Liu, C. Yu, J. Gao et al. , “LLM-powered hierarchical language agent for real-time human-AI coordination,” in Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems , Auckland, New Zealand, May 2024, pp. 1219 - 1228 .
S. Qiao, R. Fang, N. Zhang et al. , “Agent planning with world knowledge model,” in Proceedings of the 38th International Conference on Neural Information Processing Systems , Vancouver, Canada, Dec. 2024 , pp. 114843 - 114871 .
Z. Ma, A. Chen, D. J. Kim et al. , “LLMParser: an exploratory study on using large language models for log parsing ,” in Proceedings of the 2024 IEEE/ACM 46th International Conference on Software Engineering , Lisbon, Portugal, Apr. 2024 , pp. 1209 - 1221 .
X. Li, Y. Sun, J. Lin et al. , “The synergy of seeing and saying: revolutionary advances in multi-modality medical vision-language large models,” Artificial Intelligence Science and Engineering , vol. 1 , no. 2 , pp. 79 - 97 , Jun. 2025 .
D. Driess, F. Xia, M. S. M. Sajjadi et al. , “PaLM-E: an embodied multimodal language model,” in Proceedings of the 40th International Conference on Machine Learning , Honolulu, USA, Jul. 2023 , pp. 8469 - 8488 .
T. Xie, S. Zhao, C. H. Wu et al . (2024, Apr.). Text2Reward: reward shaping with language models for reinforcement learning. [Online ] . Available: https://openreview.net/forum?id=tUM39YTRxH
B. Rabiei, Z. Dai, S. L. Pilla et al . (2025, Mar.). LTLCodeGen: code generation of syntactically correct temporal logic for robot task planning. [Online ] . Available: https://arxiv.org/abs/2503.07902
X. Yan, Y. Song, X. Feng et al. (2025, Jan.). Efficient reinforcement learning with large language model priors. [Online ] . Avail able: https://openreview.net/forum?id=e2NRNQ0sZe
Y. Gat, N. Calderon, A. Feder et al . (2024, Mar.). Faithful explanations of black-box NLP models using LLM-generated counterfactuals. [Online ] . Available: https://openreview.net/forum?id=UMfcdRIotC
S. Qin, H. Guan, W. Liao et al. , “Intelligent design and optimization system for shear wall structures based on large language models and generative artificial intelligence,” Journal of Building Engineering , vol. 95 , p. 110250 , Oct. 2024 .
Z. Ding, W. Zhang, J. Yue et al. , “Entity divider with language grounding in multi-agent reinforcement learning,” in Proceedings of the 40th International Conference on Machine Learning , Honolulu, USA, Jul. 2023 , pp. 8103 - 8119 .
A. W. Hanjie, V. Zhong, and K. Narasimhan, “Grounding language to entities and dynamics for generalization in reinforcement learning,” in Proceedings of the 38th International Conference on Machine Learning , Virtual event, Jul. 2021 , pp. 4051 - 4062 .
W. Huang, P. Abbeel, D. Pathak et al. , “Language models as zero-shot planners: extracting actionable knowledge for embodied agents,” in Proceedings of the 39th International Conference on Machine Learning , Baltimore, USA, Jul. 2022 , pp. 9118 - 9147 .
R. S. Bonadia, F. C. L. Trindade, W. Freitas et al. , “On the potential of ChatGPT to generate distribution systems for load flow studies using OpenDSS,” IEEE Transactions on Power Systems , vol. 38 , no. 6 , pp. 5965 - 5968 , Nov. 2023 .
L. Zhang, Z. Chen, and V. Ford, “Advancing building energy modeling with large language models: exploration and case studies,” Energy and Buildings , vol. 323 , p. 114812 , Nov. 2024 .
J. Song, Z. Zhou, J. Liu et al . (2023, Sept.). Self-refined large language model as automated reward function designer for deep reinforcement learning in robotics. [Online ] . Available: https://arxiv.org/abs/2309.06687
Y. Xu, M. Fang, L. Chen et al. , “Perceiving the world: question-guided reinforcement learning for text-based games,” in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics , Dublin, Ireland, May 2022, pp. 538 - 560 .
H. Golchha, S. Yerawar, D. Patel et al. (2024, Mar.). Language guided exploration for RL agents i n text environments. [Online ] . Available: https://arxiv.org/abs/2403.03141
R. Kohita, A. Wachi, D. Kimura et al. , “Language-based general action template for reinforcement learning agents,” in Findings of the Association for Computational Linguistics , Virtual event, Aug. 2021 , pp. 2125 - 2139 .
C. Demircan, T. Saanum, A. K. Jagadish et al . (2025). Sparse autoencoders reveal temporal difference learning in large language models. [Online ] . Available: https://openreview.net/forum?id=2tIyA5cri8
X. Wu. (2024, May). Enhancing Q-learning with large language model heuristics. [Online]. Available: https://arxiv.org/abs/2405.03341
Y. Zhou, Y. Chen, X. Rao et al. , “Leveraging large language models and BERT for log parsing and anomaly detection,” Mathematics , vol. 12 , no. 17 , pp. 1 - 20 , Sep. 2024 .
Y. Du, O. Watkins, Z. Wang et al. , “Guiding pretraining in reinforcement learning with large language models,” in Proceedings of the 40th International Conference on Machine Learning , Honolulu, USA, Jul. 2023 , pp. 8657 - 8677 .
Z. Wan, X. Feng, M. Wen et al. , “AlphaZero-like tree-search can guide large language model decoding and training,” in Proceedings of the 41st International Conference on Machine Learning , Vienna, Austria, Jul. 2024 , pp. 49890 - 49920 .
H. Yin, H. Qian, Y. Shi et al. , “Grounding open-domain knowledge from LLMs to real-world reinforcement learning tasks: a survey,” in Proceedings of the 34th International Joint Conference on Artificial Intelligence , Montreal, Canada, Aug. 2025 , pp. 10797 - 10806 .
C. Druet, D. Ernst, and L. Wehenkel, “Application of reinforcement learning to electrical power system closed-loop emergency control,” in Proceedings of the 4th European Conference on Principles and Practice of Knowledge Discovery in Databases , Lyon, France, Sept. 2000, pp. 86 - 95 .
T. P. I. Ahamed, P. S. N. Rao, and P. S. Sastry, “A reinforcement learning approach to automatic generation control,” Electric Power Systems Research , vol. 63 , no. 1 , pp. 9 - 26 , Aug. 2002 .
D. Ernst, M. Glavic, and L. Wehenkel, “Power systems stability control: reinforcement learning framework,” IEEE Transactions on Power Systems , vol. 19 , no. 1 , pp. 427 - 435 , Feb. 2004 .
J. Nicolaisen, V. Petrov, and L. Tesfatsion, “Market power and efficiency in a computational electricity market with discriminatory double-auction pricing,” IEEE Transactions on Evolutionary Computation , vol. 5 , no. 5 , pp. 504 - 523 , Oct. 2002 .
E. A. Jasmin, T. P. Imthias Ahamed, and V. P. Jagathiraj, “A reinforcement learning algorithm to economic dispatch considering transmission losses,” in Proceedings of 2008 IEEE Region 10 Conference , Hyderabad, India, Nov. 2008 , pp. 1 - 6 .
J. Duan, D. Shi, R. Diao et al. , “Deep-reinforcement-learning-based autonomous voltage control for power grid operations,” IEEE Transactions on Power Systems , vol. 35 , no. 1 , pp. 814 - 817 , Sept. 2019.
J. Jin, S. Mao, and Y. Xu, “Optimal priority rule-enhanced deep reinforcement learning for charging scheduling in an electric vehicle battery swapping station,” IEEE Transactions on Smart Grid , vol. 14 , no. 6 , pp. 4581 - 4593 , Nov. 2023 .
Y. Li, P. Guan, T. Li et al. , “Digital twin for secure peer-to-peer trading in cyber-physical energy systems,” IEEE Transactions on Network Science and Engineering , vol. 12 , no. 2 , pp. 669 - 683 , Mar.-Apr. 2025.
Y. Li, T. Li, H. Zhang et al. , “Distributed resilient double-gradient-descent based energy management strategy for multi-energy system under DoS attacks,” IEEE Transactions on Network Science and Engineering , vol. 9 , no. 4 , pp. 2301 - 2316 , Jul.-Aug. 2022.
Y. Li, H. Zhang, X. Liang et al. , “Event-triggered-based distributed cooperative energy management for multienergy systems,” IEEE Transactions on Industrial Informatics , vol. 15 , no. 4 , pp. 2008 - 2022 , Apr. 2019 .
Y. Li, H. Liu, T. B. Pedersen et al. (2025). RobustZero: enhancing MuZero reinforcement learning robustness to state perturbations. [Online ] . Available: https://openreview.net/forum?id=DaOdkXgLvE
Z. Yan and Y. Xu, “Real-time optimal power flow with linguistic stipulations: integrating GPT-agent and deep reinforcement learning,” IEEE Transactions on Power Systems , vol. 39 , no. 2 , pp. 4747 - 4750 , Mar. 2024 .
M. Liu, L. Zhang, J. Chen et al. , “Large language models for building energy applications: opportunities and challenges,” Building Simulation , vol. 18 , no. 2 , pp. 225 - 234 , Feb. 2025 .
F. Michelon, Y. Zhou, and T. Morstyn, “Large language model interface for home energy management systems,” in Proceedings of the 16th ACM International Conference on Future and Sustainable Energy Systems , Rotterdam, Netherlands, Jun. 2025 , pp. 590 - 602 .
G. Jiang and J. Chen, “Efficient fine-tuning of large language models for automated building energy modeling in complex cases,” Automation in Construction , vol. 175 , p. 106025 , Jul. 2025 .
H. Wu, D. Qiu, L. Zhang et al. , “Adaptive multi-agent reinforcement learning for flexible resource management in a Virtual event power plant with dynamic participating multi-energy buildings,” Applied Energy , vol. 374 , p. 124015 , Nov. 2024 .
S. Lv, H. Yuan, Z. Wang et al. , “An optimal scheduling method of hydrogen production systems using curtailed electricity through artificial intelligence and deep reinforcement learning,” in Proceedings of the 2024 4th International Conference on Energy, Power and Electrical Engineering , Wuhan, China, Sept. 2024, pp. 1233 - 1240 .
X. Chen, X. Lu, Q. Li et al. , “Integration of LLM and human-AI coordination for power dispatching with connected electric vehicles under SAGVNs,” IEEE Transactions on Vehicular Technology , vol. 74 , no. 2 , pp. 1992 - 2002 , Feb. 2025 .
X. Yang, C. Lin, H. Liu et al. , “RL2: reinforce large language model to assist safe reinforcement learning for energy management of active distribution networks,” IEEE Transactions on Smart Grid , vol. 16 , no. 4 , pp. 3419 - 3431 , Jul. 2025 .
S. Orfanoudakis, P. Palensky, and P. P. Vergara. (2025, Feb.). Optimizing electric vehicles charging using large language models and graph neural networks. [Online]. Available: https://arxiv.org/abs/2502.03067
J. Zhao, X. Zhang, X. Chen et al . (2025, Aug.). Energy scheduling for multi-energy microgrids: a large language model-assisted reinforcement learning approach. [Online ] . Available: https://ssrn.com/abstract=5378331
E. Shahinas, A. King, and U. D. Atmojo, “Safe reinforcement learning for ship energy management optimization with LLM-based reward shaping,” in Proceedings of the 2025 IEEE 30th International Conference on Emerging Technologies and Factory Automation , Porto, Portugal, Sept. 2025, pp. 1 - 4 .
H. Zhang, J. Dong, N. Lei et al. , “Optimal vehicle dynamics and powertrain control of carbon-free autonomous vehicles: large language model assisted heterogeneous-agent learning,” Energy , vol. 338 , p. 134148 , Nov. 2025 .
Y. Cheng, H. Zhao, X. Zhou et al. , “A large language model for advanced power dispatch,” Scientific Reports , vol. 15 , no. 1 , pp. 1 - 17 , Mar. 2025 .
H. Zhang, R. Zhang, W. Zhang et al. (2025, Jan.). Advancing generative artificial intelligence and large language models for demand side management with electric vehicles. [Online ] . Available: https://arxiv.org/abs/2501.15544
N. Nascimento, P. Alencar, and D. Cowan, “GPT-in-the-loop: supporting adaptation in multiagent systems,” in Proceedings of the 2023 IEEE International Conference on Big Data , Sorrento, Italy, Dec. 2023 , pp. 4674 - 4683 .
F. Teng, L. Wang, T. Li et al. , “Distributed noise-resilient secondary control for AC shipboard microgrid under disturbances,” IEEE Transactions on Transportation Electrification , vol. 11 , no. 2 , pp. 5521 - 5529 , Apr. 2025 .
Y. Li, W. Gao, S. Huang et al. , “Data-driven optimal control strategy for Virtual event synchronous generator via deep reinforcement learning approach,” Journal of Modern Power Systems and Clean Energy , vol. 9 , no. 4 , pp. 919 - 929 , Jul. 2021 .
Y. Liu, M. Jia, Y. Zhang et al. , “RePower: an LLM-driven autonomous platform for power system data-guided research,” Patterns , vol. 6 , no. 4 , p. 101147 , Apr. 2025 .
L. Yan and C. Cheng, “Voltage control for distribution networks based on large language model-assisted deep reinforcement learning,” IEEE Access , vol. 13 , pp. 76072 - 76084 , Apr. 2025 .
X. Wan, W. Xu, C. Yang et al. (2025, May). Think twice, act once: a co-evolution framework of LLM and RL for large-scale decision making. [Online ] . Available: https://openreview.net/forum?id=ySWrJer7mW
H. Zhao, J. W. Kocsis, A. H. Akhijahani et al . (2025, Mar.). Advancing distribution system restoration via an innovative physics-informed decision transformer. [Online ] . Available: https://ai-2-ase.github.io/papers/25_Causal_Transformer_Paper_AAAI_Final.pdf
L. Yin and Y. Zhao, “Stability control of multiband power system stabilizer based on transformer-embedded deep deterministic policy gradient method,” Integrated Intelligent Energy , vol. 46 , no. 12 , pp. 1 - 9 , Oct. 2024 .
A. Bernadić, G. Kujundžić, and I. Primorac, “Large language models in power systems: enhancing control and decision-making,” International Journal of Innovative Solutions in Engineering , vol. 1 , no. 1 , pp. 9 - 16 , Jan. 2025 .
Y. Zhang, A. M. Saber, A. Youssef et al. (2025, Sept.). Grid-Agent: an LLM-powered multi-agent system for power grid control. [Online ] . Available: https://arxiv.org/abs/2508.05702
M. Zhang, F. Eliassen, A. Taherkordi et al. , “Self-determination theory and deep reinforcement learning for personalized energy trading in smart grid,” IEEE Transactions on Systems, Man, and Cybernetics: Systems , vol. 55 , no. 6 , pp. 4216 - 4229 , Jun. 2025 .
N. Harder, R. Qussous, and A. Weidlich, “Fit for purpose: modeling wholesale electricity markets realistically with multi-agent deep reinforcement learning,” Energy and AI , vol. 14 , p. 100299 , Oct. 2023 .
L. Yu, P. Wang, Z. Chen et al. , “Finding Nash equilibrium based on reinforcement learning for bidding strategy and distributed algorithm for ISO in imperfect electricity market,” Applied Energy , vol. 350 , p. 121780 , Nov. 2023 .
Q. Yao, F. Fang, Y. Chen et al. , “AI large models for power system: a survey and outlook,” IET Smart Energy Systems , vol. 1 , no. 1 , pp. 3 - 21 , Jun. 2025 .
B. Zhang, C. Li, G. Chen et al. (2024, Jun.). Large language model assisted optimal bidding of BESS in FCAS market: an AI-agent based approach. [Online ] . Available: https://arxiv.org/abs/2406.00974
C. Lou, Z. Jin, W. Tang et al . (2025, Jul.). LLM-enhanced multi-agent reinforcement learning with expert workflow for real-time P2P energy trading. [Online ] . Available: https://arxiv.org/abs/2507.14995
B. Zhang, C. Li, G. Chen et al. , “LLM-coordination in auto-bidding of frequency regulation: cross-attention distributional reinforcement agentic learning,” Applied Energy , vol. 401 , p. 124576 , Dec. 2025 .
S. Jadhav, B. Sevak, S. Das et al . (2025, Aug.). Scalable fairness shaping with LLM-guided multi-agent reinforcement learning for peer-to-peer electricity markets. [Online ] . Available: https://arxiv.org/abs/2508.18610
S. Jadhav, B. Sevak, S. Das et al. (2025, Jun.). FairMarket-RL: LLM-guided fairness shaping for multi-agent reinforcement learning in peer-to-peer markets. [Online ] . Available: https://arxiv.org/abs/2506.22708
J. Li, C. Wang, Y. Zhang et al. , “Learn to bid: deep reinforcement learning with transformer for energy storage bidding in energy and contingency reserve markets,” in Proceedings of the 2022 Conference on Neural Information Processing Systems Workshop on Tackling Climate Change with Machine Learning , Virtual event, Dec. 2022 , pp. 1 - 12 .
D. K. Mishra, M. J. Ghadi, L. Li et al. , “A review on solid-state transformer: a breakthrough technology for future smart distribution grids,” International Journal of Electrical Power & Energy Systems , vol. 133 , p. 107258 , Dec. 2021 .
S. M. Hashemzadeh, M. A. Al-Hitmi, S. Islam et al. , “A high voltage gain solid-state transformer for integration of renewable energy and AC sources,” Scientific Reports , vol. 14 , p. 23156 , Oct. 2024 .
H. Shadfar, M. G. Pashakolaei, and A. A. Foroud, “Solid-state transformers: an overview of the concept, topology, and its applications in the smart grid,” International Transactions on Electrical Energy Systems , vol. 31 , no. 9 , p. e12967, Jul. 2021 .
V. Samano-Ortega, A. Padilla-Medina, M. Bravo-Sanchez et al. , “Hardware in the loop platform for testing photovoltaic system control,” Applied Sciences , vol. 10 , no. 23 , p. 8622 , Dec. 2020 .
K. A. Ibrahim, P. C. Luk, Z. Luo et al. , “Revolutionizing power electronics design through large language models: applications and future directions,” Computers and Electrical Engineering , vol. 123 , p. 109970 , Apr. 2025 .
I. Terpstra, “Empowering analog integrated circuit design through large language models and reinforcement learning,” M.S. dissertation, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, USA, 2024.
J. Zuo, N. Y. Steiner, Z. Li et al. , “Reinforcement learning-based maintenance scheduling for a stochastic deteriorating fuel cell considering stack-to-stack heterogeneity,” Reliability Engineering & System Safety , vol. 256 , p. 110753 , Apr. 2025 .
L. Zeng, D. Qiu, and M. Sun, “Resilience enhancement of multi-agent reinforcement learning-based demand response against adversarial attacks,” Applied Energy , vol. 324 , p. 119735 , Oct. 2022 .
G. Pesántez, W. Guamán, J. Córdova et al. , “Reinforcement learning for efficient power systems planning: a review of operational and expansion strategies,” Energies , vol. 17 , no. 9 , p. 2047 , May 2024.
M. Liang, Y. Hu, H. Weng et al. , “EnergyGPT: fine-tuning large language model for multi-energy load forecasting,” Renewable Energy , vol. 251 , p. 122299 , Oct. 2025 .
Y. Zhou and M. Wang, “Empower pre-trained large language models for building-level load forecasting,” IEEE Transactions on Power Systems , vol. 40 , no. 5 , pp. 4220 - 4232 , Sept. 2025.
L. Huang, W. Yu, W. Ma et al. , “A survey on hallucination in large language models: principles, taxonomy, challenges, and open questions,” ACM Transactions on Information Systems , vol. 43 , no. 42 , pp. 1 - 55 , Mar. 2025 .
G. Qu, Q. Chen, W. Wei et al. , “Mobile edge intelligence for large language models: a contemporary survey,” IEEE Communications Surveys & Tutorials , vol. 27 , no. 6 , pp. 3820 - 3860 , Dec. 2025 .
B. C. Das, M. H. Amini, and Y. Wu, “Security and privacy challenges of large language models: a survey,” ACM Computing Surveys , vol. 57 , no. 152 , pp. 1 - 39 , Feb. 2025 .
R. Ye, W. Wang, J. Chai et al. , “OpenFedLLM: training large language models on decentralized private data via federated learning,” in Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining , Barcelona, Spain, Aug. 2024 , pp. 6137 - 6147 .
C. Song, R. Huang, S. Hu et al. , “P rivate-preserving language model inference based on secure multi-party computation,” Neurocomputing , vol. 592 , p. 127810 , Aug. 2024 .
Y. Xiao, Y. Song, and J. Liu, “Collaborative multi-agent deep reinforcement learning for energy-efficient resource allocation in heterogeneous mobile edge computing networks,” IEEE Transactions on Wireless Communications , vol. 23 , no. 6 , pp. 6653 - 6668 , Jun. 2024 .
Y. Wei, X. Shan, R. Miao et al. , “LERO: LLM-driven evolutionary framework with hybrid rewards and enhanced observation for multi-agent reinforcement learning,” Advanced Intelligent Computing Technology and Applications , vol. 15853 , pp. 15 - 26 , Jul. 2025 .
J. Chai, Z. Zhao, Y. Zhu et al. , “A survey of cooperative multi-agent reinforcement learning for multi-task scenarios,” Artificial Intelligence Science and Engineering , vol. 1 , no. 2 , pp. 98 - 121 , Jun. 2025 .
K. Acharya, A. Velasquez, and H. H. Song, “A survey on symbolic knowledge distillation of large language models,” IEEE Transactions on Artificial Intelligence , vol. 5 , no. 12 , pp. 5928 - 5948 , Dec. 2024 .
Y. An, X. Zhao, T. Yu et al. , “Fluctuation-based adaptive structured pruning for large language models,” Proceedings of the AAAI Conference on Artificial Intelligence , vol. 38 , no. 10 , pp. 10865 - 10873 , Mar. 2024 .
Y. Chen, J. Zhu, Y. Liu et al. , “Distributed hierarchical deep reinforcement learning for large-scale grid emergency control,” IEEE Transactions on Power Systems , vol. 39 , no. 2 , pp. 4446 - 4458 , Mar. 2024 .
C. Mu, Z. Liu, J. Yan et al. , “Graph multi-agent reinforcement learning for inverter-based active voltage control,” IEEE Transactions on Smart Grid , vol. 15 , no. 2 , pp. 1399 - 1409 , Mar. 2024 .
H. Sun, R. Jin, S. Xu et al. , “FuxiTranyu: a multilingual large language model trained with balanced data,” in Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track , Miami, USA, Nov. 2024 , pp. 1499 - 1522 .
Y. Zhao, W. Zhang, G. Chen et al. , “How do large language models handle multilingualism?” in Proceedings of the 38th International Conference on Neural Information Processing Systems , Vancouver, Canada, Dec. 2024 , pp. 15296 - 15319 .
L. Qin, Q. Chen, Y. Zhou et al. , “A survey of multilingual large language models,” Patterns , vol. 6 , p. 101059 , Jan. 2025 .
V. H. Bui, S. Mohammadi, S. Das et al. , “A critical review of safe reinforcement learning strategies in power and energy systems,” Engineering Applications of Artificial Intelligence , vol. 143 , p. 109931 , Mar. 2025 .
E. Beckstedde, M. C. Ramirez, R. Cossent et al. , “Regulatory sandboxes: do they speed up innovation in energy?” Energy Policy , vol. 180 , p. 113682 , Sept. 2023.
Y. Guan, W. Ma, L. Che et al. , “Model-based safe reinforcement learning for active distribution network scheduling,” IEEE Transactions on Smart Grid , vol. 16 , no. 3 , pp. 2375 - 2388 , May 2025.
X. Ding, Z. An, A. Rathee et al. , “A safe and data-efficient model-based reinforcement learning system for HVAC control,” IEEE Internet of Things Journal , vol. 12 , no. 7 , pp. 8014 - 8032 , Apr. 2025 .
0
Views
0
下载量
0
CSCD
Publicity Resources
Related Articles
Related Author
Related Institution
京公网安备11010802024621