ZHANG Luxi, SHI Yan, CAO Zhiyuan, et al. Photovoltaic Power Forecasting Based on Deep Perception-Interaction Transformer[J]. 2025, 53(8): 70-78. DOI: 10.20204/j.sp.2025.08009.
Photovoltaic Power Forecasting Based on Deep Perception-Interaction Transformer
To fully exploit data correlations and temporal dependencies
this study proposes a deep perception-interaction transformer (DPIT) based photovoltaic power forecasting method. First
an enhanced temporal convolutional network (TCN) is constructed to efficiently capture cross-temporal and cross-variable dependencies while expanding the receptive field. Second
a dual-branch interactive learning network is established
comprising an improved inverted transformer (IIT)
deep perception self-attention (DPSA)
and residual self-attention (RSA). The IIT integrates convolutional additive self-attention
feedforward networks
and layer normalization in inverted dimensions
significantly reducing computational complexity while enhancing global learning capabilities and improving the capture of critical meteorological features/multivariate correlations. DPSA and RSA synergize deep perception mechanisms with self-attention to strengthen feature learning. Finally,extensive simulations demonstrate that the DPIT model achieves dual advantages of low computational complexity and high forecasting accuracy.
YANG D,KLEISSL J,GUEYMARD C A,et al.History and trends in solar irradiance and PV power forecasting:A preliminary assessment and review using text mining[J].Solar Energy,2018,168(1):60-101.
LUO D,WANG X.ModernTCN:a modern pure convolution structure for general time series analysis[C]// The Twelfth International Conference on Learning Representations,Vienna,Austria,2024:1-13.
HE Y,GAO Q,LIU F,et al.Short-term photovoltaic power forecasting method based on convolutional neural network[J].Energy Reports,2022,8(1):54-62.
MA H,ZHANG C,PENG T,et al.An integrated framework of gated recurrent unit based on improved sine cosine algorithm for photovoltaic power forecasting[J].Energy,2022,256(1):124650.
VASWANI A.Attention is all you need[C]//International Conference on Neural Information Processing Systems,California,USA,2017:1-11.
WU H,XU J,WANG J,et al.Autoformer:decomposition transformers with auto-correlation for long-term series forecasting[J].Neural Information Processing Systems,2021,34(1):22419-22430.
XU H,PENG Q,WANG Y,et al. Power-load forecasting model based on informer and its application[J]. Energies,2023,16(7):1-14.
ZHOU T,MA Z,WEN Q,et al.FEDformer:frequency enhanced decomposed transformer for long-term series forecasting[C]//International Conference on Machine Learning,Maryland,USA,2022:1-19.
KITAEV N,KAISER L,LEVSKAYA A.Reformer:The efficient transformer[C]//International Conference on Learning Representa-tions,Ababa,Ethiopia,2020:1-12.
HUANG Z,SHI X,ZHANG C,et al.Flowformer:a transformer architecture for optical flow[C]//European Conference on Computer Vision (ECCV),Tel Aviv,Israel,2022:668-685.
DAO T,FU D,ERMON S,et al.Flashattention:fast and memory-efficient exact attention with io-awareness[C]//The 36th Conference on Neural Information Processing Systems,Louisiana,USA,2022:1-16.
LIU Y,HU T,ZHANG H,et al.iTransformer:inverted transformers are effective for time series forecasting[C]//International Conference on Learning Representations,Vienna,Austria,2024:1-25.
TAO K,ZHAO J,TAO Y,et al.Operational day-ahead photovoltaic power forecasting based on transformer variant[J].Applied Energy,2024,373(1):1-16.
KIM J,OBREGON J,PARK H,et al. Multi-step photovoltaic power forecasting using transformer and recurrent neural networks[J].Renewable and Sustainable Energy Reviews,2024,200(1):1-18.
SHAKER A,MAAZ M,RASHEED H,et al.Swiftformer:Efficient additive attention for transformer-based real-time mobile vision applications[C]// IEEE/CVF International Conference on Computer Vision,Paris,France,2023:17425-17436.
ZENG A,CHEN M,ZHANG L,et al.Are transformers effective for time series forecasting?[C]//AAAI conference on Artificial Intelligence,Washington,USA,2023,37(9):11121-11128.
YAO T,WANG J,WU H,et al.A photovoltaic power output dataset:multi- source photovoltaic power output dataset with Python toolkit[J].Solar Energy,2021,230:122-130.