In order to solve the problem of power loss of photovoltaic modules caused by the“hot spot effect”
a multi-modal YOLOv8n-cls model prediction method based on Super Token Attention Mechanism (STA) was proposed. The STA attention mechanism was added to the image classification network YOLOv8n-cls to solve the problem that the neural network tend to capture the local hot spot features in the shallow layer with high redundancy. At the same time
a multi-modal model of infrared image and digital information fusion of photovoltaic modules was built based on the YOLOv8n-cls algorithm to explore the influence of irradiance parameters on power loss prediction. A photovoltaic multi-source dataset composed of photovoltaic infrared images
power loss and irradiance parameter labels was constructed
and power loss prediction experiments were carried out. Experiments show that the Top1 accuracy of the improved network model for the hot spot effect caused by leaves
dust and guano reaches 95.6%
89.0% and 88.1% respectively
which is 3.3%
10.0% and 7.5% higher than that of the original model
which proves the superiority of the proposed algorithm in predicting the power loss of photovoltaic modules with hot spot effect.
MEHTA S, AZAD A P, CHEMMENGATH S A, et al.DeepSolarEye: power loss prediction and weakly supervised soiling localization via fully convolutional networks for solar panels[C]//2018 IEEE Winter Conference on Applications of Computer Vision (WACV),Lake Tahoe, NV, USA, 2018: 333-342.
LONG J, SHELHAMER E, DARRELL T.Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 2015: 3431-3440.
ZHANG W J, LIU S Q, GANDHI O, et al.Deep-learning-based probabilistic estimation of solar PV soiling loss[J]. IEEE transactions on sustainable energy, 2021, 12(4): 2436-2444.
JIAO X, LI X S, YANG Y H, et al.Novel and comprehensive approach for power loss estimation of soiled photovoltaic modules[J]. Solar energy, 2024, 268: 112283.
NGUYEN-DUC T, LE-VIET T, NGUYEN-DANG D, et al.Photovoltaic array reconfiguration under partial shading conditions based on short-circuit current estimated by convolutional neural network[J]. Energies, 2022, 15(17): 6341.
REDMON J, DIVVALA S, GIRSHICK R, et al.You only look once: unified, real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016: 779-788.
HUANG H B, ZHOU X Q, CAO J, et al.Vision transformer with super token sampling[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 2023: 22690-22699.
CHEN W, WANG W P, LIU L, et al.New ideas and trends in deep multimodal content understanding: a review[J]. Neurocomputing, 2021, 426: 195-215.
JAMPANI V, SUN D Q, LIU M Y, et al.Superpixel sampling networks[C]//Proceedings of the European Conference on Computer Vision(ECCV), Munich, Germany, 2018: 352-368.
WANG C X, JIA M S, LI M R, et al.Attention is all you need for blind room volume estimation[C]//ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Korea, Republic of, 2024: 1341-1345.
LIU Q M, CHMELY S C, ABDOULMOUMINE N.Biomass treatment strategies for thermochemical conversion[J]. Energy & fuels, 2017, 31(4): 3525-3536.
WANG B, SHAABAN K, KIM I.Revealing the hidden features in traffic prediction via entity embedding[J]. Personal and ubiquitous computing, 2021, 25(1): 21-31.