most methods only distinguish between the sky and clouds
neglecting the inherent differences among various cloud types. In addition
many current models are computationally intensive and inefficient
making them unsuitable for the real-time segmentation of cloud images and thus limiting their application in ultra-short-term photovoltaic power forecasting. To overcome these challenges
we propose CloudSwinNetLite
a lightweight fine-grained cloud image segmentation network. The model adopts an encoder-decoder structure with Swin Transformer as the base module
using a lightweight multi-head self-attention mechanism (W-GLWMSA) and a ghost-based inverted residual feed-forward network (GIRFFN). These designs jointly enhance computational efficiency while preserving high segmentation accuracy. Experimental results demonstrate that CloudSwinNetLite achieves effective fine-grained cloud segmentation with substantially reduced computational cost compared with existing models.
SHI C J, ZHOU Y T, QIU B, et al.CloudU-Net: a deep convolutional neural network architecture for daytime and nighttime cloud images’ segmentation[J]. IEEE Geoscience and remote sensing letters, 2021, 18(10): 1688-1692.
SHI C J, ZHOU Y T, QIU B.CloudU-Netv2: a cloud segmentation method for ground-based cloud images based on deep learning[J]. Neural processing letters, 2021, 53(4): 2715-2728.
SHI C J, ZHOU Y T, QIU B.CloudRaedNet: residual attention-based encoder-decoder network for ground-based cloud images segmentation in nychthemeron[J]. International journal of remote sensing, 2022, 43(6): 2059-2075.
ZHANG Z, YANG S Z, LIU S, et al.Ground-based cloud detection using multiscale attention convolutional neural network[J]. IEEE geoscience and remote sensing letters, 2022, 19: 8019605.
LIU S, ZHANG J F, ZHANG Z, et al.Integration transformer for ground-based cloud image segmentation[J]. IEEE transactions on geoscience and remote sensing, 2023, 61: 5606712.
SHI C J, SU Z B, ZHANG K, et al.CloudFU-Net: a fine-grained segmentation method for ground-based cloud images based on an improved encoder-decoder structure[J]. IEEE transactions on geoscience and remote sensing, 2024, 62: 5619913.
SHI C J, SU Z B, ZHANG K, et al.CloudSwinNet: a hybrid CNN-transformer framework for ground-based cloud images fine-grained segmentation[J]. Energy, 2024, 309: 133128.
YE L, CAO Z G, XIAO Y, et al.Supervised fine-grained cloud detection and recognition in whole-sky images[J]. IEEE transactions on geoscience and remote sensing, 2019, 57(10): 7972-7985.
CAO H, WANG Y Y, CHEN J, et al.Swin-Unet: unet-like pure transformer for medical image segmentation[C]//Computer Vision-ECCV 2022 Workshops. Cham, Switzed and, Springer, 2023: 205-218.
ZHOU Z W, SIDDIQUEE M M R, TAJBAKHSH N, et al. UNet: redesigning skip connections to exploit multiscale features in image segmentation[J]. IEEE transactions on medical imaging, 2020, 39(6): 1856-1867.
RONNEBERGER O, FISCER P, BROX T.Attention U-Net: learning where to look for the pancreas[C]// 2018 Medical Image Computing and Computer-Assisted Intervention. Madrid, Spain, 2018.
SUN K, XIAO B, LIU D, et al.Deep high-resolution representation learning for human pose estimation[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach, CA, USA, 2020: 5686-5696.