1. 广东工业大学 计算机学院,广东,广州,510006
2. 广东技术师范大学 电子与信息学院,广东,广州,510665
曾安(1978–),女,教授,博士生导师,主要研究方向为图像处理、模式识别及人工智能,E-mail:zengan@gdut.edu.cn
杨宝瑶 (1991–) ,女,副教授,研究生导师,主要研究方向为模式识别与数据挖掘、知识表示与处理、机器学习、计算机图像视频处理与多媒体技术,E-mail:ybaoyao@gdut.edu.cn
纸质出版:2025
移动端阅览
曾安, 赖峻浩, 杨宝瑶, 等. 基于多尺度卷积和注意力机制的病理图像分割网络[J]. 广东工业大学学报, 2025, 42(2): 1–10.
Zeng An, Lai Junhao, Yang Baoyao, et al. Pathology Image Segmentation Network Based on Multiscale Convolution and Attention Mechanism[J]. 2025, 42(2): 1-10.
曾安, 赖峻浩, 杨宝瑶, 等. 基于多尺度卷积和注意力机制的病理图像分割网络[J]. 广东工业大学学报, 2025, 42(2): 1–10. DOI: 10.12052/gdutxb.230179
Zeng An, Lai Junhao, Yang Baoyao, et al. Pathology Image Segmentation Network Based on Multiscale Convolution and Attention Mechanism[J]. 2025, 42(2): 1-10. DOI: 10.12052/gdutxb.230179.
深度学习在病理图像分割中具有重要作用,然而现有深度学习方法在处理多尺度的病理图像分割任务上存在分割性能不足,泛化能力差等问题。针对上述问题,本文提出了一种基于多尺度卷积和注意力机制的病理图像分割网络。该网络通过多尺度卷积注意力模块,从不同尺度出发对特征图进行特征提取并从空间维度出发关注全局上下文关联信息,有效过滤冗余噪声信息,提升网络处理多尺度病理图像数据的泛化能力;通过多尺度特征融合模块,将不同尺度的特征进行信息融合,丰富了特征图的边缘信息和细粒度信息,改善分割效果。在GlaS、MoNuSeg和Lizard数据集上分别进行实验,所提方法的Dice指标在3个数据集上分别为91.07%、81.00%、79.87%,IoU指标为84.13%、68.22%、67.26%。实验结果表明,本文所提方法能够有效分割病理图片,提升分割准确度,为临床诊断提供可靠依据。
Deep learning plays an essential role in the segmentation of pathological images. However
most existing deep learning methods still face challenges such as poor segmentation performance and generalization ability on multi-scale pathological image segmentation tasks. To address these issues
we propose a pathological image segmentation network based on multi-scale convolution and attention mechanisms. We design a multi-scale convolution attention module to extract different scales of features and spatially capture global contextual correlation information
effectively filtering redundant noise information and improving the network's generalization ability in handling multi-scale pathological image data. Additionally
we design a multi-scale feature fusion module to integrate features from different scales
enhancing the edge and fine-grained information in the feature maps and improving segmentation results. The experiments were performed on the GlaS
MoNuSeg and Lizard datasets
and the experimental results show that the Dice scores of the proposed method were 91.07%、81.00% and 79.87%
respectively
and the IoU scores were 84.13%、68.22% and 67.26%
respectively. This demonstrates that the proposed method can effectively segment pathology image
improve the segmentation accuracy
and provide a reliable basis for clinical diagnosis.
SONG J, XIAO L, LIAN Z C, et al . Overview and prospect of deep learning for image segmentation in digital pathology [J ] . Journal of Software, 2021, 32(5): 1427-1460.
TSAI A, YEZZI A, WELLS W, et al . A shape-based approach to the segmentation of medical imagery using level sets [J ] . IEEE Transactions on Medical Imaging, 2003, 22(2): 137-154.
HELD K, KOPS E R, KRAUSE B J, et al . Markov random field segmentation of b rain MR images [J ] . IEEE Transactions on Medical Imaging, 1997, 16(6): 878-886.
RONNEBERGER O, FISCHER P, BROX T. U-net: convolutional networks for biomedical image segmentation[C] //Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference. Munich: Springer International Publishing, 2015: 234-241.
XIAO X, LIAN S, LUO Z, et al. Weighted res-unet for high-quality retina vessel segmentation[C]//2018 9th International Conference on Information Technology in Medicine and Education (ITME) . Hangzhou: IEEE, 2018: 327-331.
ZHOU S, NIE D, ADELI E, et al . High-resolution encoder–decoder networks for low-contrast medical image segmentation [J ] . IEEE Transactions on Image Processing, 2019, 29: 461-475.
HATAMIZADEH A, TANG Y, NATH V, et al. Unetr: transformers for 3d medical image segmentation[C] //Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. Waikoloa: IEEE, 2022: 574-584.
CAO H, WANG Y, CHEN J, et al. Swin-unet: unet-like pure transformer for medical image segmentation[C]//European Conference on Computer Vision. Tel-Aviv: Springer Nature Switzerland, 2022: 205-218.
LI X, CHEN H, QI X, et al . H-denseunet: hybrid densely connected unet for liver and tumor segmentation from ct volumes [J ] . IEEE Transactions on Medical Imaging, 2018, 37(12): 2663-2674.
ZHOU Z, RAHMAN SIDDIQUEE M M, TAJBAKHSH N, et al. Unet++: A nested u-net architecture for medical image segmentation[C]//Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop. Granada: Springer International Publishing, 2018: 3-11.
ICEK , ABDULKADIR A, LIENKAMP S S, et al. 3D u-net: learning dense volumetric segmentation from sparse annotation[C]//Medical Image Computing and Computer-Assisted Intervention–MICCAI 2016: 19th International Conference. Athens: Springer International Publishing, 2016: 424-432.
MILLETARI F, NAVAB N, AHMADI S A. V-net: fully convolutional neural networks for volumetric medical image segmentation[C]//2016 Fourth International Conference on 3D Vision (3DV) . Stanford: IEEE, 2016: 565-571.
ZHANG Y, LIU H, HU Q. Transfuse: fusing transformers and CNNs for medical image segmentation[C]//Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference. Strasbourg: Springer International Publishing, 2021: 14-24.
VALANARASU J M J, OZA P, HACIHALILOGLU I, et al. Medical transformer: gated axial-attention for medical image segmentation[C]//Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference. Strasbourg: Springer International Publishing, 2021: 36-46.
WANG H, ZHU Y, GREEN B, et al. Axial-deeplab: stand-alone axial-attention for panoptic segmentation[C]//European Conference on Computer Vision. Glasgow: Springer International Publishing, 2020: 108-126.
WANG H, CAO P, WANG J, et al. Uctransnet: rethinking the skip connections in u-net from a channel-wise perspective with transformer[C]//Proceedings of the AAAI Conference on Artificial Intelligence. Vancouver: AAAI, 2022, 36(3) : 2441-2449.
DIAO S, TIAN Y, HU W, et al . Weakly supervised framework for cancer region detection of hepatocellular carcinoma in whole-slide pathologic images based on multiscale attention convolutional neural network [J ] . The American Journal of Pathology, 2022, 192(3): 553-563.
VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[J]. Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2017: 5999-6008.
SIRINUKUNWATTANA K, PLUIM J P W, CHEN H, et al . Gland segmentation in colon histology images: the glas challenge contest [J ] . Medical Image Analysis, 2017, 35: 489-502.
KUMAR N, VERMA R, SHARMA S, et al . A dataset and a technique for generalized nuclear segmentation for computational pathology [J ] . IEEE Transactions on Medical Imaging, 2017, 36(7): 1550-1560.
GRAHAM S, JAHANIFAR M, AZAM A, et al. Lizard: a large-scale dataset for colonic nuclear instance segmentation and classification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Montreal: IEEE, 2021: 684-693.
0
浏览量
0
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621