Segmentation of Left Ventricular Endocardium Using Direction-constrained Reinforcement Learning

Zeng An; Pang Yao-xing; Pan Dan; Zhao Jing-liang

doi:10.12052/gdutxb.230156

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

Segmentation of Left Ventricular Endocardium Using Direction-constrained Reinforcement Learning

更新时间：2026-05-27

- Segmentation of Left Ventricular Endocardium Using Direction-constrained Reinforcement Learning
- Vol. 41, Issue 6, Pages: 60-68(2024)
- 作者机构：
  
  1. 广东工业大学计算机学院,广东,广州,510006
  2. 广东技术师范大学电子与信息学院,广东,广州,510665
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.230156
  CLC： TP389.1
- Published：2024
- 稿件说明：
移动端阅览
曾安, 庞耀幸, 潘丹, 赵靖亮. 基于方向约束强化学习的左心室内膜分割[J]. 广东工业大学学报, 2024, 41(6): 60-68.

Zeng An, Pang Yao-xing, Pan Dan, et al. Segmentation of Left Ventricular Endocardium Using Direction-constrained Reinforcement Learning[J]. 2024, 41(6): 60-68.
曾安, 庞耀幸, 潘丹, 赵靖亮. 基于方向约束强化学习的左心室内膜分割[J]. 广东工业大学学报, 2024, 41(6): 60-68. DOI： 10.12052/gdutxb.230156.

Zeng An, Pang Yao-xing, Pan Dan, et al. Segmentation of Left Ventricular Endocardium Using Direction-constrained Reinforcement Learning[J]. 2024, 41(6): 60-68. DOI： 10.12052/gdutxb.230156.

摘要

从心脏核磁共振成像中准确分割左心室内膜，进而得到左心室区域，是对心脏功能进行分析的重要步骤。针对强化学习通过定位左心室内膜边缘来进行分割时容易出现定位偏差而导致分割效果下降的问题，本文提出一种基于方向约束强化学习的左心室内膜分割方法。方法将分割任务划分为两个阶段：在第一阶段提取内膜的全局边缘特征；在第二阶段利用强化学习迭代定位内膜边缘点得到边缘，从而分割出左心室内膜。方法对智能体的定位方向进行约束，能减少定位偏差和重叠的情况从而提高分割精度。最后，在两个公共数据集自动心脏诊断挑战(Automatic Cardiac Diagnosis Challenge

ACDC)和Sunnybrook心脏MR左心室分割挑战(Sunnybrook Cardiac MR Left Ventricle Segmentation Challenge

Sunnybrook)上的实验结果显示：与其他方法相比，本文方法精度较高，其F1-score指标分别为

0.9482

、

0.9387

，平均垂直距离(Average Perpendicular Distance

APD)分别为

3.5863

、

4.9447

，能有效地分割左心室内膜。

Abstract

Accurate segmentation of the left ventricular endocardium from cardiac magnetic resonance imaging to obtain the left ventricular region is an important step in the analysis of cardiac function. It is noted that reinforcement learning is prone to localization deviation in left ventricula

r endocardium segmentation by locating the left ventricular endocardial edges

leading to a performance decrease in the segmentation. To address this

this paper proposes a direction-constrained reinforcement learning method for left ventricular endocardium segmentation

which divides the segmentation task into two stages. In the first stage

the proposed method extracts global edge features of the endocardium

and in the second stage

reinforcement learning is used to iteratively locate the endocardial edge points to obtain the edge

obtaining the segmented left ventricular endocardium. The proposed method constrains the direction of agent positioning

which can reduce the localization deviation and overlap

such that the segmentation accuracy can be improved. Finally

the experimental results on two public datasets

including the Automated Cardiac Diagnosis Challenge (ACDC) and Sunnybrook Cardiac MR Left Ventricle Segmentation Challenge (Sunnybrook)

show that the proposed method has higher accuracy than the compared methods. Specifically

the F1-score of the proposed method are

0.9482

and

0.9387

and the Average perpendicular distance (APD) are

3.5863

and

4.9447

which can effectively segment the left ventricular endocardium.

关键词

Keywords

references

中国心血管健康与疾病报告2022概要[J]. 中国循环杂志, 2023, 38(6) : 583-612.

CHEN C, QIN C, QIU H Q, et al . Deep learning for cardiac image segmentation: a review [J ] . Frontiers in Cardiovascular Medicine, 2020, 7: 25-43.

XIONG J J, PO L M, CHEUNG K W, et al . Edge-sensitive left ventricle segmentation using deep reinforcement learning [J ] . Sensors, 2021, 21(7): 1-19.

ZHOU Z W, RAHMAN SIDDIQUEE M M, TAJBAKHSH N, et al . Unet++: a nested U-net architecture for medical image segmentation[C ] //Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support. [S. l. ] : Springer Cham, 2018: 3-11.

RONNEBERGER O, FISCHER P, BROX T. U-net: convolutional networks for biomedical image segmentation[C]//Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention. New York: Springer, 2015: 234–241.

SCHLEMPER J, OKTAY O, SCHAAP M, et al . Attention gated networks: learning to leverage salient regions in medical images [J ] . Medical Image Analysis, 2019, 53: 197-207.

ABDELTAWAB H, KHALIFA F, TAHER F, et al . A deep learning-based approach for automatic segmentation and quantification of the left ventricle from cardiac cine MR images [J ] . Computerized Medical Imaging and Graphics, 2020, 81: 1-11.

VASWANI A, SHAZEER N, PARMAR N, et al . Attention is all you need[C ] //Proceedings of Neural Information Processing Systems. Long Beach: MIT Press, 2017: 5998-6008.

CAO H, WANG Y Y, CHEN J, et al . Swin-unet: Unet-like pure transformer for medical image segmentation[C ] //European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2022: 205-218.

TRAGAKIS A, KAUL C, MURRAY-SMITH R, et al . The fully convolutional transformer for medical image segmentation[C ] //Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. Waikoloa: IEEE, 2023: 3649-3658.

LIANG L M, HE A J, ZHU C K, et al . Colorectal polyp segmentation method based on fusion of transformer and cross-level phase awareness [J ] . Journal of Biomedical Engineering, 2023, 40(2): 234-243.

STEMBER J N, SHALU H. Unsupervised deep clustering and reinforcement learning can accurately segment MRI brain tumors with very small training sets[C]//International Symposium on Intelligent Informatics. Singapore: Springer Nature Singapore, 2022: 255-270.

ZHOU S K, LE H N, LUU K, et al . Deep reinforcement learning in medical imaging: a literature review [J ] . Medical Image Analysis, 2021, 73: 1-20.

MORTAZI A, BAGCI U. Automatically designing CNN architectures for medical image segmentation[C]//Machine Learning in Medical Imaging: 9th International Workshop, MLMI 2018, Held in Conjunction with MICCAI 2018. Granada: Springer International Publishing, 2018: 98-106.

QIN T X, WANG Z Y, HE K L, et al . Automatic data augmentation via deep reinforcement learning for effective kidney tumor segmentation[C ] // ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Barcelona: IEEE, 2020: 1419-1423.

LIAO X, LI W H, XU Q, et al . Iteratively-refined interactive 3D medical image segmentation with multi-agent reinforcement learning[C ] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: CVF, 2020: 9394-9402.

BERNARD O, LALANDE A, ZOTTI C, et al . Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved? [J ] . IEEE Transactions on Medical Imaging, 2018, 37(11): 2514-2525.

RADAU P, LU Y, CONNELLY K, et al . Evaluation framework for algorithms segmenting short axis cardiac MRI [J ] . The MIDAS Journal, 2009, 7: 100-107.

HE K M, ZHANG X Y, REN S Q, et al . Deep residual learning for image recognition[C ] //Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770-778.

HUANG Y, WEI G L, WANG Y X. V-D D3QN: the variant of double deep q-learning network with dueling architecture[C]//2018 37th Chinese Control Conference (CCC) . Wuhan: IEEE, 2018: 9130-9135.

VAN HASSELT H, GUEZ A, SILVER D. Deep reinforcement learning with double q-learning[C]//Proceedings of the AAAI Conference on Artificial Intelligence. Phoenix: AAAI Press, 2016: 2094–2100.

WANG Z Y, SCHAUL T, HESSEL M, et al . Dueling network architectures for deep reinforcement learning[C ] //International Conference on Machine Learning. New York: JMLR Organization, 2016: 1995-2003.

ZHANG Z J, FU H Z, DAI H, et al . ET-Net: a generic edge-attention guidance network for medical image segmentation[C ] //Medical Image Computing and Computer Assisted Intervention-MICCAI 2019: 22nd International Conference. Shenzhen: Springer International Publishing, 2019: 442-450.

SHEELA C J J, SUGANTHI G. Morphological edge detection and brain tumor segmentation in Magnetic Resonance (MR) images based on region growing and performance evaluation of modified Fuzzy C-Means (FCM) algorithm [J]. Multimedia Tools and Applications, 2020, 79: 17483-17496.

SHEELA C J J, SUGANTHI G. Brain tumor segmentation with radius contraction and expansion based initial contour detection for active contour model [J]. Multimedia Tools and Applications, 2020, 79: 23793-23819.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

An Improved Double Deep Q Network for Multi-user Dynamic Spectrum Access

Aortic Re-coarctation Prediction Research Based on Swin-Unet

An AGV Path Planning Method for Discrete Manufacturing Smart Factory

A Research on a Training Model to Improve the Development Efficiency of Robot Reinforcement Learning

Trajectory Tracking and Dynamic Obstacle Avoidance of Mobile Robot Based on Deep Reinforcement Learning

Related Author

Wu Wen-tao

Wang Lei

Wan Pin

Wang Yong-hua

He Yi-shan

Zhang Xiao-bo

Zeng An

Gan Meng-kun

Related Institution

School of Automation, Guangdong University of Technology

Key Laboratory of Intelligent Information Processing and System Integration of IoT, Ministry of Education

The Chinese University of Hong Kong

School of Computers, Guangdong University of Technology

AI问答

⁰