Xia Hao, Cai Nian, Wang Ping, et al. Magnetic Resonance Image Super-Resolution via Multi-Resolution Learning[J]. 2020, 37(6): 26-31.DOI: 10.12052/gdutxb.200011.
Magnetic Resonance Image Super-Resolution via Multi-Resolution Learning
High-resolution magnetic resonance images are of great significance for medical diagnosis. A convolutional neural network with multi-resolution learning is proposed for magnetic resonance image (MR) super-resolution. The network is an improved deep residual network
which involves residual units for feature extraction
a deconvolution layer for multi-resolution up-sampling
and a multi-resolution learning layer. The proposed network performs the super-resolution task in the low-resolution space
which can accelerate the network. Multi-resolution upsampling is put forward to integrate multiple residual unit information and to accelerate the network. Multi-resolution learning can adaptively determine the contributions of these upsampled high-dimensional feature maps to high-resolution MR image reconstruction. Experiment results indicate that the proposed method can achieve a good super-resolution reconstruction performance for magnetic resonance images
which is superior to the state-of-the-art deep learning methods.
关键词
Keywords
references
SHI F, CHENG J, WANG L, et al . LRTV: MR image super-resolution with low-rank and total variation regularizations [J ] . IEEE Transactions on Medical Imaging, 2015, 34(12): 2459-2466.
PLENGE E, POOT D H J, BERNSEN M, et al . Super-resolution methods in MRI: Can they improve the trade-off between resolution, signal-to-noise ratio, and acquisition time? [J ] . Magnetic Resonance in Medicine, 2012, 68(6): 1983-1993.
WU J, CAI N, LI F, et al . Automatic detonator code recognition via deep neural network [J ] . Expert Systems with Applications, 2020, 145: 113121.
FU X, CAI N, HUANG K, et al . M-net: a novel u-net with multi-stream feature fusion and multi-scale dilated convolutions for bile ducts and hepatolith segmentation [J ] . IEEE Access, 2019, 7: 148645-148657.
WU J, CAI N, CHEN W, et al . Automatic detection of hardhats w orn by construction personnel: a deep learning approach and benchmark dataset [J ] . Automation in Construction, 2019, 106: 102894.
WENG S W, PENG Y H, WEI B, et al . A two-stage-video forgery based on inception-v3 network [J ] . Journal of Guangdong University of Technology, 2019, 36(6): 16-23.
GAO J Y, LIU W Y, YANG Z G. Object tracking combined with attention and feature fusion [J]. Journal of Guangdong University of Technology, 2019, 36(4): 18-23.
YE W J, GAO H J, WENG S W, et al . A two-stage effect rendering method for art font based on CGAN network [J ] . Journal of Guangdong University of Technology, 2019, 36(3): 47-55.
HARIS M, SHAKHNAROVICH G, UKITA N. Deep back-projection networks for super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 1664-1673.
PHAM C H, DUCOURNAU A, FABLET R, et al. Brain MRI super-resolution using deep 3D convolutional networks[C]//2017 IEEE 14th International Symposium on Biomedical Imaging. Melbourne: IEEE, 2017: 197-200.
DONG C, LOY C C, HE K, et al. Learning a deep convolutional network for image super-resolution[C]//European Conference on Computer Vision. Amsterdam: Springer, Cham, 2014: 184-199.
DONG C, LOY CC, HE K, et al . Image super-resolution using deep convolutional networks [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 38(2): 295-307.
OKTAY O, BAI W, LEE M, et al. Multi-input cardiac image super-resolution using convolutional neural networks[C]//International Conference on Medical Image Computing and Computer-assisted Intervention. Istanbul: Springer, Cham, 2016: 246-254.
GIANNAKIDIS A, OKTAY A O, KEEGAN J. Super-resolution reconstruction of late gadolinium cardiovascular magnetic resonance images using a residual convolutional neural network 25th Scientific Meeting of the Int[C]//International Society for Magnetic Resonance in Medicine. Hawaii: [s.n.], 2017.
KIM J, KWON LEE J, MU LEE K. Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 1646-1654.
SHI J, LI Z, YING S, et al . MR image super-resolution via wide residual networks with fixed skip connection [J ] . IEEE Journa l of Biomedical and Health Informatics, 2018, 23(3): 1129-1140.
MCDONAGH S, HOU B, ALANSARY A, et al. Context-sensitive super-resolution for fast fetal magnetic resonance imaging[C]//Molecular Imaging, Reconstruction and Analysis of Moving Body Organs, and Stroke Imaging and Treatment. Canada: Springer, Cham, 2017: 116-126.
DONG C, LOY C C, TANG X. Accelerating the super-resolution convolutional neural network[C]//European Conference on Computer Vision. Amsterdam: Springer, Cham, 2016: 391-407.
TANNO R, WORRALL D E, GHOSH A, et al. Bayesian image quality transfer with CNNs: exploring uncertainty in dMRI super-resolution[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Istanbul: Springer, Cham, 2017: 611-619.
SHI W, CABALLERO J, HUSZÁR F, et al. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 1874-1883.
TAI Y, YANG J, LIU X. Image super-resolution via deep recursive residual network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii: IEEE, 2017: 3147-3155.
HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770-778.
WANG Z, BOVIK A C, SHEIKH H R, et al . Image quality assessment: from error visibility to structural similarity [J ] . IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
HE K, ZHANG X, REN S, et al. Delving deep into rectifiers: Surpassing human-level performance on image net classification[C]//Proceedings of the IEEE International Conference on Computer Vision. Boston: IEEE, 2015: 1026-1034.