Deng Jie-hang, Yuan Zhong-ming, Lin Hao-run, et al. Superpixel and Visual Saliency Synergetic Image Quality Assessment[J]. 2021, 38(5): 33-39.DOI: 10.12052/gdutxb.210036.
Superpixel and Visual Saliency Synergetic Image Quality Assessment
In order to achieve higher consistency between objective and subjective evaluation of image quality
a full-reference image quality evaluation method based on a synergetic strategy between superpixel and visual saliency is proposed. This method obtains the image quality score by pooling four similarities of the image features. The four similarities are: the superpixel-based local luminance similarity
the superpixel-based local chrominance similarity
the visual saliency similarity
and the Scharr gradient similarity. In particular
a parameter correction model is proposed to adaptively adjust the parameters of each similarity
to address the problem of determining the parameters of each similarity empirically. The visual saliency is introduced to design a weighting function to fuse the four similarities to obtain the global quality score. A large number of comparative experiments show that the proposed method outperforms the baseline full-reference image quality assessment methods
and has a higher correlation with the subjective evaluation.
关键词
Keywords
references
WANG Z, BOVIK A C. Modern image quality assessment[M]. New York: Morgan and Claypool Publishing Company, 2006.
CHU J, CHEN Q, YANG X C. Review on full reference image quality assessment algorithms [J]. Application Research of Computers, 2014, 31(1): 13-22.
WANG Z, BOVIK A C. Mean squared error: love it or leave it? [J]. IEEE Signal Processing Magazine, 2009, 26(1): 98-17.
GAO F Y, HE L H. No-reference image quality assessment based on deep network and visual characteristics [J]. Journal of Nanjing Normal University(Natural Science Edition), 2019, 42(3): 20-26.
MA H L, ZHANG L Y. No-reference Tone-mapper image quality assessment based on human eye perception [J]. Computer Applications and Software, 2020, 37(7): 158-164.
CUI L. Reduced-reference image quality assessment base on multi-feature similarity fusion [J]. Journal of Shanxi University of Science Technology, 2019, 37(6): 160-164.
WU S H, BAO Y D, CHEN G, et al . Reduced-reference crop image quality assessment based on random Gabor feature [J ] . Computer and Modernization, 2020(5): 70-74.
WANG Z, BOVIK A C, SHEIKH H R, et al . Image quality assessment: from error visibility to structural similarity [J ] . IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
WANG Z, SIMONCELLI E P, BOVIK A C. Multi-scale structural similarity for image quality assessment[C]//The Thirty-Seventh Asilomar Conference on Signals, Systems and Computers. Pacific Grove, CA: IEEE Signal Processing Society, 2003: 1398-1402.
WANG Z, LI Q. Information content weighting for perceptual image quality assessment [J]. IEEE Transaction on Image Processing, 2011, 20(5): 1185-1198.
ZHANG L, ZHANG L, MOU X Q, et al . FSIM: a feature similarity index for image quality assessment [J ] . IEEE Transaction on Image Processing, 2011, 20(8): 2378-2386.
LARSON E C, CHANDLER D M. Most apparent distortion: full-reference image quality assessment and the role of strategy [J]. Journal of Electronic Imaging, 2010, 19(1): 011006.
XUE W F, ZHANG L, MOU X Q, et al . Gradient magnitude similarity deviation: a highly efficient perceptu al image quality index [J ] . IEEE Transaction on Image Processing, 2014, 23(2): 684-695.
SUN W, LIAO Q M, XUE J H, et al . SPSIM: a superpixel-based similarity index for full-reference image Quality Assessment [J ] . IEEE Transaction on Image Processing, 2018, 27(9): 4232-4244.
ZHANG L, SHEN Y, LI H Y. VSI: a visual saliency-induced index for perceptual image quality assessment [J]. IEEE Transaction on Image Processing, 2014, 23(10): 4270-4281.
GAO J Y, LIU W Y, YAN Z G. Object tracking combined with attention and feature fusion [J]. Journal of Guangdong University of Technology, 2019, 36(4): 18-23.
HAREL J, KOCH C, PERONA P. Graph-based visual saliency[C]//Proceedings of the 2006 Conference. Advances in Neural Information Processing Systems 19. Vancouver: MIT Press, 2007: 545-552.
ACHANTA R, SHAJI A, SMITH K et al . SLIC superpixels compared to state-of-the-art superpixel methods [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11): 2274-2281.
ZHANG X D, FENG X C, WANG W W et al . Edge strength similarit y for image quality assessment [J ] . IEEE Signal Processing Letters, 2013, 20(4): 319-322.
GAO M J, DANG H S, WEI L L et al . Combining global and local variation for image quality assessment [J ] . Acta Automatica Sinica, 2020, 46(12): 1-10;.
GAO M J, DANG H S, WEI L L, et al . Visual saliency induced local image quality metrics [J ] . Scientia Sinica (Technological), 2019, 49(11): 1350-1360.
SHI C Y, LIN Y D. Objective image quality assessment based on image color appearance and gradient features [J]. Acta Physica Sinica, 2020, 69(22): 401-41.