Computer-Vision Based on Three-dimensional Reconstruction Technology and Its Applications in Gas Turbine Industry

Xiangling KONG; Jinglun FU

doi:10.12096/j.2096-4528.pgt.21031

English Version Reader LoginJournal Login

您当前的位置：

首页 >

文章列表页 >

Computer-Vision Based on Three-dimensional Reconstruction Technology and Its Applications in Gas Turbine Industry

Intelligent Turbine Power Generation Technology | 更新时间：2025-07-04

- Computer-Vision Based on Three-dimensional Reconstruction Technology and Its Applications in Gas Turbine Industry
- Power Generation Technology Vol. 42, Issue 4, Pages: 454-463(2021)
- 作者机构：
  
  1.中国科学院工程热物理研究所南京未来能源系统研究院, 江苏省南京市 210000
  2.中国科学院工程热物理研究所先进燃气轮机实验室, 北京市海淀区 100190
  3.中国科学院大学, 北京市海淀区 100049
  4.中国科学院先进能源动力重点实验室, 北京市海淀区 100190
  5.中国科学院轻型动力创新研究院, 北京市海淀区 100190
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China(51776201)
- DOI：10.12096/j.2096-4528.pgt.21031
  CLC： TK05
- Received：25 April 2021，
  
  Published：31 August 2021
- 稿件说明：
移动端阅览
Xiangling KONG, Jinglun FU. Computer-Vision Based on Three-dimensional Reconstruction Technology and Its Applications in Gas Turbine Industry[J]. Power Generation Technology, 2021, 42(4): 454-463.
DOI：

Xiangling KONG, Jinglun FU. Computer-Vision Based on Three-dimensional Reconstruction Technology and Its Applications in Gas Turbine Industry[J]. Power Generation Technology, 2021, 42(4): 454-463. DOI： 10.12096/j.2096-4528.pgt.21031.

摘要

燃气轮机的整机性能及运行安全与其各部件的性能和工作状态密切相关，部件性能优劣和健康状态直接反映在表面的形貌上。因此，根据部件的形貌特征对其性能及健康状态进行判读，是评估燃机设计和健康状态的最为高效的方法，而三维重建技术是实现这一方法的关键技术。首先围绕基于计算机视觉的三维重建，系统地阐述了基于单目视觉、基于双目视觉及基于深度学习的三维重建技术及其发展现状；之后讨论了三维重建技术在燃气轮机行业的发展现状及可能的发展方向；最后，以燃气轮机透平叶片为对象，比较了基于阴影信息及多视图学习网络的三维重建效果并讨论了其各自的优缺点。

Abstract

The operational safety and performance of gas turbine is closely related to the health status of its components. Generally

the status of gas turbine components can be evaluated by the morphological characters

such as size

shape

color

etc. Therefore

the method of feature extraction

especially the three- dimensional (3D) feature extraction

has become a key technology for component health status assessment. The existing computer vision based on 3D reconstruction algorithms was reviewed. After that

the research status and development directions of the 3D reconstruction in the gas turbine industry were discussed. In the end

the reconstruction results of a turbine blade using the shape from shading (SFS) algorithm and the Mvsnet were presented and compared.

关键词

Keywords

references

方继辉, 王荣. 重型F级燃气轮机IGV开度对压气机效率的影响[J]. 发电技术, 2020, 41(3): 317-319.

FANG J H, WANG R. Influence of IGV opening degree on the compressor efficiency of MITSUBISHI F4 gas turbine[J]. Power Generation Technology, 2020, 41(3): 317-319.

BUTIME J, GUTIERREZ I, CORZO L G, et al. 3D reconstruction methods, a survey[C]//Proceedings of the First International Conference on Computer Vision Theory and Applications, 2015: 457-463.

CHEN X, LU C, MA M, et al. Color-coding and phase-shift method for absolute phase measurement[J]. Optics Communications, 2013, 298/299: 54-58.

TAKEDA M, MUTOH K. Fourier transform profilometry for the automatic measurement of 3-D object shapes[J]. Applied Optics, 1983, 22(24): 3977-3982.

FARAJIKHAH S, MADANIPOUR K, SAHARKHIZ S, et al. Shadow moiré aided 3-D reconstruction of fabric drape[J]. Fibers and Polymers, 2012, 13(7): 928-935.

IDESAWA M, YATAGAI T, SOMA T. Scanning moiré method and automatic measurement of 3D shapes[J]. Applied Optics, 1977, 16(8): 2152-2162.

SRINIVASAN V, LIU H C, HALIOUA M. Automated phase-measuring profilometry of 3-D diffuse objects[J]. Applied Optics, 1984, 23(18): 3105-3108.

TAVARES P J, VAZ M A. Linear calibration procedure for the phase-to-height relationship in phase measurement profilometry[J]. Optics Communications, 2007, 274(2): 307-314.

沈洋, 陈文静. 抽样对复合傅里叶变换轮廓术的影响[J]. 激光技术, 2008, 32(1): 80-83.

SHEN Y, CHEN E J. Influence of sampling on composite Fourier-transform propfilometry[J]. Laser Technology, 2008, 32(1): 80-83.

HORN B. Shape from shading: a method for obtaining the shape of a smooth opaque object from one view[D]. Cambridge: Massachusetts Institute of Technology, 1970.

HORN B. Obtaining shape from shading information[M]. New York: McGraw-Hill, 1989: 123-171.

王学梅. 不同成像条件的从明暗恢复形状算法研究[D]. 长沙: 国防科学技术大学, 2009.

WANG X M. Research on shape recovery algorithm from light and shade under different imaging conditions[D]. Changsha: National University of Defense Technology, 2009.

BROOKS M J, HORN B. Shape and source from shading[R]. Cambridge: Massachusetts Institute of Technology, 1985.

PARAGIOS N, CHEN Y, FAUGERAS O. Handbook of mathematical models in computer vision[M]. New Nork, Springer, 2006: 108-112.

孙玉娟. 基于光学图像的三维重建理论与技术[M]. 北京: 清华大学出版社, 2017: 125-126.

SUN Y J. Theory and technology of 3D reconstruction based on optical image[M]. Beijing: Tsinghua University Press, 2017: 125-126.

ROUY E, TOURIN A. A viscosity solutions approach to shape-from-shading[J]. SIAM Journal on Numerical Analysis, 1992: 867-884.

KIMMEL R, BRUCKSTEIN A M. Tracking level sets by level sets: a method for solving the shape from shading problem[J]. Computer Vision and Image Understanding, 1995, 62(1): 47-58.

ZHANG R, TSAI P S, CRYER J E, et al. Shape from shading: a survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1999, 21(8): 690-706.

PENTLAND A. Shape information from shading: a theory about human perception[J]. Spat Vis, 1989, 4(2/3): 165-182.

TSAI P, SHAH M. Shape from shading using linear approximation[J]. Image and Vision Computing, 1994, 12(8): 487-498.

ZHANG S, NEGAHDARIPOUR S. 3-D shape recovery of planar and curved surfaces from shading cues in underwater images[J]. IEEE Journal of Oceanic Engineering, 2002, 27(1): 100-116.

COOPER A P R. A simple shape-from-shading algorithm applied to images of ice-covered terrain[J]. IEEE Transactions on Geoscience and Remote Sensing, 1994, 32(6): 1196-1198.

CHO S Y, CHOW T W S. Shape and surface measurement technology by an improved shape-from-shading neural algorithm[J]. IEEE Transactions on Industrial Electronics, 2000, 47(1): 225-230.

KONG F H. Reconstruction of solder joint surface based on hybrid shape from shading[C]//International Conference on Natural Computation. IEEE Computer Society, 2008: 593-597.

CASTELAN M, HANCOCK E R. Acquiring height maps of faces from a single image[C]//3D Data Processing, Visualization, and Transmission, International Symposium. IEEE Computer Society. Thessaloniki: IEEE, 2004: 183-190.

MCGUNNIGLE G, DONG J. Augmenting photometric stereo with coaxial illumination[J]. IET Computer Vision, 2011, 5(1): 33-49.

ZHENG Q, CHELLAPPA R. Estimation of illuminant direction, albedo, and shape from shading[C]//IEEE Computer Society Conference on Computer Vision&Pattern Recognition. Maui: IEEE, 2002: 540-545.

WOODHAM R J. Photometric method for determining surface orientation from multiple images[J]. Optical Engineering, 1992, 19(1): 151-171.

GEORGHIADES A S, BELHUMEUR P N, KRIEGMAN D J. From few to many: illumination cone models for face recognition under variable lighting and pose[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 23(6): 643-660.

HAYAKAWA H. Photometric stereo under a light source with arbitrary motion[J]. Journal of the Optical Society of America A, 1994, 11(11): 3079-3089.

PAPADHIMITRI T, FAVARO P. A new perspective on uncalibrated photometric stereo[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Portland: IEEE, 2013: 1474-1481.

WOODHAM R J. Gradient and curvature from the photometric-stereo method, including local confidence estimation[J]. Journal of the Optical Society of America A, 1994, 11(11): 3050-3068.

COLEMAN E N, JAIN R. Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry[J]. Computer Graphics and Image Processing, 1982, 18(4): 309-328.

HERTZMANN A, SEITZ S M. Example-based photometric stereo: shape reconstruction with general, varying BRDFs[J]. IEEE Computer Society, 2005, 27(8): 1254-1264.

ZHANG Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11): 1330-1334.

CAI J. Integration of optical flow and dynamic programming for stereo matching[J]. IET Image Processing, 2012, 6(3): 205-212.

ANSARI M E, MAZOUL A, BENSRHAIR A, et al. A real-time spatio-temporal stereo matching for road applications[C]//International IEEE Conference on Intelligent Transportation Systems. Washington: IEEE, 2011: 1483-1488.

STOJAKOVIC V, TEPAVCEVIC B. Image-based modeling approach in creating 3D morphogenetic reconstruction of Liberty Square in Novi Sad[J]. Journal of Cultural Heritage, 2011, 12(1): 105-110.

CALAKLI F, TAUBIN G. SSD: smooth signed distance surface reconstruction[J]. Computer Graphics Forum, 2011, 30(7): 1993-2002.

MAURICIO K, YUSHI G, TUKI T, et al. Robust 3D image reconstruction of pancreatic cancer tumors from histopathological images with different stains and its quantitative performance evaluation[J]. International Journal of Computer Assisted Radiology and Surgery, 2019, 14(12): 2047-2055.

SZEGEDY C, LIU W, JIA Y Q, et al. Going deeper with convolutions[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston, MA, USA, 2015.

ZHONG Z, JIN L, XIE Z, et al. High performance offline handwritten Chinese character recognition using googlenet and directional feature maps[C]//Proceeding of the 201513th International Conference on Document Analysis and Recognition (ICDAR). Tunis, Tunisia, 2015: 846-850.

HE K M, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA, 2016.

FAVALLI M, FORNACIAI A, ISOLA I, et al. Multiview 3D reconstruction in geosciences[J]. Computers&Geosciences, 2012, 44: 168-176.

FAN H, HAO S, GUIBAS L. A point set generation network for 3D object reconstruction from a single image[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu: IEEE, 2017: 605-613.

CHOY C B, XU D, GWAK J, et al. 3D-R 2 N 2 : a unified approach for single and multi-view 3D object reconstruction[C ] //Proceeding of the European Conference on Computer Vision. 2016..

PAN J, LI J, HAN X, et al. Residual meshnet: learning to deform meshes for single-view 3D reconstruction[C]//Proceeding of the 2018 International Conference on 3D Vision, 2018.

RUAN C, YU T, CHEN F, et al. Experimental characterization of the spatiotemporal dynamics of a turbulent flame in a gas turbine model combustor using computed tomography of chemiluminescence[J]. Energy, 2019, 170: 744-751.

WANG Q, ZHANG Y. Spark characteristics investigation of a gas turbine igniter[J]. Combustion Science and Technology, 2012, 184(10/12): 1526-1540.

HUANG J, LIU H, WANG Q, et al. Limited-projection volumetric tomography for time-resolved turbulent combustion diagnostics via deep learning[J]. Aerospace Science and Technology, 2020, 106: 106123.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Uncertainty Analysis of Gas Turbine Overall Performance Based on Monte Carlo Method

Research Progress on Film Cooling Fed by Crossflow Ribbed Passage of Gas Turbine Blades

Research Status and Development Trend of Rotating Internal Cooling Channel in Gas Turbine Blade

Review of Research on Swirl Cooling Technology of Gas Turbine Blades

Impact of Falling Blocks of High Pressure Turbine Rotor Blades With Squealer Tip on the Aerodynamic Performance and Vibration Characteristics

Related Author

KONG Xiangling

LIU Haisong

FU Jinglun

CHEN Yan

LU Wenqiang

TONG Zhiting

FU Jinglun

ZHANG Haichuan

Related Institution

Nanjing Institute of Future Energy System, IET, CAS

Jiangsu Yanhai Chemical Co., Ltd.

Advanced Gas Turbine Laboratory, Institute of Engineering Thermophysics, Chinese Academy of Sciences, Haidian District

Research Center of Fluid Machinery Engineering and Technology, Jiangsu University

University of Chinese Academy of Sciences, Haidian District

AI问答

⁰