MPI/OpenMP hybrid parallel computation of wall distance for turbulence flow simulations

ZHAO Zhong; HE Lei; ZHANG Jian; XU Qingxin; ZHANG Laiping

doi:10.7638/kqdlxxb-2017.0199

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

MPI/OpenMP hybrid parallel computation of wall distance for turbulence flow simulations

更新时间：2026-05-28

- MPI/OpenMP hybrid parallel computation of wall distance for turbulence flow simulations
- Vol. 37, Issue 6, Pages: 883-892(2019)
- 作者机构：
  
  中国空气动力研究与发展中心计算空气动力研究所,四川,绵阳,621000
- 作者简介：
- 基金信息：
- DOI：10.7638/kqdlxxb-2017.0199
  CLC： V211.3
- Published：2019
- 稿件说明：
移动端阅览
赵钟, 何磊, 张健, 徐庆新, 张来平. 湍流模拟壁面距离MPI/OpenMP混合并行计算方法[J]. 空气动力学学报, 2019, 37(6): 883-892.

ZHAO Zhong, HE Lei, ZHANG Jian, et al. MPI/OpenMP hybrid parallel computation of wall distance for turbulence flow simulations[J]. 2019, 37(6): 883-892.
赵钟, 何磊, 张健, 徐庆新, 张来平. 湍流模拟壁面距离MPI/OpenMP混合并行计算方法[J]. 空气动力学学报, 2019, 37(6): 883-892. DOI： 10.7638/kqdlxxb-2017.0199.

ZHAO Zhong, HE Lei, ZHANG Jian, et al. MPI/OpenMP hybrid parallel computation of wall distance for turbulence flow simulations[J]. 2019, 37(6): 883-892. DOI： 10.7638/kqdlxxb-2017.0199.

摘要

针对计算流体力学在湍流数值模拟过程中壁面距离计算效率不高的问题，设计了一种基于ADT数据结构搜索的MPI/OpenMP混合并行计算方法，以大幅提高大规模网格壁面距离的计算效率，降低因内存消耗而对网格规模的限制。首先分析了壁面距离计算精度对湍流模拟的重要性，介绍了壁面距离计算的几何基础。随后基于区域分解思想，将计算域划分为不同的子分区，服务器进程收集全局壁面面元网格信息后发送给其他所有进程，各进程根据全局壁面信息，基于ADT数据结构搜索其网格分区内的单元，精确计算壁面距离。为了解决全局壁面信息内存过大的问题，采用MPI/OpenMP混合并行算法，使得各计算节点中仅有一个或少数几个壁面信息备份，这些壁面信息备份被节点内的其他各进程所共享。最后采用大规模网格进行了壁面距离计算测试，网格规模最大达到33.2亿，结果表明，该方法的计算精度和直接搜索法一致，内存耗费下降70%，计算时间减少约1个量级，能满足大规模CFD数值模拟的需求。

Abstract

A parallel wall distance computing approach is proposed for large scale CFD turbulence flow simulations to reduce the wall distance computing time consumption. This method is based on MPI/OpenMP hybrid parallel ADT searching procedure to further improve the computational efficiency and to reduce memory consumption. Firstly

the influence of the accuracy of wall distance computing is analyzed

and the foundational computational geometry algorithm used in this paper is introduced. Then the parallel wall distance computing approach based on the ADT searching procedure is discussed in details. In this method

the total computational field is divided into a number of zones firstly

and then the whole surface faces data on the solid wall is collected and broadcasted to all other processors using MPI communications. The wall distances of spatial cells in each zone are computed based on the ADT searching within each processor. In order to overcome the memory limitation

a MPI/OpenMP hybrid parallel method is proposed

and then only one or a few copies of the surface faces data are created within each computer node other than for each processor. Numerical results show that the present method substantially improves efficiency by one order and reduces the memory consumption by 70%

which indicates that this method can fullfill the demand of large-scale parallel simulations.

关键词

Keywords

references

ZHOU H, ZHANG H X. What is the essence of the so-called century lasting difficult problem in classic physics, the "problem of turbulence"?[J]. Scientia Sinica Physica, Mechanica Astronomica, 2012, 42(1): 1-5. (in Chinese)

TUCKER P G, RUMSEY C L, SPALART P R. Computation of wall distances based on differential equations[R]. AIAA 2004-2232.

TUCKER P G. Assessment of geometric multilevel convergence robustness and a wall distance method for flows with multiple internal boundaries[J]. Applied Mathematical Modeling, 1998, 22(4): 293-311.

LI G N, LI F W, ZHOU Z H. An efficient method for calculating wall distance[J]. Advances in Aeronautical Science and Engineering, 2010, 1(2): 137-142. (in Chinese)

VOS J B, LEYLAND P. NSMB handbook 5.0[R]. IMHEF-DGM-EPFL, 2003.

SPALART P R. Trends in turbulence treatments[R]. AIAA 2000-2306.

WANG G, ZENG Z, YE Z Y. An efficient search algorithm for calculating minimum wall distance of unstructured mesh[J]. Journal of Northwestern Polytechnical University, 2014, 32(4): 511-516. (in Chinese)

ZHAO H Y, HE X Z, LE J L. Recursive box method for wall distance computation[J]. Chinese Journal of Computational Physics, 2008, 25(4): 427-430. (in Chinese)

YANG Y G, CHENG X H, WANG W J. A parallel computation method of wall distance for large-scale flow simulation[J]. Computer Engineering Science, 2016, 38(6): 1086-1090. (in Chinese)

BOGER D A. Efficient method for calculating wall proximity[J]. AIAA Journal, 2001, 9(12): 2404-2406.

SPALART P R, ALLMARAS S R. A one equation turbulence model for aerodynamic flows[R]. AIAA 92-0439.

JOSEPH O R. Computational geometry in C[M]. Cambridge University Press, 1997.

TOMAS M, BEN T. Fast minimum storage ray-triangle intersection[J]. Journal of Graphics Tools, 1997, 2(1): 21-28.

JAVIER B, JAIME P. An alternating digital tree (ADT) algorithm for 3D geometric searching and intersection problems[J]. International Journal for Numerical Methods in Engineering, 1997, 31: 1-17.

HE X, ZHAO Z, ZHANG L P. The research and development of structured-unstructured hybrid CFD software[J]. Transactions of Nanjing University of Aeronautics Astronautics, 2013, 30(s): 116-126.

HE X, ZHANG L P, ZHAO Z. Research of general large scale CFD software architecture and data structure[J]. Acta Aerodynamica Sinica, 2012, 30(5): 557-565. (in Chinese)

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Development and open source application progress of NNW-PHengLEI

Design and development of software automated continuous integration and testing platform for National Numerical Windtunnel project

Research on the characteristics of water droplets impacting moving superhydrophobic surfaces and its regulation

Installation effects on propeller tone noise

Noise prediction and reduction methods for LAGOON landing gear based on Lattice Boltzmann method

Related Author

Zhao Zhong

He Xianyao

He Lei

Huang Can

HE Lei

GUO Yongyan

ZENG Zhichun

LAI Xiangcheng

Related Institution

Computational Aerodynamic Institute of China Aerodynamics Research and Development Center, Mianyang

Sichuan Tianfu Fluid Big Data Research Center, Chengdu

China Aerodynamics Research and Development Center

AI问答

⁰