An Evolutionary Optimization of LSTM for Model Recovery of Geophysical Fluid Dynamics

Gary Yen; Li Bo; Xie Sheng-li

doi:10.12052/gdutxb.210109

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

An Evolutionary Optimization of LSTM for Model Recovery of Geophysical Fluid Dynamics

更新时间：2026-05-27

- An Evolutionary Optimization of LSTM for Model Recovery of Geophysical Fluid Dynamics
- Vol. 38, Issue 6, Pages: 1-8(2021)
- 作者机构：
  
  1. 美国俄克拉荷马州立大学电气与计算机工程学院，俄克拉荷马州静水,74078
  2. 广东工业大学自动化学院,广东,广州,510006
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.210109
  CLC： TP391.4
- Online First：10 November 2021，
  
  Published：2021
- 稿件说明：
移动端阅览
GaryYen, 栗波, 谢胜利. 地球流体动力学模型恢复的长短期记忆网络渐进优化方法[J]. 广东工业大学学报, 2021, 38(6): 1-8.

Gary Yen, Li Bo, Xie Sheng-li. An Evolutionary Optimization of LSTM for Model Recovery of Geophysical Fluid Dynamics[J]. 2021, 38(6): 1-8.
GaryYen, 栗波, 谢胜利. 地球流体动力学模型恢复的长短期记忆网络渐进优化方法[J]. 广东工业大学学报, 2021, 38(6): 1-8. DOI： 10.12052/gdutxb.210109.

Gary Yen, Li Bo, Xie Sheng-li. An Evolutionary Optimization of LSTM for Model Recovery of Geophysical Fluid Dynamics[J]. 2021, 38(6): 1-8. DOI： 10.12052/gdutxb.210109.

摘要

地球物理流体动力学的计算模型在数据同化和不确定性量化等任务中的计算代价非常大。有人提出了相应的替代模型以寻求减轻计算负担。研究人员已经开始应用人工智能和机器学习算法

特别是人工神经网络

针对地球物理流体建立数据驱动的替代模型。神经网络的性能在很大程度上取决于其网络结构设计和超参数的选择(调参)。一般情况下

这些神经网络通过手动调参

反复试错

从而最大限度地提高其计算性能。这通常要求对底层神经网络结构以及特定领域问题有专业知识积累和认知。这一局限性可以通过使用进化算法

自动设计和选择神经网络的最优超参数来解决。本文应用遗传算法进行了有效的长短期记忆(Long Short-Term Memory

LSTM)神经网络设计

建立了NOAA海表温度数据集的温度预测模型。

Abstract

The computational models for geophysical fluid dynamics are computationally enormously expensive to employ in tasks such as data assimilation and uncertainty quantification. Naturally

surrogate models seeking to alleviate the computational burden has been proposed. Researchers have started applying artificial intelligence and machine learning algorithms

particularly artificial neural networks

to build data-driven surrogate models for geophysical flows. The performance of the neural network highly relies upon their architecture design and selection of hyper-parameters. These neural networks are usually manually crafted through trial and error to maximize their performance. This often demands specialized knowledge of the underlying neural network as well as the domain problems of interest. This limitation can be addressed by using an evolutionary algorithm to automatically design and select optimal hyper-parameters of the neural network. In this study

the genetic algorithm is applied to effectively design the long short-term memory (LSTM) neural network to build the forecasting model of the temperature in the NOAA sea-surface temperature data set.

关键词

Keywords

references

LEWIS J M, LAKSHMIVARAHAN S, DHALL S. Dynamic data assimilation: a least squares approach[M]. Cambridge: Cambridge University Press, 2006.

MOIN P, MAHESH K. Direct numerical simulation: a tool in turbulence research [J]. Annual Review of Fluid Mechanics, 1998, 30(1): 539-578.

POLAT O, TUNCER I H. Aerodynamic shape optimization of wind turbine blades using a parallel genetic algorithm [J]. Procedia Engineering, 2013, 61: 28-31.

LUCIA D J, BERAN P S, SILVA W A. Reduced-order modeling: new approaches for computational physics [J]. Progress in Aerospace Sciences, 2004, 40(1-2): 51-117.

TAIRA K, BRUNTON S L, DAWSON S T M, et al . Modal analysis of fluid flows: an overview [J ] . Aiaa Journal, 2017, 55(12): 4013-4041.

BENNER P, GUGERCIN S, WILLCOX K. A survey of projection-based model reduction methods for parametric dynamical systems [J]. SIAM Review, 2015, 57(4): 483-531.

XIAO D, FANG F, PAIN C, et al . Non-intrusive reduced-order modelling of the Navier-Stokes equations based on RBF interpolation [J ] . International Journal for Numerical Methods in Fluids, 2015, 79(11): 580-595.

HESTHAVEN J S, UBBIALI S. Non-intrusive reduced order modeling of nonlinear problems using neural networks [J]. Journal of Computational Physics, 2018, 363: 55-78.

PAWAR S, RAHMAN S M, VADDIREDDY H, et al . A deep learning enabler for nonintrusive reduced order modeling of fluid flows [J ] . Physics of Fluids, 2019, 31(8): 085101.

SCHNEIDER T, LAN S, STUART A, et al . Earth system modeling 2.0: a blueprint for models that learn from observations and targeted high-resolution simulations [J ] . Geophysical Research Letters, 2017, 44(24): 12396-12417.

O'GORMAN P A, DWYER J G. Using machine learning to parameterize moist convection: potential for modeling of climate, climate change, and extreme events [J]. Journal of Advances in Modeling Earth Systems, 2018, 10(10): 2548-2563.

REICHSTEIN M, CAMPS-VALLS G, STEVENS B, et al . Deep learning and process understanding for data-driven earth system science [J ] . Nature, 2019, 566(7743): 195-204.

RAHMAN S M, PAWAR S, SAN O, et al . Nonintrusive reduced order modeling framework for quasigeostrophic turbulence [J ] . Physica l Review E, 2019, 100(5): 053306.

TAN C, SUN F, KONG T, et al. A survey on deep transfer learning[C]//International Conference on Artificial Neural Networks. Switzerland: Springer, Cham, 2018: 270-279.

MJOLSNESS E, DECOSTE D. Machine learning for science: state of the art and future prospects [J]. Science, 2001, 293(5537): 2051-2055.

BRUNTON S L, NOACK B R, KOUMOUTSAKOS P. Machine learning for fluid mechanics [J]. Annual Review of Fluid Mechanics, 2020, 52: 477-508.

KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks [J]. Advances in Neural Information Processing Systems, 2012, 25: 1097-1105.

ELSKEN T, METZEN J H, HUTTER F. Neural architecture search: a survey [J]. The Journal of Machine Learning Research, 2019, 20(1): 1997-2017.

HOLMES P, LUMLEY J L, BERKOOZ G, et al. Turbulence, coherent structures, dynamical systems and symmetry[M]. Cambridge: Cambridge University Press, 2012.

ROWLEY C W, DAWSON S T M. Model reduction for flow analysis and control [J]. Annual Review of Fluid Mechanics, 2017, 49: 387-417.

PATHAK J, HUNT B, GIRVAN M, et al . Model-free prediction of large spatiotemporally chaotic systems from data: a reservoir computing approach [J ] . Physical Review Letters, 2018, 120(2): 024102.

VLACHAS P R, BYEON W, WAN Z Y, et al . Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks [J ] . Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2018, 474(2213): 20170844.

MAULIK R, MOHAN A, LUSCH B, et al . Time-series learning of latent-space dynamics for reduced-order model closure [J ] . Physica D: Nonlinear Phenomena, 2020, 405: 132368.

AHMED S E, RAHMAN S M, SAN O, et al . Memory embedded non-intrusive reduced order modeling of non-ergodic flows [J ] . Physics of Fluids, 2019, 31(12): 126602.

WAN Z Y, VLACHAS P, KOUMOUTSAKOS P, et al . Data-assisted reduced-order modeling of extreme events in complex dynamical systems [J ] . PloS One, 2018, 13(5): e0197704.

HOCHREITER S, SCHMIDHUBER J. Long short-term memory [J]. Neural Computation, 1997, 9(8): 1735-1780.

XIE L, YUILLE A. Genetic CNN[C]//Proceedings of the IEEE International Conference on Computer Vision.Venice: IEEE, 2017: 1379-1388.

SUN Y, XUE B, ZHANG M, et al . Automatically designing CNN architectures using the genetic algorithm for image classification [J ] . IEEE Transactions on Cybernetics, 2020, 50(9): 3840-3854.

SUN Y, YEN G G, YI Z. Evolving unsupervised deep neural networks for learning meaningful representations [J]. IEEE Transactions on Evolutionary Computation, 2018, 23(1): 89-103.

SUN Y, WANG H, XUE B, et al . Surrogate-assisted evolutionary deep learning using an end-to-end random forest-based performance predictor [J ] . IEEE Transactions on Evolutionary Computation, 2019, 24(2): 350-364.

SUN Y, XUE B, ZHANG M, et al . Evolving deep convolutional neural networks for image classification [J ] . IEEE Transactions on Evolutionary Computation, 2019, 24(2): 394-407.

SUN Y, XUE B, ZHANG M, et al . Completely automated CNN architecture design based on blocks [J ] . IEEE Transactions on Neural Networks and Learning Systems, 2019, 31(4): 1242-1254.

ZHOU Y, YEN G G, YI Z. Evolutionary compression of deep neural networks for biomedical image segmentation [J]. IEEE Transactions on Neural Networks and Learning Systems, 2019, 31(8): 2916-2929.

DROZDZAL M, VORONTSOV E, CHARTRAND G, et al. The importance of skip connections in biomedical image segmentation[C]//Deep learning and data labeling for medical applications. Switzerland: Springer, 2016: 179-187.

HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV: IEEE, 2016: 770-778.

MAULIK R, LUSCH B, BALAPRAKASH P. Non-autoregressive time-series methods for stable parametric reduced-order models [J]. Physics of Fluids, 2020, 32(8): 087115.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Dynamic Adaptive Enhancement for Power Scene Images DA-IOD Algorithm for Quantitative Target Detection

Deep Subdomain Adaptation Method Based on Domain Invariant Discriminant Feature Learning

A Hotspot Detector Based on Active Learning and Visual State Space Models

Ground Deformation Monitoring and Influencing Factors Analysis in Fuzhou City Based on PSI Technology

Energy Management Strategy of Hybrid Locomotive Based on Road Condition Parameters

Related Author

Xu Fangyuan

Chen Hailin

Yuan Haoliang

Chen Jianhua

Hoon Heo

Feng Yongjin

Wu Xiaoling

Xiao Kaixiang

Related Institution

Samsung Electro-mechanics Co., Ltd., Suwon City

School of Computer Science and Technology, Guangdong University of Technology

School of Integrated Circuits, Guangdong University of Technology

Faculty of Applied Sciences, Macao Polytechnic University, Macao

School of Computer Science of Technology, Guangdong University of Technology

AI问答

⁰