WU Pin, SUN Junwu, FENG Weibing. Reduced order model based on autoencoder and long short-term memory network[J]. 2021, 39(1): 73-81.DOI: 10.7638/kqdlxxb-2019.0082.
Reduced order model based on autoencoder and long short-term memory network
Autoencoder is an effective dimensionality reduction method that can learn the hidden information and features implicated in the data
and reconstruct the original input data. We propose a model reduction method with improved accuracy based on a multi-layer autoencoder and a long short-term memory network. The method is analyzed and verified through a two-dimensional flow past a cylinder. Firstly
the multi-layer autoencoder is used to reduce the order and extract features of the original data. Then
a prediction model based on a long short-term memory network is established. At last
the autoencoder and the prediction model are spliced into a single network to obtain a fine-tuned reduced order model. This model is further c
ompared with another one based on the principal component analysis. Results show that the multi-layer autoencoder can improve the data compression ratio while ensuring the accuracy. The proposed reduced order method can effectively improve the model accuracy since the root mean square error between the predicted and the original velocity fields is reduced to within 3×10
-3
.
关键词
Keywords
references
DOWELL E H. Eigenmode analysis in unsteady aerodynamics-Reduced-order models[J]. Applied Mechanics Reviews, 1997, 50(6): 371.
SILVA W A. Identification of linear and nonlinear aerodynamic impulse responses using digital filter techniques: AIAA-97-3712[R]. Reston: AIAA, 1997.
CHEN G, LI Y M. Advances and prospects of the reduced order model for unsteady flow and itsapplication[J]. Advances in Mechanics, 2011, 41(6): 686-701. (in Chinese)
LIBBRECHT M W, NOBLE W S. Machine learning applications in genetics and genomics[J]. Nature Reviews Genetics, 2015, 16(6): 321.
KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks[C]//Advances in neural information processing systems. 2012: 1097-1105.
KOUROU K, EXARCHOS T P, EXARCHOS K P, et al. Machine learning applications in cancer prognosis and prediction[J]. Computational and Structural Biotechnology Journal, 2015, 13: 8-17.
KUTZ J N. Deep learning in fluiddynamics[J]. Journal of Fluid Mechanics, 2017, 814: 1-4.
ZHANG W W, ZHU L Y, LIU Y L, et al. Progresses in the application of machine learning in turbulence modeling[J]. Acta Aerodynamica Sinica, 2019, 37(3): 444-454. (in Chinese)
TOMPSON J, SCHLACHTER K, SPRECHMANN P, et al. Accelerating eulerian fluid simulation with convolutional networks[C]//34th International Conference on Machine Learning-Volume 70. JMLR. org, 2017: 3424-3433.
WANG Q, HESTHAVEN J S, RAY D. Non-intrusive reduced order modeling of unsteady flows using artificial neural networks with application to a combustion problem[J]. Journal of Computational Physics, 2019, 384: 289-307.
HOCHREITER S, SCHMIDHUBER J. Long short-term memory[J]. Neural Computation, 1997, 9(8): 1735-1780.
MANNARINO A, MANTEGAZZA P. Nonlinearaeroelastic reduced order modeling by recurrent neural networks[J]. Journal of Fluids and Structures, 2014, 48: 103-121.
WANG Z, XIAO D, FANG F, et al. Model identification of reduced order fluid dynamics systems using deep learning[J]. International Journal for Numerical Methods in Fluids, 2018, 86(4): 255-268.
GRAVES A, SCHMIDHUBER J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures[J]. Neural Networks, 2005, 18(5-6): 602-610.
LINDHORST K, HAUPT M C, HORST P. Efficient surrogate modelling of nonlinear aerodynamics inaerostructural coupling schemes[J]. AIAA Journal, 2014, 52(9): 1952-1966.
YAO W, MARQUES S. Nonlinear aerodynamic andaeroelastic model reduction using a discrete empirical interpolation method[J]. AIAA Journal, 2017, 55(2): 1-14.
YIN M L, KOU J Q, ZHANG WW. A reduced-order aerodynamic model with high generalization capability based on neural network[J]. Acta Aerodynamica Sinica, 2017, 35(2): 205-213. (in Chinese) doi: 10. 7638/kqdlxxb-2015. 0210
KOU J, ZHANG W. Multi-kernel neural networks for nonlinear unsteady aerodynamic reduced-order modeling[J]. Aerospace Scienceand Technology, 2017, 67: 309-326.
RUMELHART D E, HINTON G E, WILLIAMS R J. Learning internal representations by error propagation[R]. California Univ San Diego La Jolla Inst for Cognitive Science, 1985.
YE S R, ZHANG Z, SONG X D, et al. Applications of autoencoder in reduced-order modeling of flow field[J]. Acta Aerodynamica Sinica, 2019, 37(3): 498-504. (in Chinese) doi: 10. 7638/kqdlxxb-2019. 0039.
HINTON G E, OSINDERO S, TEH Y W. A fast learning algorithm for deep beliefnets[J]. Neural Computation, 2006, 18(7): 1527-1554.
KINGMA D P, BA J. Adam: a method for stochastic optimization[J]. ArXiv Preprint ArXiv: 1412. 6980, 2014.