TY - JOUR
T1 - An efficient data generation method for ANN-based surrogate models
AU - Tan, Ren Kai
AU - Qian, Chao
AU - Wang, Michael
AU - Ye, Wenjing
N1 - Funding Information:
This work is supported by the Hong Kong Research Grants under Competitive Earmarked Research Grant No. 16206320.
Publisher Copyright:
© 2022, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.
PY - 2022/2/14
Y1 - 2022/2/14
N2 - Rapid development in deep learning methods has brought about wide applications of artificial-neural-network (ANN)-based surrogate models in the field of numerical simulation. Given sufficient training, ANN-based surrogate models can be both accurate and efficient, and thus can be used to replace computationally expensive numerical simulations in problems where intensive numerical simulations are required. However, the training of ANN-based surrogate models relies on a large corpus of ground-truth data that is often generated using full-scale numerical simulations. For such large-scale problems, the computational cost of generating training data can be massive which diminishes the efficiency gained using ANN-based surrogate models and limits their application scope. In this work, a solution scheme is proposed to address this issue by reducing the full-scale numerical simulations needed during training data generation, thus reducing the training cost. The key idea is to utilize a Mapping Network that maps a coarse field to a fine field to generate fine-scale training data. Compared to surrogate models which map parameters/structures to fine fields, Mapping Network is much easier to be trained and thus requires much less fine-scale data. In addition, it has much better transferability and can be easily adopted to a related but different task. Combined with transfer learning, the proposed scheme results in greatly reduced training costs compared to the approach without using Mapping Network.
AB - Rapid development in deep learning methods has brought about wide applications of artificial-neural-network (ANN)-based surrogate models in the field of numerical simulation. Given sufficient training, ANN-based surrogate models can be both accurate and efficient, and thus can be used to replace computationally expensive numerical simulations in problems where intensive numerical simulations are required. However, the training of ANN-based surrogate models relies on a large corpus of ground-truth data that is often generated using full-scale numerical simulations. For such large-scale problems, the computational cost of generating training data can be massive which diminishes the efficiency gained using ANN-based surrogate models and limits their application scope. In this work, a solution scheme is proposed to address this issue by reducing the full-scale numerical simulations needed during training data generation, thus reducing the training cost. The key idea is to utilize a Mapping Network that maps a coarse field to a fine field to generate fine-scale training data. Compared to surrogate models which map parameters/structures to fine fields, Mapping Network is much easier to be trained and thus requires much less fine-scale data. In addition, it has much better transferability and can be easily adopted to a related but different task. Combined with transfer learning, the proposed scheme results in greatly reduced training costs compared to the approach without using Mapping Network.
KW - Artificial Neural Network
KW - Deep learning
KW - Surrogate model
KW - Topology optimization
KW - Transfer learning
UR - http://www.scopus.com/inward/record.url?scp=85124940136&partnerID=8YFLogxK
U2 - 10.1007/s00158-022-03180-6
DO - 10.1007/s00158-022-03180-6
M3 - Article
AN - SCOPUS:85124940136
SN - 1615-147X
VL - 65
JO - Structural and Multidisciplinary Optimization
JF - Structural and Multidisciplinary Optimization
IS - 3
M1 - 90
ER -