SmOOD: Smoothness-based Out-of-Distribution Detection Approach for Surrogate Neural Networks in Aircraft Design

by   Houssem Ben Braiek, et al.
Corporation de l'ecole Polytechnique de Montreal

Aircraft industry is constantly striving for more efficient design optimization methods in terms of human efforts, computation time, and resource consumption. Hybrid surrogate optimization maintains high results quality while providing rapid design assessments when both the surrogate model and the switch mechanism for eventually transitioning to the HF model are calibrated properly. Feedforward neural networks (FNNs) can capture highly nonlinear input-output mappings, yielding efficient surrogates for aircraft performance factors. However, FNNs often fail to generalize over the out-of-distribution (OOD) samples, which hinders their adoption in critical aircraft design optimization. Through SmOOD, our smoothness-based out-of-distribution detection approach, we propose to codesign a model-dependent OOD indicator with the optimized FNN surrogate, to produce a trustworthy surrogate model with selective but credible predictions. Unlike conventional uncertainty-grounded methods, SmOOD exploits inherent smoothness properties of the HF simulations to effectively expose OODs through revealing their suspicious sensitivities, thereby avoiding over-confident uncertainty estimates on OOD samples. By using SmOOD, only high-risk OOD inputs are forwarded to the HF model for re-evaluation, leading to more accurate results at a low overhead cost. Three aircraft performance models are investigated. Results show that FNN-based surrogates outperform their Gaussian Process counterparts in terms of predictive performance. Moreover, SmOOD does cover averagely 85 When SmOOD plus FNN surrogates are deployed in hybrid surrogate optimization settings, they result in a decrease error rate of 34.65 speed up rate of 58.36 times, respectively.


page 1

page 2

page 3

page 4


Using Bayesian deep learning approaches for uncertainty-aware building energy surrogate models

Fast machine learning-based surrogate models are trained to emulate slow...

Distance-based Kernels for Surrogate Model-based Neuroevolution

The topology optimization of artificial neural networks can be particula...

Yield Optimization using Hybrid Gaussian Process Regression and a Genetic Multi-Objective Approach

Quantification and minimization of uncertainty is an important task in t...

Optimizing Closed-Loop Performance with Data from Similar Systems: A Bayesian Meta-Learning Approach

Bayesian optimization (BO) has demonstrated potential for optimizing con...

Surrogate Neural Networks for Efficient Simulation-based Trajectory Planning Optimization

This paper presents a novel methodology that uses surrogate models in th...

On Predictive Explanation of Data Anomalies

Numerous algorithms have been proposed for detecting anomalies (outliers...

Please sign up or login with your details

Forgot password? Click here to reset