Sensitivity Analysis for Computationally Expensive Models using Optimization and Objective-oriented Surrogate Approximations

by   Yilun Wang, et al.

In this paper, we focus on developing efficient sensitivity analysis methods for a computationally expensive objective function f(x) in the case that the minimization of it has just been performed. Here "computationally expensive" means that each of its evaluation takes significant amount of time, and therefore our main goal to use a small number of function evaluations of f(x) to further infer the sensitivity information of these different parameters. Correspondingly, we consider the optimization procedure as an adaptive experimental design and re-use its available function evaluations as the initial design points to establish a surrogate model s(x) (or called response surface). The sensitivity analysis is performed on s(x), which is an lieu of f(x). Furthermore, we propose a new local multivariate sensitivity measure, for example, around the optimal solution, for high dimensional problems. Then a corresponding "objective-oriented experimental design" is proposed in order to make the generated surrogate s(x) better suitable for the accurate calculation of the proposed specific local sensitivity quantities. In addition, we demonstrate the better performance of the Gaussian radial basis function interpolator over Kriging in our cases, which are of relatively high dimensionality and few experimental design points. Numerical experiments demonstrate that the optimization procedure and the "objective-oriented experimental design" behavior much better than the classical Latin Hypercube Design. In addition, the performance of Kriging is not as good as Gaussian RBF, especially in the case of high dimensional problems.


page 1

page 2

page 3

page 4


Lipschitz-based Surrogate Model for High-dimensional Computationally Expensive Problems

Standard evolutionary optimization algorithms assume that the evaluation...

Global sensitivity analysis based on Gaussian-process metamodelling for complex biomechanical problems

Biomechanical models often need to describe very complex systems, organs...

Can We Do Better Than Random Start? The Power of Data Outsourcing

Many organizations have access to abundant data but lack the computation...

Cross-Entropy Method Variants for Optimization

The cross-entropy (CE) method is a popular stochastic method for optimiz...

Goal-based sensitivity maps using time windows and ensemble perturbations

We present an approach for forming sensitivity maps (or sensitivites) us...

Landscape-Sketch-Step: An AI/ML-Based Metaheuristic for Surrogate Optimization Problems

In this paper, we introduce a new heuristics for global optimization in ...

Please sign up or login with your details

Forgot password? Click here to reset