Meta-Model Framework for Surrogate-Based Parameter Estimation in Dynamical Systems

by   Žiga Lukšič, et al.

The central task in modeling complex dynamical systems is parameter estimation. This task involves numerous evaluations of a computationally expensive objective function. Surrogate-based optimization introduces a computationally efficient predictive model that approximates the value of the objective function. The standard approach involves learning a surrogate from training examples that correspond to past evaluations of the objective function. Current surrogate-based optimization methods use static, predefined substitution strategies that decide when to use the surrogate and when the true objective. We introduce a meta-model framework where the substitution strategy is dynamically adapted to the solution space of the given optimization problem. The meta model encapsulates the objective function, the surrogate model and the model of the substitution strategy, as well as components for learning them. The framework can be seamlessly coupled with an arbitrary optimization algorithm without any modification: it replaces the objective function and autonomously decides how to evaluate a given candidate solution. We test the utility of the framework on three tasks of estimating parameters of real-world models of dynamical systems. The results show that the meta model significantly improves the efficiency of optimization, reducing the total number of evaluations of the objective function up to an average of 77


page 1

page 10


A First Analysis of Kernels for Kriging-based Optimization in Hierarchical Search Spaces

Many real-world optimization problems require significant resources for ...

Monotone Improvement of Information-Geometric Optimization Algorithms with a Surrogate Function

A surrogate function is often employed to reduce the number of objective...

Adaptive machine learning based surrogate modeling to accelerate PDE-constrained optimization in enhanced oil recovery

In this contribution, we develop an efficient surrogate modeling framewo...

A Radial Basis Function based Optimization Algorithm with Regular Simplex set geometry in Ellipsoidal Trust-Regions

We present a novel derivative-free interpolation based optimization algo...

Resonant Machine Learning Based on Complex Growth Transform Dynamical Systems

In this paper we propose an energy-efficient learning framework which ex...

Cross-Entropy Method Variants for Optimization

The cross-entropy (CE) method is a popular stochastic method for optimiz...

Initial Design Strategies and their Effects on Sequential Model-Based Optimization

Sequential model-based optimization (SMBO) approaches are algorithms for...

Please sign up or login with your details

Forgot password? Click here to reset