Design of Dynamic Experiments for Black-Box Model Discrimination

by   Simon Olofsson, et al.

Diverse domains of science and engineering require and use mechanistic mathematical models, e.g. systems of differential algebraic equations. Such models often contain uncertain parameters to be estimated from data. Consider a dynamic model discrimination setting where we wish to chose: (i) what is the best mechanistic, time-varying model and (ii) what are the best model parameter estimates. These tasks are often termed model discrimination/selection/validation/verification. Typically, several rival mechanistic models can explain data, so we incorporate available data and also run new experiments to gather more data. Design of dynamic experiments for model discrimination helps optimally collect data. For rival mechanistic models where we have access to gradient information, we extend existing methods to incorporate a wider range of problem uncertainty and show that our proposed approach is equivalent to historical approaches when limiting the types of considered uncertainty. We also consider rival mechanistic models as dynamic black boxes that we can evaluate, e.g. by running legacy code, but where gradient or other advanced information is unavailable. We replace these black-box models with Gaussian process surrogate models and thereby extend the model discrimination setting to additionally incorporate rival black-box model. We also explore the consequences of using Gaussian process surrogates to approximate gradient-based methods.


page 1

page 2

page 3

page 4


GPdoemd: a Python package for design of experiments for model discrimination

Model discrimination identifies a mathematical model that usefully expla...

Uncertainty estimation for time series forecasting via Gaussian process regression surrogates

Machine learning models are widely used to solve real-world problems in ...

Black-Box Saliency Map Generation Using Bayesian Optimisation

Saliency maps are often used in computer vision to provide intuitive int...

Design of Experiments for Model Discrimination Hybridising Analytical and Data-Driven Approaches

Healthcare companies must submit pharmaceutical drugs or medical devices...

Learning Arbitrary Quantities of Interest from Expensive Black-Box Functions through Bayesian Sequential Optimal Design

Estimating arbitrary quantities of interest (QoIs) that are non-linear o...

Goal-Image Conditioned Dynamic Cable Manipulation through Bayesian Inference and Multi-Objective Black-Box Optimization

To perform dynamic cable manipulation to realize the configuration speci...

Neural Modelling of Dynamic Systems with Time Delays Based on an Adjusted NEAT Algorithm

A problem related to the development of an algorithm designed to find an...

Please sign up or login with your details

Forgot password? Click here to reset