DeepAI AI Chat
Log In Sign Up

Error Analysis of Surrogate Models Constructed through Operations on Sub-models

by   Yiwen Chen, et al.

Model-based methods are popular in derivative-free optimization (DFO). In most of them, a single model function is built to approximate the objective function. This is generally based on the assumption that the objective function is one blackbox. However, some real-life and theoretical problems show that the objective function may consist of several blackboxes. In those problems, the information provided by each blackbox may not be equal. In this situation, one could build multiple sub-models that are then combined to become a final model. In this paper, we analyze the relation between the accuracy of those sub-models and the model constructed through their operations. We develop a broad framework that can be used as a theoretical tool in model error analysis and future research in DFO algorithms design.


page 1

page 2

page 3

page 4


Monotone Improvement of Information-Geometric Optimization Algorithms with a Surrogate Function

A surrogate function is often employed to reduce the number of objective...

A First Analysis of Kernels for Kriging-based Optimization in Hierarchical Search Spaces

Many real-world optimization problems require significant resources for ...

A Joint Framework for Argumentative Text Analysis Incorporating Domain Knowledge

For argumentation mining, there are several sub-tasks such as argumentat...

Derivative-Free Multiobjective Trust Region Descent Method Using Radial Basis Function Surrogate Models

We present a flexible trust region descend algorithm for unconstrained a...

An Empirical Study on Learning and Improving the Search Objective for Unsupervised Paraphrasing

Research in unsupervised text generation has been gaining attention over...

Evaluating Bregman Divergences for Probability Learning from Crowd

The crowdsourcing scenarios are a good example of having a probability d...

A theoretical framework for evaluating forward feature selection methods based on mutual information

Feature selection problems arise in a variety of applications, such as m...