Tuning metaheuristics by sequential optimization of regression models

by   Áthila R. Trindade, et al.

Tuning parameters is an important step for the application of metaheuristics to problem classes of interest. In this work we present a tuning framework based on the sequential optimization of perturbed regression models. Besides providing algorithm configurations with good expected performance, the proposed methodology can also provide insights on the relevance of each parameter and their interactions, as well as models of expected algorithm performance for a given problem class, conditional on the parameter values. A test case is presented for the tuning of six parameters of a decomposition-based multiobjective optimization algorithm, in which an instantiation of the proposed framework is compared against the results obtained by the most recent version the Iterated Racing (Irace) procedure. The results suggest that the proposed approach returns solutions that are as good as those of Irace in terms of mean performance, with the advantage of providing more information on the relevance and effect of each parameter on the expected performance of the algorithm.


Selection of tuning parameters in bridge regression models via Bayesian information criterion

We consider the bridge linear regression modeling, which can produce a s...

In a Nutshell: Sequential Parameter Optimization

The performance of optimization algorithms relies crucially on their par...

A Pragmatic Approach for Hyper-Parameter Tuning in Search-based Test Case Generation

Search-based test case generation, which is the application of meta-heur...

Support estimation in high-dimensional heteroscedastic mean regression

A current strand of research in high-dimensional statistics deals with r...

Clustering via Ant Colonies: Parameter Analysis and Improvement of the Algorithm

An ant colony optimization approach for partitioning a set of objects is...

Good and Bad Optimization Models: Insights from Rockafellians

A basic requirement for a mathematical model is often that its solution ...

Please sign up or login with your details

Forgot password? Click here to reset