DoE2Vec: Deep-learning Based Features for Exploratory Landscape Analysis

by   Bas van Stein, et al.
Hochschule München
universiteit leiden

We propose DoE2Vec, a variational autoencoder (VAE)-based methodology to learn optimization landscape characteristics for downstream meta-learning tasks, e.g., automated selection of optimization algorithms. Principally, using large training data sets generated with a random function generator, DoE2Vec self-learns an informative latent representation for any design of experiments (DoE). Unlike the classical exploratory landscape analysis (ELA) method, our approach does not require any feature engineering and is easily applicable for high dimensional search spaces. For validation, we inspect the quality of latent reconstructions and analyze the latent representations using different experiments. The latent representations not only show promising potentials in identifying similar (cheap-to-evaluate) surrogate functions, but also can significantly boost performances when being used complementary to the classical ELA features in classification tasks.


page 3

page 6

page 7


Learning Latent Representations of Bank Customers With The Variational Autoencoder

Learning data representations that reflect the customers' creditworthine...

Computational and Exploratory Landscape Analysis of the GKLS Generator

The GKLS generator is one of the most used testbeds for benchmarking glo...

Exploratory Landscape Analysis is Strongly Sensitive to the Sampling Strategy

Exploratory landscape analysis (ELA) supports supervised learning approa...

Towards Automated Design of Bayesian Optimization via Exploratory Landscape Analysis

Bayesian optimization (BO) algorithms form a class of surrogate-based he...

Toward an ImageNet Library of Functions for Global Optimization Benchmarking

Knowledge of search-landscape features of BlackBox Optimization (BBO) pr...

In a Nutshell: Sequential Parameter Optimization

The performance of optimization algorithms relies crucially on their par...

Please sign up or login with your details

Forgot password? Click here to reset