Sample-Efficient Optimization in the Latent Space of Deep Generative Models via Weighted Retraining

by   Austin Tripp, et al.

Many important problems in science and engineering, such as drug design, involve optimizing an expensive black-box objective function over a complex, high-dimensional, and structured input space. Although machine learning techniques have shown promise in solving such problems, existing approaches substantially lack sample efficiency. We introduce an improved method for efficient black-box optimization, which performs the optimization in the low-dimensional, continuous latent manifold learned by a deep generative model. In contrast to previous approaches, we actively steer the generative model to maintain a latent manifold that is highly useful for efficiently optimizing the objective. We achieve this by periodically retraining the generative model on the data points queried along the optimization trajectory, as well as weighting those data points according to their objective function value. This weighted retraining can be easily implemented on top of existing methods, and is empirically shown to significantly improve their efficiency and performance on synthetic and real-world optimization problems.


page 2

page 21


Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spaces

We consider the problem of optimizing combinatorial spaces (e.g., sequen...

xGEMs: Generating Examplars to Explain Black-Box Models

This work proposes xGEMs or manifold guided exemplars, a framework to un...

Fast Approximate Geodesics for Deep Generative Models

The length of the geodesic between two data points along the Riemannian ...

Diffusion Generative Inverse Design

Inverse design refers to the problem of optimizing the input of an objec...

Generative Pretraining for Black-Box Optimization

Many problems in science and engineering involve optimizing an expensive...

Improving black-box optimization in VAE latent space using decoder uncertainty

Optimization in the latent space of variational autoencoders is a promis...

Code Repositories

Please sign up or login with your details

Forgot password? Click here to reset