On PAC-Bayesian reconstruction guarantees for VAEs

Despite its wide use and empirical successes, the theoretical understanding and study of the behaviour and performance of the variational autoencoder (VAE) have only emerged in the past few years. We contribute to this recent line of work by analysing the VAE's reconstruction ability for unseen test data, leveraging arguments from the PAC-Bayes theory. We provide generalisation bounds on the theoretical reconstruction error, and provide insights on the regularisation effect of VAE objectives. We illustrate our theoretical results with supporting experiments on classical benchmark datasets.

READ FULL TEXT
research
05/05/2020

Interpreting Rate-Distortion of Variational Autoencoder and Using Model Uncertainty for Anomaly Detection

Building a scalable machine learning system for unsupervised anomaly det...
research
06/22/2022

Cold Posteriors through PAC-Bayes

We investigate the cold posterior effect through the lens of PAC-Bayes g...
research
02/05/2023

Latent Reconstruction-Aware Variational Autoencoder

Variational Autoencoders (VAEs) have become increasingly popular in rece...
research
07/14/2020

Towards a Theoretical Understanding of the Robustness of Variational Autoencoders

We make inroads into understanding the robustness of Variational Autoenc...
research
10/10/2019

PAC-Bayesian Contrastive Unsupervised Representation Learning

Contrastive unsupervised representation learning (CURL) is the state-of-...
research
12/18/2019

Learning under Model Misspecification: Applications to Variational and Ensemble methods

This paper provides a novel theoretical analysis of the problem of learn...
research
08/01/2018

Open Category Detection with PAC Guarantees

Open category detection is the problem of detecting "alien" test instanc...

Please sign up or login with your details

Forgot password? Click here to reset