A Targeted Accuracy Diagnostic for Variational Approximations

by   Yu Wang, et al.

Variational Inference (VI) is an attractive alternative to Markov Chain Monte Carlo (MCMC) due to its computational efficiency in the case of large datasets and/or complex models with high-dimensional parameters. However, evaluating the accuracy of variational approximations remains a challenge. Existing methods characterize the quality of the whole variational distribution, which is almost always poor in realistic applications, even if specific posterior functionals such as the component-wise means or variances are accurate. Hence, these diagnostics are of practical value only in limited circumstances. To address this issue, we propose the TArgeted Diagnostic for Distribution Approximation Accuracy (TADDAA), which uses many short parallel MCMC chains to obtain lower bounds on the error of each posterior functional of interest. We also develop a reliability check for TADDAA to determine when the lower bounds should not be trusted. Numerical experiments validate the practical utility and computational efficiency of our approach on a range of synthetic distributions and real-data examples, including sparse logistic regression and Bayesian neural network models.


page 1

page 2

page 3

page 4


Scaling Bayesian inference of mixed multinomial logit models to very large datasets

Variational inference methods have been shown to lead to significant imp...

Practical Posterior Error Bounds from Variational Objectives

Variational inference has become an increasingly attractive, computation...

Nearly Optimal Variational Inference for High Dimensional Regression with Shrinkage Priors

We propose a variational Bayesian (VB) procedure for high-dimensional li...

The Variational Bayesian Inference for Network Autoregression Models

We develop a variational Bayesian (VB) approach for estimating large-sca...

Variational Inference with Locally Enhanced Bounds for Hierarchical Models

Hierarchical models represent a challenging setting for inference algori...

Evaluating uncertainties in electrochemical impedance spectra of solid oxide fuel cells

Electrochemical impedance spectroscopy (EIS) is a widely used tool for c...

Please sign up or login with your details

Forgot password? Click here to reset