Bayesian Coresets: An Optimization Perspective

07/01/2020
by   Jacky Y. Zhang, et al.
0

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that posterior inference using the selected subset closely approximates posterior inference using the full dataset. This manuscript revisits Bayesian coresets through the lens of sparsity constrained optimization. Leveraging recent advances in accelerated optimization methods, we propose and analyze a novel algorithm for coreset selection. We provide explicit convergence rate guarantees and present an empirical evaluation on a variety of benchmark datasets to highlight our proposed algorithm's superior performance compared to state of the art on speed and accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/23/2020

Gradient-Free Adversarial Attacks for Bayesian Neural Networks

The existence of adversarial examples underscores the importance of unde...
research
08/09/2014

Optimally-Weighted Herding is Bayesian Quadrature

Herding and kernel herding are deterministic methods of choosing samples...
research
10/12/2022

On Divergence Measures for Bayesian Pseudocoresets

A Bayesian pseudocoreset is a small synthetic dataset for which the post...
research
06/07/2019

Sparse Variational Inference: Bayesian Coresets from Scratch

The proliferation of automated inference algorithms in Bayesian statisti...
research
03/17/2023

Robust probabilistic inference via a constrained transport metric

Flexible Bayesian models are typically constructed using limits of large...
research
06/16/2021

Scalable Quasi-Bayesian Inference for Instrumental Variable Regression

Recent years have witnessed an upsurge of interest in employing flexible...
research
03/06/2021

Metropolis-Hastings via Classification

This paper develops a Bayesian computational platform at the interface b...

Please sign up or login with your details

Forgot password? Click here to reset