Mean-Square Analysis of Discretized Itô Diffusions for Heavy-tailed Sampling

03/01/2023
by   Ye He, et al.
0

We analyze the complexity of sampling from a class of heavy-tailed distributions by discretizing a natural class of Itô diffusions associated with weighted Poincaré inequalities. Based on a mean-square analysis, we establish the iteration complexity for obtaining a sample whose distribution is ϵ close to the target distribution in the Wasserstein-2 metric. In this paper, our results take the mean-square analysis to its limits, i.e., we invariably only require that the target density has finite variance, the minimal requirement for a mean-square analysis. To obtain explicit estimates, we compute upper bounds on certain moments associated with heavy-tailed targets under various assumptions. We also provide similar iteration complexity results for the case where only function evaluations of the unnormalized target density are available by estimating the gradients using a Gaussian smoothing technique. We provide illustrative examples based on the multivariate t-distribution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/20/2022

Heavy-tailed Sampling via Transformed Unadjusted Langevin Algorithm

We analyze the oracle complexity of sampling from polynomially decaying ...
research
08/08/2021

Mean-square Analysis of the NLMS Algorithm

This work presents a novel approach to the mean-square analysis of the n...
research
07/10/2019

Tails of Triangular Flows

Triangular maps are a construct in probability theory that allows the tr...
research
04/04/2018

Use of the geometric mean as a statistic for the scale of the coupled Gaussian distributions

The geometric mean is shown to be an appropriate statistic for the scale...
research
04/16/2018

Structured Recovery with Heavy-tailed Measurements: A Thresholding Procedure and Optimal Rates

This paper introduces a general regularized thresholded least-square pro...
research
07/18/2022

Non-Gaussian Bayesian Filtering by Density Parametrization Using Power Moments

Non-Gaussian Bayesian filtering is a core problem in stochastic filterin...
research
12/22/2022

Nonlinear consensus+innovations under correlated heavy-tailed noises: Mean square convergence rate and asymptotics

We consider distributed recursive estimation of consensus+innovations ty...

Please sign up or login with your details

Forgot password? Click here to reset