Optimality in Noisy Importance Sampling

01/07/2022
by   Fernando Llorente, et al.
0

In this work, we analyze the noisy importance sampling (IS), i.e., IS working with noisy evaluations of the target density. We present the general framework and derive optimal proposal densities for noisy IS estimators. The optimal proposals incorporate the information of the variance of the noisy realizations, proposing points in regions where the noise power is higher. We also compare the use of the optimal proposals with previous optimality approaches considered in a noisy IS framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/09/2022

Variance Analysis of Multiple Importance Sampling Schemes

Multiple importance sampling (MIS) is an increasingly used methodology w...
research
03/23/2020

Efficient sampling generation from explicit densities via Normalizing Flows

For many applications, such as computing the expected value of different...
research
02/18/2021

Nonasymptotic bounds for suboptimal importance sampling

Importance sampling is a popular variance reduction method for Monte Car...
research
12/08/2022

Entropy minimizing distributions are worst-case optimal importance proposals

Importance sampling of target probability distributions belonging to a g...
research
10/14/2019

A unified view of likelihood ratio and reparameterization gradients and an optimal importance sampling scheme

Reparameterization (RP) and likelihood ratio (LR) gradient estimators ar...
research
01/23/2023

Optimizing the Noise in Self-Supervised Learning: from Importance Sampling to Noise-Contrastive Estimation

Self-supervised learning is an increasingly popular approach to unsuperv...
research
08/18/2019

Revisiting the balance heuristic for estimating normalising constants

Multiple importance sampling estimators are widely used for computing in...

Please sign up or login with your details

Forgot password? Click here to reset