On the overestimation of widely applicable Bayesian information criterion

08/28/2019
by   Toru Imai, et al.
0

A widely applicable Bayesian information criterion (Watanabe, 2013) is applicable for both regular and singular models in the model selection problem. This criterion tends to overestimate the log marginal likelihood. We identify an overestimating term of a widely applicable Bayesian information criterion. Adjustment of the term gives an asymptotically unbiased estimator of the leading two terms of asymptotic expansion of the log marginal likelihood. In numerical experiments on regular and singular models, the adjustment resulted in smaller bias than the original criterion.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2019

Estimating Real Log Canonical Thresholds

Evaluation of the marginal likelihood plays an important role in model s...
research
08/31/2012

A Widely Applicable Bayesian Information Criterion

A statistical model or a learning machine is called regular if the map t...
research
10/23/2021

Prior Intensified Information Criterion

The widely applicable information criterion (WAIC) has been used as a mo...
research
04/28/2019

Schwartz type model selection for ergodic stochastic differential equation models

We study the construction of the theoretical foundation of model compari...
research
08/11/2020

Evidence bounds in singular models: probabilistic and variational perspectives

The marginal likelihood or evidence in Bayesian statistics contains an i...
research
12/29/2014

Marginal likelihood and model selection for Gaussian latent tree and forest models

Gaussian latent tree models, or more generally, Gaussian latent forest m...
research
04/22/2015

Rebuilding Factorized Information Criterion: Asymptotically Accurate Marginal Likelihood

Factorized information criterion (FIC) is a recently developed approxima...

Please sign up or login with your details

Forgot password? Click here to reset