When Ignorance is Bliss

07/27/2014
by   Peter D. Grünwald, et al.
0

It is commonly-accepted wisdom that more information is better, and that information should never be ignored. Here we argue, using both a Bayesian and a non-Bayesian analysis, that in some situations you are better off ignoring information if your uncertainty is represented by a set of probability measures. These include situations in which the information is relevant for the prediction task at hand. In the non-Bayesian analysis, we show how ignoring information avoids dilation, the phenomenon that additional pieces of information sometimes lead to an increase in uncertainty. In the Bayesian analysis, we show that for small sample sizes and certain prediction tasks, the Bayesian posterior based on a noninformative prior yields worse predictions than simply ignoring the given information.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/03/2019

Bayesian Pharmacokinetic Modeling of Dynamic Contrast-Enhanced Magnetic Resonance Imaging: Validation and Application

Tracer-kinetic analysis of dynamic contrast-enhanced magnetic resonance ...
research
07/31/2020

Cold Posteriors and Aleatoric Uncertainty

Recent work has observed that one can outperform exact inference in Baye...
research
11/27/2018

Bayesian Neural Network Ensembles

Ensembles of neural networks (NNs) have long been used to estimate predi...
research
09/11/2007

On Universal Prediction and Bayesian Confirmation

The Bayesian framework is a well-studied and successful framework for in...
research
12/05/2016

Known Unknowns: Uncertainty Quality in Bayesian Neural Networks

We evaluate the uncertainty quality in neural networks using anomaly det...
research
09/19/2018

Focused econometric estimation for noisy and small datasets: A Bayesian Minimum Expected Loss estimator approach

Central to many inferential situations is the estimation of rational fun...
research
07/04/2020

Cluster Prediction for Opinion Dynamics from Partial Observations

We present a Bayesian approach to predict the clustering of opinions for...

Please sign up or login with your details

Forgot password? Click here to reset