Frequentist performances of Bayesian prediction intervals for random-effects meta-analysis

06/30/2019
by   Yuta Hamaguchi, et al.
0

The prediction interval has been increasingly used in meta-analyses as a useful measure for assessing the magnitude of treatment effect and between-studies heterogeneity. In calculations of the prediction interval, although the Higgins-Thompson-Spiegelhalter method is used most often in practice, it might not have adequate coverage probability for the true treatment effect of a future study under realistic situations. An effective alternative candidate is the Bayesian prediction interval, which has also been widely used in general prediction problems. However, these prediction intervals are constructed based on the Bayesian philosophy, and their frequentist validities are only justified by large-sample approximations even if non-informative priors are adopted. There has been no certain evidence that evaluated their frequentist performances under realistic situations of meta-analyses. In this study, we conducted extensive simulation studies to assess the frequentist coverage performances of Bayesian prediction intervals with 11 non-informative prior distributions under general meta-analysis settings. Through these simulation studies, we found that frequentist coverage performances strongly depended on what prior distributions were adopted. In addition, when the number of studies was smaller than 10, there were no prior distributions that retained accurate frequentist coverage properties. We also illustrated these methods via applications to eight real meta-analysis datasets. The resultant prediction intervals also differed according to the adopted prior distributions. Inaccurate prediction intervals may provide invalid evidence and misleading conclusions. Thus, if frequentist accuracy is required, Bayesian prediction intervals should be used cautiously in practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/03/2018

Prediction intervals for random-effects meta-analysis: a confidence distribution approach

For the inference of random-effects models in meta-analysis, the predict...
research
06/02/2020

Conformal prediction intervals for the individual treatment effect

We propose several prediction intervals procedures for the individual tr...
research
11/05/2020

Methods to Compute Prediction Intervals: A Review and New Results

This paper reviews two main types of prediction interval methods under a...
research
10/03/2021

Bayesian Model-Averaged Meta-Analysis in Medicine

We outline a Bayesian model-averaged meta-analysis for standardized mean...
research
07/16/2020

On weakly informative prior distributions for the heterogeneity parameter in Bayesian random-effects meta-analysis

The normal-normal hierarchical model (NNHM) constitutes a simple and wid...
research
11/06/2018

A Variational Inference Algorithm for BKMR in the Cross-Sectional Setting

The identification of pollutant effects is an important task in environm...
research
06/20/2023

Empirical prior distributions for Bayesian meta-analyses of binary and time to event outcomes

Bayesian model-averaged meta-analysis allows quantification of evidence ...

Please sign up or login with your details

Forgot password? Click here to reset