Bayesian Estimation of Gaussian Graphical Models with Projection Predictive Selection

01/17/2018
by   Donald R. Williams, et al.
0

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to observations (n) approaches one, the maximum likelihood estimator of the covariance matrix becomes unstable and requires shrinkage estimation. Whereas several classical (frequentist) methods have been introduced to address this issue, Bayesian methods remain relatively uncommon in practice and methodological literatures. Here we introduce a Bayesian method for estimating sparse matrices, in which conditional relationships are determined with projection predictive selection. Through simulation and an applied example, we demonstrate that the proposed method often outperforms both classical and alternative Bayesian estimators with respect to frequentist risk and consistently made the fewest false positives.We end by discussing limitations and future directions, as well as contributions to the Bayesian literature on the topic of sparsity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2019

A permutation-based Bayesian approach for inverse covariance estimation

Covariance estimation and selection for multivariate datasets in a high-...
research
12/03/2012

Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses

We investigate the relationship between the structure of a discrete grap...
research
10/30/2010

Sparse Inverse Covariance Selection via Alternating Linearization Methods

Gaussian graphical models are of great interest in statistical learning....
research
05/18/2018

Distributionally Robust Inverse Covariance Estimation: The Wasserstein Shrinkage Estimator

We introduce a distributionally robust maximum likelihood estimation mod...
research
08/04/2023

Fast Bayesian High-Dimensional Gaussian Graphical Model Estimation

Graphical models describe associations between variables through the not...
research
05/11/2021

Gaussian graphical models with graph constraints for magnetic moment interaction in high entropy alloys

This article is motivated by studying the interaction of magnetic moment...
research
07/05/2023

Bayesian Structure Learning in Undirected Gaussian Graphical Models: Literature Review with Empirical Comparison

Gaussian graphical models are graphs that represent the conditional rela...

Please sign up or login with your details

Forgot password? Click here to reset