Latent space projection predictive inference

09/10/2021
by   Alejandro Catalina, et al.
0

Given a reference model that includes all the available variables, projection predictive inference replaces its posterior with a constrained projection including only a subset of all variables. We extend projection predictive inference to enable computationally efficient variable and structure selection in models outside the exponential family. By adopting a latent space projection predictive perspective we are able to: 1) propose a unified and general framework to do variable selection in complex models while fully honouring the original model structure, 2) properly identify relevant structure and retain posterior uncertainties from the original model, and 3) provide an improved approach also for non-Gaussian models in the exponential family. We demonstrate the superior performance of our approach by thoroughly testing and comparing it against popular variable selection approaches in a wide range of settings, including realistic data sets. Our results show that our approach successfully recovers relevant terms and model structure in complex models, selecting less variables than competing approaches for realistic datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/14/2020

Projection Predictive Inference for Generalized Linear and Additive Multilevel Models

Projection predictive inference is a decision theoretic Bayesian approac...
research
01/04/2023

Projection predictive variable selection for discrete response families with finite support

The approximate latent-space approach to the projective part of the proj...
research
04/27/2020

Using reference models in variable selection

Variable selection, or more generally, model reduction is an important a...
research
07/04/2023

Scalable variable selection for two-view learning tasks with projection operators

In this paper we propose a novel variable selection method for two-view ...
research
07/12/2016

Information Projection and Approximate Inference for Structured Sparse Variables

Approximate inference via information projection has been recently intro...
research
01/19/2016

Variable projection without smoothness

The variable projection technique solves structured optimization problem...
research
08/16/2019

Selection of Exponential-Family Random Graph Models via Held-Out Predictive Evaluation (HOPE)

Statistical models for networks with complex dependencies pose particula...

Please sign up or login with your details

Forgot password? Click here to reset