Spectral Deconfounding and Perturbed Sparse Linear Models

11/13/2018
by   Domagoj Ćevid, et al.
0

Standard high-dimensional regression methods assume that the underlying coefficient vector is sparse. This might not be true in some cases, in particular in presence of hidden, confounding variables. Such hidden confounding can be represented as a high-dimensional linear model where the sparse coefficient vector is perturbed. We develop and investigate a class of methods for such model. We propose some spectral transformations, which change the singular values of the design matrix, as a preprocessing step for the data which serves as input for the Lasso. We show that, under some assumptions, one can achieve the optimal ℓ_1-error rate for estimating the underlying sparse coefficient vector. We also illustrate the performance on simulated data and a real-world genomic dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2020

Doubly Debiased Lasso: High-Dimensional Inference under Hidden Confounding and Measurement Errors

Inferring causal relationships or related associations from observationa...
research
03/19/2018

Confounder Detection in High Dimensional Linear Models using First Moments of Spectral Measures

In this paper, we study the confounder detection problem in the linear m...
research
12/06/2017

Estimating the error variance in a high-dimensional linear model

The lasso has been studied extensively as a tool for estimating the coef...
research
09/07/2022

High-dimensional Inference for Generalized Linear Models with Hidden Confounding

Statistical inferences for high-dimensional regression models have been ...
research
03/14/2015

Communication-efficient sparse regression: a one-shot approach

We devise a one-shot approach to distributed sparse regression in the hi...
research
04/05/2017

Detecting confounding in multivariate linear models via spectral analysis

We study a model where one target variable Y is correlated with a vector...
research
03/21/2019

Convergence of Parameter Estimates for Regularized Mixed Linear Regression Models

We consider Mixed Linear Regression (MLR), where training data have bee...

Please sign up or login with your details

Forgot password? Click here to reset