Estimation with informative missing data in the low-rank model with random effects

06/06/2019
by   Aude Sportisse, et al.
0

Matrix completion based on low-rank models is very popular and comes with powerful algorithms and theoretical guarantees. However, existing methods do not consider the case of values missing not at random (MNAR) which are widely encountered in practice. Considering a data matrix generated from a probabilistic principal component analysis (PPCA) model containing several MNAR variables, we propose estimators for the means, variances and covariances related to the MNAR missing variables and study their consistency. The proposed estimators present the advantage of being computed without explicitly modeling the MNAR mechanism and by only using observed data. In addition, we propose an imputation method of the data matrix and an estimation of the PPCA loading matrix. We compare our proposal with the classical methods used in low-rank models, as iterative methods based on singular value decomposition.

READ FULL TEXT
research
06/06/2019

Estimation and imputation in Probabilistic Principal Component Analysis with Missing Not At Random data

Missing Not At Random values are considered to be non-ignorable and requ...
research
12/29/2018

Imputation and low-rank estimation with Missing Non At Random data

Missing values challenge data analysis because many supervised and unsu-...
research
11/26/2018

Sparse spectral estimation with missing and corrupted measurements

Supervised learning methods with missing data have been extensively stud...
research
09/06/2017

The low-rank hurdle model

A composite loss framework is proposed for low-rank modeling of data con...
research
06/02/2019

Graphon Estimation from Partially Observed Network Data

We consider estimating the edge-probability matrix of a network generate...
research
07/06/2021

Inference for Low-Rank Models

This paper studies inference in linear models whose parameter of interes...
research
10/04/2019

The Sparse Reverse of Principal Component Analysis for Fast Low-Rank Matrix Completion

Matrix completion constantly receives tremendous attention from many res...

Please sign up or login with your details

Forgot password? Click here to reset