Bayesian matrix completion with a spectral scaled Student prior: theoretical guarantee and efficient sampling

04/16/2021
by   The Tien Mai, et al.
0

We study the problem of matrix completion in this paper. A spectral scaled Student prior is exploited to favour the underlying low-rank structure of the data matrix. Importantly, we provide a thorough theoretical investigation for our approach, while such an analysis is hard to obtain and limited in theoretical understanding of Bayesian matrix completion. More precisely, we show that our Bayesian approach enjoys a minimax-optimal oracle inequality which guarantees that our method works well under model misspecification and under general sampling distribution. Interestingly, we also provide efficient gradient-based sampling implementations for our approach by using Langevin Monte Carlo which is novel in Bayesian matrix completion. More specifically, we show that our algorithms are significantly faster than Gibbs sampler in this problem. To illustrate the attractive features of our inference strategy, some numerical simulations are conducted and an application to image inpainting is demonstrated.

READ FULL TEXT
research
02/15/2021

Efficient Bayesian reduced rank regression using Langevin Monte Carlo approach

The problem of Bayesian reduced rank regression is considered in this pa...
research
10/27/2022

From bilinear regression to inductive matrix completion: a quasi-Bayesian analysis

In this paper we study the problem of bilinear regression and we further...
research
06/04/2023

Matrix Completion from General Deterministic Sampling Patterns

Most of the existing works on provable guarantees for low-rank matrix co...
research
08/21/2023

Matrix Completion over Finite Fields: Bounds and Belief Propagation Algorithms

We consider the low rank matrix completion problem over finite fields. T...
research
08/20/2022

Matrix Completion with Cross-Concentrated Sampling: Bridging Uniform Sampling and CUR Sampling

While uniform sampling has been widely studied in the matrix completion ...
research
12/29/2021

On Local Convergence of Iterative Hard Thresholding for Matrix Completion

Iterative hard thresholding (IHT) has gained in popularity over the past...
research
05/31/2023

Bridging Spectral Embedding and Matrix Completion in Self-Supervised Learning

Self-supervised methods received tremendous attention thanks to their se...

Please sign up or login with your details

Forgot password? Click here to reset