PCA in Data-Dependent Noise (Correlated-PCA): Nearly Optimal Finite Sample Guarantees

02/10/2017
by   Namrata Vaswani, et al.
0

We study Principal Component Analysis (PCA) in a setting where a part of the corrupting noise is data-dependent and, as a result, the noise and the true data are correlated. Under a bounded-ness assumption on the true data and the noise, and a simple assumption on data-noise correlation, we obtain a nearly optimal sample complexity bound for the most commonly used PCA solution, singular value decomposition (SVD). This bound is a significant improvement over the bound obtained by Vaswani and Guo in recent work (NIPS 2016) where this "correlated-PCA" problem was first studied; and it holds under a significantly weaker data-noise correlation assumption than the one used for this earlier result.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/19/2017

Finite Sample Guarantees for PCA in Non-Isotropic and Data-Dependent Noise

This work obtains novel finite sample guarantees for Principal Component...
research
10/28/2016

Correlated-PCA: Principal Components' Analysis when Data and Noise are Correlated

Given a matrix of observed data, Principal Components Analysis (PCA) com...
research
10/19/2018

Heteroskedastic PCA: Algorithm, Optimality, and Applications

Principal component analysis (PCA) and singular value decomposition (SVD...
research
04/13/2018

Regularized Singular Value Decomposition and Application to Recommender System

Singular value decomposition (SVD) is the mathematical basis of principa...
research
01/10/2021

HePPCAT: Probabilistic PCA for Data with Heteroscedastic Noise

Principal component analysis (PCA) is a classical and ubiquitous method ...
research
07/15/2023

Identification of Stochasticity by Matrix-decomposition: Applied on Black Hole Data

Timeseries classification as stochastic (noise-like) or non-stochastic (...
research
03/25/2020

Derivation of Coupled PCA and SVD Learning Rules from a Newton Zero-Finding Framework

In coupled learning rules for PCA (principal component analysis) and SVD...

Please sign up or login with your details

Forgot password? Click here to reset