Multiplicative Perturbation Bounds for Multivariate Multiple Linear Regression in Schatten p-Norms

07/12/2020
by   Jocelyn T. Chi, et al.
0

Multivariate multiple linear regression (MMLR), which occurs in a number of practical applications, generalizes traditional least squares (multivariate linear regression) to multiple right-hand sides. We extend recent MLR analyses to sketched MMLR in general Schatten p-norms by interpreting the sketched problem as a multiplicative perturbation. Our work represents an extension of Maher's results on Schatten p-norms. We derive expressions for the exact and perturbed solutions in terms of projectors for easy geometric interpretation. We also present a geometric interpretation of the action of the sketching matrix in terms of relevant subspaces. We show that a key term in assessing the accuracy of the sketched MMLR solution can be viewed as a tangent of a largest principal angle between subspaces under some assumptions. Our results enable additional interpretation of the difference between an orthogonal and oblique projector with the same range.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/13/2021

Multiple Linear Regression and Correlation: A Geometric Analysis

In this review article we consider linear regression analysis from a geo...
research
03/17/2021

On Some Bounds on the Perturbation of Invariant Subspaces of Normal Matrices with Application to a Graph Connection Problem

We provide upper bounds on the perturbation of invariant subspaces of no...
research
01/29/2023

Revisiting the Conceptualization of Multiple Linear Regression

The problem known as multicolinearity has long been recognized to fundam...
research
03/17/2022

An alternative Interpretation of residual feed intake by phenotypic recursive relationships in dairy cattle

There has been an increasing interest in residual feed intake (RFI) as a...
research
07/17/2023

An extended latent factor framework for ill-posed linear regression

The classical latent factor model for linear regression is extended by a...
research
08/17/2018

Randomized Least Squares Regression: Combining Model- and Algorithm-Induced Uncertainties

We analyze the uncertainties in the minimum norm solution of full-rank r...

Please sign up or login with your details

Forgot password? Click here to reset