Matroid Regression

03/04/2014
by   Franz J Király, et al.
0

We propose an algebraic combinatorial method for solving large sparse linear systems of equations locally - that is, a method which can compute single evaluations of the signal without computing the whole signal. The method scales only in the sparsity of the system and not in its size, and allows to provide error estimates for any solution method. At the heart of our approach is the so-called regression matroid, a combinatorial object associated to sparsity patterns, which allows to replace inversion of the large matrix with the inversion of a kernel matrix that is constant size. We show that our method provides the best linear unbiased estimator (BLUE) for this setting and the minimum variance unbiased estimator (MVUE) under Gaussian noise assumptions, and furthermore we show that the size of the kernel matrix which is to be inverted can be traded off with accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/21/2020

Sparse sketches with small inversion bias

For a tall n× d matrix A and a random m× n sketching matrix S, the sketc...
research
08/28/2023

Solving Attention Kernel Regression Problem via Pre-conditioner

Large language models have shown impressive performance in many tasks. O...
research
02/02/2023

Role of Bootstrap Averaging in Generalized Approximate Message Passing

Generalized approximate message passing (GAMP) is a computationally effi...
research
09/05/2023

Some Additional Remarks on Statistical Properties of Cohen's d from Linear Regression

The size of the effect of the difference in two groups with respect to a...
research
11/02/2019

Sparse inversion for derivative of log determinant

Algorithms for Gaussian process, marginal likelihood methods or restrict...
research
04/20/2020

Automated data-driven selection of the hyperparameters for Total-Variation based texture segmentation

Penalized Least Squares are widely used in signal and image processing. ...
research
04/22/2020

Efficient modeling of correlated noise II. A flexible noise model with fast and scalable methods

Correlated noise affects most astronomical datasets and to neglect accou...

Please sign up or login with your details

Forgot password? Click here to reset