Regularized randomized iterative algorithms for factorized linear systems

by   Kui Du, et al.

Randomized iterative algorithms for solving a factorized linear system, 𝐀𝐁𝐱=𝐛 with π€βˆˆβ„^mΓ—β„“, πβˆˆβ„^β„“Γ— n, and π›βˆˆβ„^m, have recently been proposed. They take advantage of the factorized form and avoid forming the matrix 𝐂=𝐀𝐁 explicitly. However, they can only find the minimum norm (least squares) solution. In contrast, the regularized randomized Kaczmarz (RRK) algorithm can find solutions with certain structures from consistent linear systems. In this work, by combining the randomized Kaczmarz algorithm or the randomized Gauss–Seidel algorithm with the RRK algorithm, we propose two novel regularized randomized iterative algorithms to find (least squares) solutions with certain structures of 𝐀𝐁𝐱=𝐛. We prove linear convergence of the new algorithms. Computed examples are given to illustrate that the new algorithms can find sparse (least squares) solutions of 𝐀𝐁𝐱=𝐛 and can be better than the existing randomized iterative algorithms for the corresponding full linear system 𝐂𝐱=𝐛 with 𝐂=𝐀𝐁.


page 1

page 2

page 3

page 4

βˆ™ 12/16/2021

Randomized regularized extended Kaczmarz algorithms for tensor recovery

Randomized regularized Kaczmarz algorithms have recently been proposed t...
βˆ™ 01/21/2022

Extended Randomized Kaczmarz Method for Sparse Least Squares and Impulsive Noise Problems

The Extended Randomized Kaczmarz method is a well known iterative scheme...
βˆ™ 08/25/2021

On the approximation of a matrix

Let F^* be an approximation of a given (a Γ— b) matrix F derived by metho...
βˆ™ 08/09/2022

Towards Practical Large-scale Randomized Iterative Least Squares Solvers through Uncertainty Quantification

As the scale of problems and data used for experimental design, signal p...
βˆ™ 10/16/2015

Robust Partially-Compressed Least-Squares

Randomized matrix compression techniques, such as the Johnson-Lindenstra...
βˆ™ 11/25/2009

On β„“_1-regularized estimation for nonlinear models that have sparse underlying linear structures

In a recent work (arXiv:0910.2517), for nonlinear models with sparse und...
βˆ™ 11/13/2014

A Randomized Algorithm for CCA

We present RandomizedCCA, a randomized algorithm for computing canonical...

Please sign up or login with your details

Forgot password? Click here to reset