Randomized Block Adaptive Linear System Solvers

04/04/2022
by   Vivak Patel, et al.
0

Randomized linear solvers leverage randomization to structure-blindly compress and solve a linear system to produce an inexpensive solution. While such a property is highly desirable, randomized linear solvers often suffer when it comes to performance as either (1) problem structure is not being exploited, and (2) hardware is inefficiently used. Thus, randomized adaptive solvers are starting to appear that use the benefits of randomness while attempting to still exploit problem structure and reduce hardware inefficiencies. Unfortunately, such randomized adaptive solvers are likely to be without a theoretical foundation to show that they will work (i.e., find a solution). Accordingly, here, we distill three general criteria for randomized block adaptive solvers, which, as we show, will guarantee convergence of the randomized adaptive solver and supply a worst-case rate of convergence. We will demonstrate that these results apply to existing randomized block adaptive solvers, and to several that we devise for demonstrative purposes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/10/2021

Convergence of Adaptive, Randomized, Iterative Linear Solvers

Deterministic and randomized, row-action and column-action linear solver...
research
05/28/2023

Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketching

We consider solving equality-constrained nonlinear, nonconvex optimizati...
research
10/02/2022

Error estimates of Kaczmarz and randomized Kaczmarz methods

The Kaczmarz method is an iterative projection scheme for solving con-si...
research
10/10/2021

Selectable Set Randomized Kaczmarz

The Randomized Kaczmarz method (RK) is a stochastic iterative method for...
research
11/30/2022

Randomized block subsampling Kaczmarz-Motzkin method

By introducing a subsampling strategy, we propose a randomized block Kac...
research
11/05/2018

On a generalization of iterated and randomized rounding

We give a general method for rounding linear programs that combines the ...
research
09/04/2020

Hybrid DCOP Solvers: Boosting Performance of Local Search Algorithms

We propose a novel method for expediting both symmetric and asymmetric D...

Please sign up or login with your details

Forgot password? Click here to reset