Strategies for the vectorized Block Conjugate Gradients method

12/26/2019
by   Nils-Arne Dreier, et al.
0

Block Krylov methods have recently gained a lot of attraction. Due to their increased arithmetic intensity they offer a promising way to improve performance on modern hardware. Recently Frommer et al. presented a block Krylov framework that combines the advantages of block Krylov methods and data parallel methods. We review this framework and apply it on the Block Conjugate Gradients method,to solve linear systems with multiple right hand sides. In this course we consider challenges that occur on modern hardware, like a limited memory bandwidth, the use of SIMD instructions and the communication overhead. We present a performance model to predict the efficiency of different Block CG variants and compare these with experimental numerical results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/06/2021

Hardware-Oriented Krylov Methods for High-Performance Computing

Krylov subspace methods are an essential building block in numerical sim...
research
03/11/2022

Performance Analysis and Optimal Node-Aware Communication for Enlarged Conjugate Gradient Methods

Krylov methods are a key way of solving large sparse linear systems of e...
research
04/08/2023

Arithmetic Intensity Balancing Convolution for Hardware-aware Efficient Block Design

As deep learning advances, edge devices and lightweight neural networks ...
research
04/28/2022

A Hardware-aware and Stable Orthogonalization Framework

The orthogonalization process is an essential building block in Krylov s...
research
01/04/2021

Split block Bloom filters

This short note describes a Bloom filter variant that takes advantage of...
research
07/21/2021

A posteriori superlinear convergence bounds for block conjugate gradient

In this paper, we extend to the block case, the a posteriori bound showi...
research
08/30/2020

Low-Depth Parallel Algorithms for the Binary-Forking Model without Atomics

The binary-forking model is a parallel computation model, formally defin...

Please sign up or login with your details

Forgot password? Click here to reset