High-Quality Hierarchical Process Mapping

01/20/2020
by   Marcelo Fonseca Faraj, et al.
0

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation when processing graphs on a parallel computer. When a topology of a distributed system is known an important task is then to map the blocks of the partition onto the processors such that the overall communication cost is reduced. We present novel multilevel algorithms that integrate graph partitioning and process mapping. Important ingredients of our algorithm include fast label propagation, more localized local search, initial partitioning, as well as a compressed data structure to compute processor distances without storing a distance matrix. Experiments indicate that our algorithms speed up the overall mapping process and, due to the integrated multilevel approach, also find much better solutions in practice. For example, one configuration of our algorithm yields better solutions than the previous state-of-the-art in terms of mapping quality while being a factor 62 faster. Compared to the currently fastest iterated multilevel mapping algorithm Scotch, we obtain 16 slightly more running time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2021

Deep Multilevel Graph Partitioning

Partitioning a graph into blocks of "roughly equal" weight while cutting...
research
07/06/2021

An MPI-based Algorithm for Mapping Complex Networks onto Hierarchical Architectures

Processing massive application graphs on distributed memory systems requ...
research
05/19/2020

Efficient Process-to-Node Mapping Algorithms for Stencil Computations

Good process-to-compute-node mappings can be decisive for well performin...
research
02/01/2022

Recursive Multi-Section on the Fly: Shared-Memory Streaming Algorithms for Hierarchical Graph Partitioning and Process Mapping

Partitioning a graph into balanced blocks such that few edges run betwee...
research
02/18/2021

Buffered Streaming Graph Partitioning

Partitioning graphs into blocks of roughly equal size is a widely used t...
research
08/29/2023

Streaming, Local, and Multi-Level (Hyper)Graph Decomposition

(Hyper)Graph decomposition is a family of problems that aim to break dow...
research
04/05/2021

Reformulating DOVER-Lap Label Mapping as a Graph Partitioning Problem

We recently proposed DOVER-Lap, a method for combining overlap-aware spe...

Please sign up or login with your details

Forgot password? Click here to reset