Hierarchical graph neural nets can capture long-range interactions

07/15/2021
by   Ladislav Rampasek, et al.
66

Graph neural networks (GNNs) based on message passing between neighboring nodes are known to be insufficient for capturing long-range interactions in graphs. In this project we study hierarchical message passing models that leverage a multi-resolution representation of a given graph. This facilitates learning of features that span large receptive fields without loss of local information, an aspect not studied in preceding work on hierarchical GNNs. We introduce Hierarchical Graph Net (HGNet), which for any two connected nodes guarantees existence of message-passing paths of at most logarithmic length w.r.t. the input graph size. Yet, under mild assumptions, its internal hierarchy maintains asymptotic size equivalent to that of the input graph. We observe that our HGNet outperforms conventional stacking of GCN layers particularly in molecular property prediction benchmarks. Finally, we propose two benchmarking tasks designed to elucidate capability of GNNs to leverage long-range interactions in graphs.

READ FULL TEXT

page 4

page 5

page 7

research
06/06/2023

CIN++: Enhancing Topological Message Passing

Graph Neural Networks (GNNs) have demonstrated remarkable success in lea...
research
02/14/2023

Understanding Oversquashing in GNNs through the Lens of Effective Resistance

Message passing graph neural networks are popular learning architectures...
research
02/01/2022

Dimensionality Reduction Meets Message Passing for Graph Node Embeddings

Graph Neural Networks (GNNs) have become a popular approach for various ...
research
06/14/2023

NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classification

Graph neural networks have been extensively studied for learning with in...
research
06/07/2022

Utility of Equivariant Message Passing in Cortical Mesh Segmentation

The automated segmentation of cortical areas has been a long-standing ch...
research
10/18/2022

Anti-Symmetric DGN: a stable architecture for Deep Graph Networks

Deep Graph Networks (DGNs) currently dominate the research landscape of ...
research
08/19/2019

Dynamic Graph Message Passing Networks

Modelling long-range dependencies is critical for complex scene understa...

Please sign up or login with your details

Forgot password? Click here to reset