Higher-order Clustering and Pooling for Graph Neural Networks

09/02/2022
by   Alexandre Duval, et al.
0

Graph Neural Networks achieve state-of-the-art performance on a plethora of graph classification tasks, especially due to pooling operators, which aggregate learned node embeddings hierarchically into a final graph representation. However, they are not only questioned by recent work showing on par performance with random pooling, but also ignore completely higher-order connectivity patterns. To tackle this issue, we propose HoscPool, a clustering-based graph pooling operator that captures higher-order information hierarchically, leading to richer graph representations. In fact, we learn a probabilistic cluster assignment matrix end-to-end by minimising relaxed formulations of motif spectral clustering in our objective function, and we then extend it to a pooling operator. We evaluate HoscPool on graph classification tasks and its clustering component on graphs with ground-truth community structure, achieving best performance. Lastly, we provide a deep empirical analysis of pooling operators' inner functioning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/07/2023

MPool: Motif-Based Graph Pooling

Graph Neural networks (GNNs) have recently become a powerful technique f...
research
06/30/2020

Graph Clustering with Graph Neural Networks

Graph Neural Networks (GNNs) have achieved state-of-the-art results on m...
research
10/11/2021

Understanding Pooling in Graph Neural Networks

Inspired by the conventional pooling layers in convolutional neural netw...
research
05/10/2023

NervePool: A Simplicial Pooling Layer

For deep learning problems on graph-structured data, pooling layers are ...
research
10/19/2020

Neuralizing Efficient Higher-order Belief Propagation

Graph neural network models have been extensively used to learn node rep...
research
09/25/2019

HaarPooling: Graph Pooling with Compressive Haar Basis

Deep Graph Neural Networks (GNNs) are instrumental in graph classificati...
research
07/03/2021

Maximum Entropy Weighted Independent Set Pooling for Graph Neural Networks

In this paper, we propose a novel pooling layer for graph neural network...

Please sign up or login with your details

Forgot password? Click here to reset