Is Homophily a Necessity for Graph Neural Networks?

06/11/2021
by   Yao Ma, et al.
0

Graph neural networks (GNNs) have shown great prowess in learning representations suitable for numerous graph-based machine learning tasks. When applied to semi-supervised node classification, GNNs are widely believed to work well due to the homophily assumption (“like attracts like”), and fail to generalize to heterophilous graphs where dissimilar nodes connect. Recent works design new architectures to overcome such heterophily-related limitations, citing poor baseline performance and new architecture improvements on a few heterophilous graph benchmark datasets as evidence for this notion. In our experiments, we empirically find that standard graph convolutional networks (GCNs) can actually achieve better performance than such carefully designed methods on some commonly used heterophilous graphs. This motivates us to reconsider whether homophily is truly necessary for good GNN performance. We find that this claim is not quite true, and in fact, GCNs can achieve strong performance on heterophilous graphs under certain conditions. Our work carefully characterizes these conditions, and provides supporting theoretical understanding and empirical observations. Finally, we examine existing heterophilous graphs benchmarks and reconcile how the GCN (under)performs on them based on this understanding.

READ FULL TEXT

page 7

page 9

page 19

research
07/05/2022

What Do Graph Convolutional Neural Networks Learn?

Graph neural networks (GNNs) have gained traction over the past few year...
research
08/06/2022

Triple Sparsification of Graph Convolutional Networks without Sacrificing the Accuracy

Graph Neural Networks (GNNs) are widely used to perform different machin...
research
12/26/2022

2-hop Neighbor Class Similarity (2NCS): A graph structural metric indicative of graph neural network performance

Graph Neural Networks (GNNs) achieve state-of-the-art performance on gra...
research
06/08/2023

On Performance Discrepancies Across Local Homophily Levels in Graph Neural Networks

Research on GNNs has highlighted a relationship between high homophily (...
research
11/01/2022

Revisiting Heterophily in Graph Convolution Networks by Learning Representations Across Topological and Feature Spaces

Graph convolution networks (GCNs) have been enormously successful in lea...
research
05/07/2021

Graph Entropy Guided Node Embedding Dimension Selection for Graph Neural Networks

Graph representation learning has achieved great success in many areas, ...
research
10/07/2022

Empowering Graph Representation Learning with Test-Time Graph Transformation

As powerful tools for representation learning on graphs, graph neural ne...

Please sign up or login with your details

Forgot password? Click here to reset