Incorporating Heterophily into Graph Neural Networks for Graph Classification

03/15/2022
by   Wei Ye, et al.
1

Graph neural networks (GNNs) often assume strong homophily in graphs, seldom considering heterophily which means connected nodes tend to have different class labels and dissimilar features. In real-world scenarios, graphs may have nodes that exhibit both homophily and heterophily. Failing to generalize to this setting makes many GNNs underperform in graph classification. In this paper, we address this limitation by identifying two useful designs and develop a novel GNN architecture called IHGNN (Incorporating Heterophily into Graph Neural Networks). These designs include integration and separation of the ego- and neighbor-embeddings of nodes; and concatenation of all the node embeddings as the final graph-level readout function. In the first design, integration is combined with separation by an injective function which is the composition of the MLP and the concatenation function. The second design enables the graph-level readout function to differentiate between different node embeddings. As the functions used in both the designs are injective, IHGNN, while being simple, has an expressiveness as powerful as the 1-WL. We empirically validate IHGNN on various graph datasets and demonstrate that it achieves state-of-the-art performance on the graph classification task.

READ FULL TEXT

page 1

page 9

research
05/09/2021

Graph Attention Networks with Positional Embeddings

Graph Neural Networks (GNNs) are deep learning methods which provide the...
research
06/20/2020

Generalizing Graph Neural Networks Beyond Homophily

We investigate the representation power of graph neural networks in the ...
research
12/01/2021

ReIGNN: State Register Identification Using Graph Neural Networks for Circuit Reverse Engineering

Reverse engineering an integrated circuit netlist is a powerful tool to ...
research
12/07/2021

A Piece-wise Polynomial Filtering Approach for Graph Neural Networks

Graph Neural Networks (GNNs) exploit signals from node features and the ...
research
07/28/2021

Effective Eigendecomposition based Graph Adaptation for Heterophilic Networks

Graph Neural Networks (GNNs) exhibit excellent performance when graphs h...
research
10/21/2022

Efficient Automatic Machine Learning via Design Graphs

Despite the success of automated machine learning (AutoML), which aims t...
research
01/17/2020

Node Masking: Making Graph Neural Networks Generalize and Scale Better

Graph Neural Networks (GNNs) have received a lot of interest in the rece...

Please sign up or login with your details

Forgot password? Click here to reset