Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods

10/27/2021
by   Derek Lim, et al.
14

Many widely used datasets for graph machine learning tasks have generally been homophilous, where nodes with similar labels connect to each other. Recently, new Graph Neural Networks (GNNs) have been developed that move beyond the homophily regime; however, their evaluation has often been conducted on small graphs with limited application domains. We collect and introduce diverse non-homophilous datasets from a variety of application areas that have up to 384x more nodes and 1398x more edges than prior datasets. We further show that existing scalable graph learning and graph minibatching techniques lead to performance degradation on these non-homophilous datasets, thus highlighting the need for further work on scalable non-homophilous methods. To address these concerns, we introduce LINKX – a strong simple method that admits straightforward minibatch training and inference. Extensive experimental results with representative simple methods and GNNs across our proposed datasets show that LINKX achieves state-of-the-art performance for learning on non-homophilous graphs. Our codes and data are available at https://github.com/CUAI/Non-Homophily-Large-Scale.

READ FULL TEXT

page 18

page 19

research
02/22/2023

A critical look at the evaluation of GNNs under heterophily: are we really making progress?

Node classification is a classical graph representation learning task on...
research
04/03/2021

New Benchmarks for Learning on Non-Homophilous Graphs

Much data with graph structures satisfy the principle of homophily, mean...
research
05/18/2023

Less Can Be More: Unsupervised Graph Pruning for Large-scale Dynamic Graphs

The prevalence of large-scale graphs poses great challenges in time and ...
research
07/25/2022

GNN Transformation Framework for Improving Efficiency and Scalability

We propose a framework that automatically transforms non-scalable GNNs i...
research
04/23/2020

SIGN: Scalable Inception Graph Neural Networks

Geometric deep learning, a novel class of machine learning algorithms ex...
research
05/01/2023

Strengthening structural baselines for graph classification using Local Topological Profile

We present the analysis of the topological graph descriptor Local Degree...
research
10/14/2022

A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinking

Large-scale graph training is a notoriously challenging problem for grap...

Please sign up or login with your details

Forgot password? Click here to reset