Path Neural Networks: Expressive and Accurate Graph Neural Networks

06/09/2023
by   Gaspard Michel, et al.
0

Graph neural networks (GNNs) have recently become the standard approach for learning with graph-structured data. Prior work has shed light into their potential, but also their limitations. Unfortunately, it was shown that standard GNNs are limited in their expressive power. These models are no more powerful than the 1-dimensional Weisfeiler-Leman (1-WL) algorithm in terms of distinguishing non-isomorphic graphs. In this paper, we propose Path Neural Networks (PathNNs), a model that updates node representations by aggregating paths emanating from nodes. We derive three different variants of the PathNN model that aggregate single shortest paths, all shortest paths and all simple paths of length up to K. We prove that two of these variants are strictly more powerful than the 1-WL algorithm, and we experimentally validate our theoretical results. We find that PathNNs can distinguish pairs of non-isomorphic graphs that are indistinguishable by 1-WL, while our most expressive PathNN variant can even distinguish between 3-WL indistinguishable graphs. The different PathNN variants are also evaluated on graph classification and graph regression datasets, where in most cases, they outperform the baseline methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/01/2018

How Powerful are Graph Neural Networks?

Graph Neural Networks (GNNs) for representation learning of graphs broad...
research
07/13/2019

k-hop Graph Neural Networks

Graph neural networks (GNNs) have emerged recently as a powerful archite...
research
08/31/2020

Distance Encoding – Design Provably More Powerful Graph Neural Networks for Structural Representation Learning

Learning structural representations of node sets from graph-structured d...
research
04/21/2023

What Do GNNs Actually Learn? Towards Understanding their Representations

In recent years, graph neural networks (GNNs) have achieved great succes...
research
11/04/2022

Weisfeiler and Leman go Hyperbolic: Learning Distance Preserving Node Representations

In recent years, graph neural networks (GNNs) have emerged as a promisin...
research
11/30/2022

Weisfeiler and Leman Go Relational

Knowledge graphs, modeling multi-relational data, improve numerous appli...
research
06/22/2022

Agent-based Graph Neural Networks

We present a novel graph neural network we call AgentNet, which is desig...

Please sign up or login with your details

Forgot password? Click here to reset