Learnable Filters for Geometric Scattering Modules

08/15/2022
by   Alexander Tong, et al.
26

We propose a new graph neural network (GNN) module, based on relaxations of recently proposed geometric scattering transforms, which consist of a cascade of graph wavelet filters. Our learnable geometric scattering (LEGS) module enables adaptive tuning of the wavelets to encourage band-pass features to emerge in learned representations. The incorporation of our LEGS-module in GNNs enables the learning of longer-range graph relations compared to many popular GNNs, which often rely on encoding graph structure via smoothness or similarity between neighbors. Further, its wavelet priors result in simplified architectures with significantly fewer learned parameters compared to competing GNNs. We demonstrate the predictive performance of LEGS-based networks on graph classification benchmarks, as well as the descriptive quality of their learned features in biochemical graph data exploration tasks. Our results show that LEGS-based networks match or outperforms popular GNNs, as well as the original geometric scattering construction, on many datasets, in particular in biochemical domains, while retaining certain mathematical properties of handcrafted (non-learned) geometric scattering.

READ FULL TEXT

page 6

page 11

research
10/06/2020

Data-Driven Learning of Geometric Scattering Networks

Graph neural networks (GNNs) in general, and graph convolutional network...
research
11/14/2019

Understanding Graph Neural Networks with Asymmetric Geometric Scattering Transforms

The scattering transform is a multilayered wavelet-based deep learning a...
research
10/28/2020

Geometric Scattering Attention Networks

Geometric scattering has recently gained recognition in graph representa...
research
06/03/2022

Can Hybrid Geometric Scattering Networks Help Solve the Maximal Clique Problem?

We propose a geometric scattering-based graph neural network (GNN) for a...
research
06/25/2023

GPatcher: A Simple and Adaptive MLP Model for Alleviating Graph Heterophily

While graph heterophily has been extensively studied in recent years, a ...
research
06/29/2023

Diffusion-Jump GNNs: Homophiliation via Learnable Metric Filters

High-order Graph Neural Networks (HO-GNNs) have been developed to infer ...
research
01/26/2023

Graph Scattering beyond Wavelet Shackles

This work develops a flexible and mathematically sound framework for the...

Please sign up or login with your details

Forgot password? Click here to reset