Haar Transforms for Graph Neural Networks

07/10/2019
by   Ming Li, et al.
0

Graph Neural Networks (GNNs) have become a topic of intense research recently due to their powerful capability in high-dimensional classification and regression tasks for graph-structured data. However, as GNNs typically define the graph convolution by the orthonormal basis for the graph Laplacian, they suffer from high computational cost when the graph size is large. This paper introduces the Haar basis, a sparse and localized orthonormal system for graph, constructed from a coarse-grained chain on the graph. The graph convolution under Haar basis --- the Haar convolution can be defined accordingly for GNNs. The sparsity and locality of the Haar basis allow Fast Haar Transforms (FHTs) on graph, by which a fast evaluation of Haar convolution between the graph signals and the filters can be achieved. We conduct preliminary experiments on GNNs equipped with Haar convolution, which can obtain state-of-the-art results for a variety of geometric deep learning tasks.

READ FULL TEXT
research
09/25/2019

HaarPooling: Graph Pooling with Compressive Haar Basis

Deep Graph Neural Networks (GNNs) are instrumental in graph classificati...
research
12/12/2020

Decimated Framelet System on Graphs and Fast G-Framelet Transforms

Graph representation learning has many real-world applications, from sup...
research
09/30/2022

GPNet: Simplifying Graph Neural Networks via Multi-channel Geometric Polynomials

Graph Neural Networks (GNNs) are a promising deep learning approach for ...
research
09/12/2019

GRESNET: Graph Residuals for Reviving Deep Graph Neural Nets from Suspended Animation

In this paper, we will investigate the causes of the GNNs' "suspended an...
research
12/08/2021

Adaptive Kernel Graph Neural Network

Graph neural networks (GNNs) have demonstrated great success in represen...
research
01/22/2021

A Novel Genetic Algorithm with Hierarchical Evaluation Strategy for Hyperparameter Optimisation of Graph Neural Networks

Graph representation of structured data can facilitate the extraction of...
research
08/21/2023

Approximately Equivariant Graph Networks

Graph neural networks (GNNs) are commonly described as being permutation...

Please sign up or login with your details

Forgot password? Click here to reset