LONGNN: Spectral GNNs with Learnable Orthonormal Basis

by   Qian Tao, et al.
Alibaba Group

In recent years, a plethora of spectral graph neural networks (GNN) methods have utilized polynomial basis with learnable coefficients to achieve top-tier performances on many node-level tasks. Although various kinds of polynomial bases have been explored, each such method adopts a fixed polynomial basis which might not be the optimal choice for the given graph. Besides, we identify the so-called over-passing issue of these methods and show that it is somewhat rooted in their less-principled regularization strategy and unnormalized basis. In this paper, we make the first attempts to address these two issues. Leveraging Jacobi polynomials, we design a novel spectral GNN, LON-GNN, with Learnable OrthoNormal bases and prove that regularizing coefficients becomes equivalent to regularizing the norm of learned filter function now. We conduct extensive experiments on diverse graph datasets to evaluate the fitting and generalization capability of LON-GNN, where the results imply its superiority.


page 1

page 2

page 3

page 4


Graph Neural Networks with Learnable and Optimal Polynomial Bases

Polynomial filters, a kind of Graph Neural Networks, typically use a pre...

Specformer: Spectral Graph Neural Networks Meet Transformers

Spectral graph neural networks (GNNs) learn graph representations via sp...

Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited

Designing spectral convolutional networks is a challenging problem in gr...

GPatcher: A Simple and Adaptive MLP Model for Alleviating Graph Heterophily

While graph heterophily has been extensively studied in recent years, a ...

Clenshaw Graph Neural Networks

Graph Convolutional Networks (GCNs), which use a message-passing paradig...

A Class-Aware Representation Refinement Framework for Graph Classification

Graph Neural Networks (GNNs) are widely used for graph representation le...

GIF: A General Graph Unlearning Strategy via Influence Function

With the greater emphasis on privacy and security in our society, the pr...

Please sign up or login with your details

Forgot password? Click here to reset