Ring Reservoir Neural Networks for Graphs

05/11/2020
by   Claudio Gallicchio, et al.
8

Machine Learning for graphs is nowadays a research topic of consolidated relevance. Common approaches in the field typically resort to complex deep neural network architectures and demanding training algorithms, highlighting the need for more efficient solutions. The class of Reservoir Computing (RC) models can play an important role in this context, enabling to develop fruitful graph embeddings through untrained recursive architectures. In this paper, we study progressive simplifications to the design strategy of RC neural networks for graphs. Our core proposal is based on shaping the organization of the hidden neurons to follow a ring topology. Experimental results on graph classification tasks indicate that ring-reservoirs architectures enable particularly effective network configurations, showing consistent advantages in terms of predictive performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/24/2019

Reservoir Topology in Deep Echo State Networks

Deep Echo State Networks (DeepESNs) recently extended the applicability ...
research
10/13/2020

Deep Reservoir Networks with Learned Hidden Reservoir Weights using Direct Feedback Alignment

Deep Reservoir Computing has emerged as a new paradigm for deep learning...
research
07/13/2020

Graph Structure of Neural Networks

Neural networks are often represented as graphs of connections between n...
research
07/23/2019

Reservoir-size dependent learning in analogue neural networks

The implementation of artificial neural networks in hardware substrates ...
research
03/12/2019

Richness of Deep Echo State Network Dynamics

Reservoir Computing (RC) is a popular methodology for the efficient desi...
research
12/23/2021

Equivariance and generalization in neural networks

The crucial role played by the underlying symmetries of high energy phys...
research
06/22/2020

Neural networks adapting to datasets: learning network size and topology

We introduce a flexible setup allowing for a neural network to learn bot...

Please sign up or login with your details

Forgot password? Click here to reset