Analysis of Wide and Deep Echo State Networks for Multiscale Spatiotemporal Time Series Forecasting

07/01/2019
by   Zachariah Carmichael, et al.
0

Echo state networks are computationally lightweight reservoir models inspired by the random projections observed in cortical circuitry. As interest in reservoir computing has grown, networks have become deeper and more intricate. While these networks are increasingly applied to nontrivial forecasting tasks, there is a need for comprehensive performance analysis of deep reservoirs. In this work, we study the influence of partitioning neurons given a budget and the effect of parallel reservoir pathways across different datasets exhibiting multi-scale and nonlinear dynamics.

READ FULL TEXT
research
10/13/2020

Deep Reservoir Networks with Learned Hidden Reservoir Weights using Direct Feedback Alignment

Deep Reservoir Computing has emerged as a new paradigm for deep learning...
research
02/03/2015

Product Reservoir Computing: Time-Series Computation with Multiplicative Neurons

Echo state networks (ESN), a type of reservoir computing (RC) architectu...
research
11/13/2017

Deep-ESN: A Multiple Projection-encoding Hierarchical Reservoir Computing Framework

As an efficient recurrent neural network (RNN) model, reservoir computin...
research
02/17/2021

On the Post-hoc Explainability of Deep Echo State Networks for Time Series Forecasting, Image and Video Classification

Since their inception, learning techniques under the Reservoir Computing...
research
01/06/2022

Introducing Randomized High Order Fuzzy Cognitive Maps as Reservoir Computing Models: A Case Study in Solar Energy and Load Forecasting

Fuzzy Cognitive Maps (FCMs) have emerged as an interpretable signed weig...
research
01/14/2021

Unveiling the role of plasticity rules in reservoir computing

Reservoir Computing (RC) is an appealing approach in Machine Learning th...
research
02/09/2022

Optimal reservoir computers for forecasting systems of nonlinear dynamics

Prediction and analysis of systems of nonlinear dynamics is crucial in m...

Please sign up or login with your details

Forgot password? Click here to reset