Industrial Forecasting with Exponentially Smoothed Recurrent Neural Networks

by   Matthew F. Dixon, et al.

Industrial forecasting has entered an era of unprecedented growth in the size and complexity of data which require new modeling methodologies. While many new general purpose machine learning approaches have emerged, they remain poorly understand and irreconcilable with more traditional statistical modeling approaches. We present a general class of exponential smoothed recurrent neural networks (RNNs) which are well suited to modeling non-stationary dynamical systems arising in industrial applications such as electricity load management and financial risk and trading. In particular, we analyze their capacity to characterize the non-linear partial autocorrelation structure of time series and directly capture dynamic effects such as seasonality and regime changes. Application of exponentially smoothed RNNs to electricity load forecasting, weather data and financial time series, such as minute level Bitcoin prices and CME futures tick data, highlight the efficacy of exponential smoothing for multi-step time series forecasting. The results also suggest that popular, but more complicated neural network architectures originally designed for speech processing, such as LSTMs and GRUs, are likely over-engineered for industrial forecasting and light-weight exponentially smoothed architectures capture the salient features while being superior and more robust than simple RNNs.


page 18

page 20


On Error Correction Neural Networks for Economic Forecasting

Recurrent neural networks (RNNs) are more suitable for learning non-line...

N-BEATS neural network for mid-term electricity load forecasting

We address the mid-term electricity load forecasting (MTLF) problem. Thi...

Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directions

Recurrent Neural Networks (RNN) have become competitive forecasting meth...

Rail Crack Propagation Forecasting Using Multi-horizons RNNs

The prediction of rail crack length propagation plays a crucial role in ...

An Intelligent End-to-End Neural Architecture Search Framework for Electricity Forecasting Model Development

Recent years have witnessed an exponential growth in developing deep lea...

Relaxed Weight Sharing: Effectively Modeling Time-Varying Relationships in Clinical Time-Series

Recurrent neural networks (RNNs) are commonly applied to clinical time-s...

Please sign up or login with your details

Forgot password? Click here to reset