Expressing Multivariate Time Series as Graphs with Time Series Attention Transformer

08/19/2022
by   William T. Ng, et al.
0

A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are inter-dependencies among variables as well. Models have to be designed to capture both intra- and inter-relationships among the time series. To move towards this goal, we propose the Time Series Attention Transformer (TSAT) for multivariate time series representation learning. Using TSAT, we represent both temporal information and inter-dependencies of multivariate time series in terms of edge-enhanced dynamic graphs. The intra-series correlations are represented by nodes in a dynamic graph; a self-attention mechanism is modified to capture the inter-series correlations by using the super-empirical mode decomposition (SMD) module. We applied the embedded dynamic graphs to times series forecasting problems, including two real-world datasets and two benchmark datasets. Extensive experiments show that TSAT clearly outerperforms six state-of-the-art baseline methods in various forecasting horizons. We further visualize the embedded dynamic graphs to illustrate the graph representation power of TSAT. We share our code at https://github.com/RadiantResearch/TSAT.

READ FULL TEXT

page 1

page 2

page 3

page 4

03/13/2021

Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting

Multivariate time-series forecasting plays a crucial role in many real-w...
07/04/2023

SageFormer: Series-Aware Graph-Enhanced Transformers for Multivariate Time Series Forecasting

Multivariate time series forecasting plays a critical role in diverse do...
08/28/2020

Pay Attention to Evolution: Time Series Forecasting with Deep Graph-Evolution Learning

Time-series forecasting is one of the most active research topics in pre...
03/21/2023

Are uGLAD? Time will tell!

We frequently encounter multiple series that are temporally correlated i...
12/16/2022

Convolution-enhanced Evolving Attention Networks

Attention-based neural networks, such as Transformers, have become ubiqu...
01/27/2023

Learning Informative Representation for Fairness-aware Multivariate Time-series Forecasting: A Group-based Perspective

Multivariate time series (MTS) forecasting has penetrated and benefited ...
12/14/2021

Scale-Aware Neural Architecture Search for Multivariate Time Series Forecasting

Multivariate time series (MTS) forecasting has attracted much attention ...

Please sign up or login with your details

Forgot password? Click here to reset