Enhancing Transformer Efficiency for Multivariate Time Series Classification

03/28/2022
by   Yuqing Wang, et al.
0

Most current multivariate time series (MTS) classification algorithms focus on improving the predictive accuracy. However, for large-scale (either high-dimensional or long-sequential) time series (TS) datasets, there is an additional consideration: to design an efficient network architecture to reduce computational costs such as training time and memory footprint. In this work we propose a methodology based on module-wise pruning and Pareto analysis to investigate the relationship between model efficiency and accuracy, as well as its complexity. Comprehensive experiments on benchmark MTS datasets illustrate the effectiveness of our method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/18/2017

A Shapelet Transform for Multivariate Time Series Classification

Shapelets are phase independent subsequences designed for time series cl...
research
10/06/2020

A Transformer-based Framework for Multivariate Time Series Representation Learning

In this work we propose for the first time a transformer-based framework...
research
11/13/2022

HigeNet: A Highly Efficient Modeling for Long Sequence Time Series Prediction in AIOps

Modern IT system operation demands the integration of system software an...
research
03/26/2021

Gated Transformer Networks for Multivariate Time Series Classification

Deep learning model (primarily convolutional networks and LSTM) for time...
research
02/07/2022

TACTiS: Transformer-Attentional Copulas for Time Series

The estimation of time-varying quantities is a fundamental component of ...
research
12/24/2020

Memory-Gated Recurrent Networks

The essence of multivariate sequential learning is all about how to extr...
research
02/18/2019

Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing

Network inference algorithms are valuable tools for the study of large-s...

Please sign up or login with your details

Forgot password? Click here to reset