Spectrum Attention Mechanism for Time Series Classification

by   Shibo Zhou, et al.

Time series classification(TSC) has always been an important and challenging research task. With the wide application of deep learning, more and more researchers use deep learning models to solve TSC problems. Since time series always contains a lot of noise, which has a negative impact on network training, people usually filter the original data before training the network. The existing schemes are to treat the filtering and training as two stages, and the design of the filter requires expert experience, which increases the design difficulty of the algorithm and is not universal. We note that the essence of filtering is to filter out the insignificant frequency components and highlight the important ones, which is similar to the attention mechanism. In this paper, we propose an attention mechanism that acts on spectrum (SAM). The network can assign appropriate weights to each frequency component to achieve adaptive filtering. We use L1 regularization to further enhance the frequency screening capability of SAM. We also propose a segmented-SAM (SSAM) to avoid the loss of time domain information caused by using the spectrum of the whole sequence. In which, a tumbling window is introduced to segment the original data. Then SAM is applied to each segment to generate new features. We propose a heuristic strategy to search for the appropriate number of segments. Experimental results show that SSAM can produce better feature representations, make the network converge faster, and improve the robustness and classification accuracy.


page 1

page 2

page 3

page 4


Temporal Pattern Attention for Multivariate Time Series Forecasting

Forecasting multivariate time series data, such as prediction of electri...

Towards Diverse and Coherent Augmentation for Time-Series Forecasting

Time-series data augmentation mitigates the issue of insufficient traini...

Deep Learning Based OFDM Channel Estimation Using Frequency-Time Division and Attention Mechanism

In this paper, we propose a frequency-time division network (FreqTimeNet...

Towards a universal neural network encoder for time series

We study the use of a time series encoder to learn representations that ...

InceptionTime: Finding AlexNet for Time Series Classification

Time series classification (TSC) is the area of machine learning interes...

Careful analysis of XRD patterns with Attention

The important peaks related to the physical properties of a lithium ion ...

Yes, DLGM! A novel hierarchical model for hazard classification

Hazards can be exposed by HAZOP as text information, and studying their ...

Please sign up or login with your details

Forgot password? Click here to reset