Attention Sequence to Sequence Model for Machine Remaining Useful Life Prediction

by   Mohamed Ragab, et al.

Accurate estimation of remaining useful life (RUL) of industrial equipment can enable advanced maintenance schedules, increase equipment availability and reduce operational costs. However, existing deep learning methods for RUL prediction are not completely successful due to the following two reasons. First, relying on a single objective function to estimate the RUL will limit the learned representations and thus affect the prediction accuracy. Second, while longer sequences are more informative for modelling the sensor dynamics of equipment, existing methods are less effective to deal with very long sequences, as they mainly focus on the latest information. To address these two problems, we develop a novel attention-based sequence to sequence with auxiliary task (ATS2S) model. In particular, our model jointly optimizes both reconstruction loss to empower our model with predictive capabilities (by predicting next input sequence given current input sequence) and RUL prediction loss to minimize the difference between the predicted RUL and actual RUL. Furthermore, to better handle longer sequence, we employ the attention mechanism to focus on all the important input information during training process. Finally, we propose a new dual-latent feature representation to integrate the encoder features and decoder hidden states, to capture rich semantic information in data. We conduct extensive experiments on four real datasets to evaluate the efficacy of the proposed method. Experimental results show that our proposed method can achieve superior performance over 13 state-of-the-art methods consistently.


page 1

page 2

page 3

page 4


Dual Aspect Self-Attention based on Transformer for Remaining Useful Life Prediction

Remaining useful life prediction (RUL) is one of the key technologies of...

Predicting Drivers' Route Trajectories in Last-Mile Delivery Using A Pair-wise Attention-based Pointer Neural Network

In last-mile delivery, drivers frequently deviate from planned delivery ...

Sequence-Based Target Coin Prediction for Cryptocurrency Pump-and-Dump

As the pump-and-dump schemes (P Ds) proliferate in the cryptocurrency ...

Remaining Useful Life Prediction Using Temporal Deep Degradation Network for Complex Machinery with Attention-based Feature Extraction

The precise estimate of remaining useful life (RUL) is vital for the pro...

Interaction models for remaining useful life estimation

The paper deals with the problem of controlling the state of industrial ...

RAP-Net: Region Attention Predictive Network for Precipitation Nowcasting

Natural disasters caused by heavy rainfall often cost huge loss of life ...

Sequential Attention Source Identification Based on Feature Representation

Snapshot observation based source localization has been widely studied d...

Please sign up or login with your details

Forgot password? Click here to reset