DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalization

by   Wang Lu, et al.

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution changes over time. The dynamic distributions inside time series pose great challenges to existing algorithms to identify invariant distributions since they mainly focus on the scenario where the domain information is given as prior knowledge. In this paper, we attempt to exploit subdomains within a whole dataset to counteract issues induced by non-stationary for generalized representation learning. We propose DIVERSIFY, a general framework, for OOD detection and generalization on dynamic distributions of time series. DIVERSIFY takes an iterative process: it first obtains the "worst-case" latent distribution scenario via adversarial training, then reduces the gap between these latent distributions. We implement DIVERSIFY via combining existing OOD detection methods according to either extracted features or outputs of models for detection while we also directly utilize outputs for classification. In addition, theoretical insights illustrate that DIVERSIFY is theoretically supported. Extensive experiments are conducted on seven datasets with different OOD settings across gesture recognition, speech commands recognition, wearable stress and affect detection, and sensor-based human activity recognition. Qualitative and quantitative results demonstrate that DIVERSIFY learns more generalized features and significantly outperforms other baselines.


Generalized Representations Learning for Time Series Classification

Time series classification is an important problem in real world. Due to...

Unsupervised Representation Learning for Time Series with Temporal Neighborhood Coding

Time series are often complex and rich in information but sparsely label...

WOODS: Benchmarks for Out-of-Distribution Generalization in Time Series Tasks

Machine learning models often fail to generalize well under distribution...

ESPRESSO: Entropy and ShaPe awaRe timE-Series SegmentatiOn for processing heterogeneous sensor data

Extracting informative and meaningful temporal segments from high-dimens...

AdaRNN: Adaptive Learning and Forecasting of Time Series

Time series has wide applications in the real world and is known to be d...

Latent Cross-population Dynamic Time-series Analysis of High-dimensional Neural Recordings

An important problem in analysis of neural data is to characterize inter...

Prior knowledge distillation based on financial time series

One of the major characteristics of financial time series is that they c...

Please sign up or login with your details

Forgot password? Click here to reset