Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement

01/08/2023
by   Yan Li, et al.
0

Time series forecasting has been a widely explored task of great importance in many applications. However, it is common that real-world time series data are recorded in a short time period, which results in a big gap between the deep model and the limited and noisy time series. In this work, we propose to address the time series forecasting problem with generative modeling and propose a bidirectional variational auto-encoder (BVAE) equipped with diffusion, denoise, and disentanglement, namely D3VAE. Specifically, a coupled diffusion probabilistic model is proposed to augment the time series data without increasing the aleatoric uncertainty and implement a more tractable inference process with BVAE. To ensure the generated series move toward the true target, we further propose to adapt and integrate the multiscale denoising score matching into the diffusion process for time series forecasting. In addition, to enhance the interpretability and stability of the prediction, we treat the latent variable in a multivariate manner and disentangle them on top of minimizing total correlation. Extensive experiments on synthetic and real-world data show that D3VAE outperforms competitive algorithms with remarkable margins. Our implementation is available at https://github.com/PaddlePaddle/PaddleSpatial/tree/main/research/D3VAE.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2021

MixSeq: Connecting Macroscopic Time Series Forecasting with Microscopic Time Series Data

Time series forecasting is widely used in business intelligence, e.g., f...
research
01/28/2021

Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting

In this work, we propose TimeGrad, an autoregressive model for multivari...
research
06/18/2021

ScoreGrad: Multivariate Probabilistic Time Series Forecasting with Continuous Energy-based Generative Models

Multivariate time series prediction has attracted a lot of attention bec...
research
10/25/2022

WaveBound: Dynamic Error Bounds for Stable Time Series Forecasting

Time series forecasting has become a critical task due to its high pract...
research
11/04/2022

Modeling Temporal Data as Continuous Functions with Process Diffusion

Temporal data like time series are often observed at irregular intervals...
research
01/16/2023

TDSTF: Transformer-based Diffusion probabilistic model for Sparse Time series Forecasting

Time series probabilistic forecasting with multi-dimensional and sporadi...
research
07/21/2023

Predict, Refine, Synthesize: Self-Guiding Diffusion Models for Probabilistic Time Series Forecasting

Diffusion models have achieved state-of-the-art performance in generativ...

Please sign up or login with your details

Forgot password? Click here to reset