Combining Ensemble Kalman Filter and Reservoir Computing to predict spatio-temporal chaotic systems from imperfect observations and models

06/25/2020
by   Futo Tomizawa, et al.
0

Prediction of spatio-temporal chaotic systems is important in various fields, such as Numerical Weather Prediction (NWP). While data assimilation methods have been applied in NWP, machine learning techniques, such as Reservoir Computing (RC), are recently recognized as promising tools to predict spatio-temporal chaotic systems. However, the sensitivity of the skill of the machine learning based prediction to the imperfectness of observations is unclear. In this study, we evaluate the skill of RC with noisy and sparsely distributed observations. We intensively compare the performances of RC and Local Ensemble Transform Kalman Filter (LETKF) by applying them to the prediction of the Lorenz 96 system. Although RC can successfully predict the Lorenz 96 system if the system is perfectly observed, we find that RC is vulnerable to observation sparsity compared with LETKF. To overcome this limitation of RC, we propose to combine LETKF and RC. In our proposed method, the system is predicted by RC that learned the analysis time series estimated by LETKF. Our proposed method can successfully predict the Lorenz 96 system using noisy and sparsely distributed observations. Most importantly, our method can predict better than LETKF when the process-based model is imperfect.

READ FULL TEXT
research
07/04/2022

Reusing the H.264/AVC deblocking filter for efficient spatio-temporal prediction in video coding

The prediction step is a very important part of hybrid video codecs for ...
research
04/08/2020

Ensemble Kalman Filter with perturbed observations in weather forecasting and data assimilation

Data assimilation provides algorithms for widespread applications in var...
research
10/01/2021

Closed-form discovery of structural errors in models of chaotic systems by integrating Bayesian sparse regression and data assimilation

Models used for many important engineering and natural systems are imper...
research
02/14/2023

Comparison of Ensemble-Based Data Assimilation Methods for Sparse Oceanographic Data

For oceanographic applications, probabilistic forecasts typically have t...
research
04/28/2019

A General Spatio-Temporal Clustering-Based Non-local Formulation for Multiscale Modeling of Compartmentalized Reservoirs

Representing the reservoir as a network of discrete compartments with ne...
research
07/14/2020

Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation

Data-driven prediction and physics-agnostic machine-learning methods hav...
research
12/01/2021

Automated Offside Detection by Spatio-Temporal Analysis of Football Videos

In this paper, we propose a new automated method to detect offsides from...

Please sign up or login with your details

Forgot password? Click here to reset