Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model

01/06/2020
by   Julien Brajard, et al.
18

A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting their future states. The method consists in applying iteratively a data assimilation step, here an ensemble Kalman filter, and a neural network. Data assimilation is used to optimally combine a surrogate model with sparse noisy data. The output analysis is spatially complete and is used as a training set by the neural network to update the surrogate model. The two steps are then repeated iteratively. Numerical experiments have been carried out using the chaotic 40-variables Lorenz 96 model, proving both convergence and statistical skills of the proposed hybrid approach. The surrogate model shows short-term forecast skills up to two Lyapunov times, the retrieval of positive Lyapunov exponents as well as the more energetic frequencies of the power density spectrum. The sensitivity of the method to critical setup parameters is also presented: forecast skills decrease smoothly with increased observational noise but drops abruptly if less than half of the model domain is observed. The successful synergy between data assimilation and machine learning, proven here with a low-dimensional system, encourages further investigation of such hybrids with more sophisticated dynamics.

READ FULL TEXT

page 8

page 9

page 10

research
06/06/2020

Online learning of both state and dynamics using ensemble Kalman filters

The reconstruction of the dynamics of an observed physical system as a s...
research
07/14/2020

Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation

Data-driven prediction and physics-agnostic machine-learning methods hav...
research
01/27/2023

Reduced-Order Autodifferentiable Ensemble Kalman Filters

This paper introduces a computational framework to reconstruct and forec...
research
05/12/2023

Online machine-learning forecast uncertainty estimation for sequential data assimilation

Quantifying forecast uncertainty is a key aspect of state-of-the-art num...
research
03/25/2019

EM-like Learning Chaotic Dynamics from Noisy and Partial Observations

The identification of the governing equations of chaotic dynamical syste...
research
07/23/2021

A comparison of combined data assimilation and machine learning methods for offline and online model error correction

Recent studies have shown that it is possible to combine machine learnin...
research
01/26/2021

Overestimation learning with guarantees

We describe a complete method that learns a neural network which is guar...

Please sign up or login with your details

Forgot password? Click here to reset