Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approach

by   Evangelos Galaris, et al.

We address a three-tier data-driven approach to solve the inverse problem in complex systems modelling from spatio-temporal data produced by microscopic simulators using machine learning. In the first step, we exploit manifold learning and in particular parsimonious Diffusion Maps using leave-one-out cross-validation (LOOCV) to both identify the intrinsic dimension of the manifold where the emergent dynamics evolve and for feature selection over the parametric space. In the second step, based on the selected features, we learn the right-hand-side of the effective partial differential equations (PDEs) using two machine learning schemes, namely shallow Feedforward Neural Networks (FNNs) with two hidden layers and single-layer Random Projection Networks(RPNNs) which basis functions are constructed using an appropriate random sampling approach. Finally, based on the learned black-box PDE model, we construct the corresponding bifurcation diagram, thus exploiting the numerical bifurcation analysis toolkit. For our illustrations, we implemented the proposed method to construct the one-parameter bifurcation diagram of the 1D FitzHugh-Nagumo PDEs from data generated by D1Q3 Lattice Boltzmann simulations. The proposed method was quite effective in terms of numerical accuracy regarding the construction of the coarse-scale bifurcation diagram. Furthermore, the proposed RPNN scheme was ∼ 20 to 30 times less costly regarding the training phase than the traditional shallow FNNs, thus arising as a promising alternative to deep learning for solving the inverse problem for high-dimensional PDEs.


page 4

page 14

page 17

page 18

page 19

page 20


Learning black- and gray-box chemotactic PDEs/closures from agent based Monte Carlo simulation data

We propose a machine learning framework for the data-driven discovery of...

Coarse-scale PDEs from fine-scale observations via machine learning

Complex spatiotemporal dynamics of physicochemical processes are often m...

Some machine learning schemes for high-dimensional nonlinear PDEs

We propose new machine learning schemes for solving high dimensional non...

Bridging Traditional and Machine Learning-based Algorithms for Solving PDEs: The Random Feature Method

One of the oldest and most studied subject in scientific computing is al...

Numerical Solution of Stiff Ordinary Differential Equations with Random Projection Neural Networks

We propose a numerical scheme based on Random Projection Neural Networks...

Efficient computation of bifurcation diagrams with a deflated approach to reduced basis spectral element method

The majority of the most common physical phenomena can be described usin...

Machine Learning Changes the Rules for Flux Limiters

Learning to integrate non-linear equations from highly resolved direct n...

Please sign up or login with your details

Forgot password? Click here to reset