A unified sparse optimization framework to learn parsimonious physics-informed models from data

06/25/2019
by   Kathleen Champion, et al.
0

Machine learning (ML) is redefining what is possible in data-intensive fields of science and engineering. However, applying ML to problems in the physical sciences comes with a unique set of challenges: scientists want physically interpretable models that can (i) generalize to predict previously unobserved behaviors, (ii) provide effective forecasting predictions (extrapolation), and (iii) be certifiable. Autonomous systems will necessarily interact with changing and uncertain environments, motivating the need for models that can accurately extrapolate based on physical principles (e.g. Newton's universal second law for classical mechanics, F=ma). Standard ML approaches have shown impressive performance for predicting dynamics in an interpolatory regime, but the resulting models often lack interpretability and fail to generalize. In this paper, we introduce a unified sparse optimization framework that learns governing dynamical systems models from data, selecting relevant terms in the dynamics from a library of possible functions. The resulting models are parsimonious, have physical interpretations, and can generalize to new parameter regimes. Our framework allows the use of non-convex sparsity promoting regularization functions and can be adapted to address key challenges in scientific problems and data sets, including outliers, parametric dependencies, and physical constraints. We show that the approach discovers parsimonious dynamical models on several example systems, including a spiking neuron model. This flexible approach can be tailored to the unique challenges associated with a wide range of applications and data sets, providing a powerful ML-based framework for learning governing models for physical systems from data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2023

Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems

Physics-informed machine learning (PIML) is a set of methods and tools t...
research
11/09/2021

Which priors matter? Benchmarking models for learning latent dynamics

Learning dynamics is at the heart of many important applications of mach...
research
03/01/2023

On the Integration of Physics-Based Machine Learning with Hierarchical Bayesian Modeling Techniques

Machine Learning (ML) has widely been used for modeling and predicting p...
research
03/20/2021

Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges

Interpretability in machine learning (ML) is crucial for high stakes dec...
research
02/03/2023

PINN Training using Biobjective Optimization: The Trade-off between Data Loss and Residual Loss

Physics informed neural networks (PINNs) have proven to be an efficient ...
research
12/07/2022

Phase2vec: Dynamical systems embedding with a physics-informed convolutional network

Dynamical systems are found in innumerable forms across the physical and...
research
03/18/2023

Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review

Data Assimilation (DA) and Uncertainty quantification (UQ) are extensive...

Please sign up or login with your details

Forgot password? Click here to reset