Convergence and error analysis of PINNs

05/02/2023
by   Nathan Doumèche, et al.
0

Physics-informed neural networks (PINNs) are a promising approach that combines the power of neural networks with the interpretability of physical modeling. PINNs have shown good practical performance in solving partial differential equations (PDEs) and in hybrid modeling scenarios, where physical models enhance data-driven approaches. However, it is essential to establish their theoretical properties in order to fully understand their capabilities and limitations. In this study, we highlight that classical training of PINNs can suffer from systematic overfitting. This problem can be addressed by adding a ridge regularization to the empirical risk, which ensures that the resulting estimator is risk-consistent for both linear and nonlinear PDE systems. However, the strong convergence of PINNs to a solution satisfying the physical constraints requires a more involved analysis using tools from functional analysis and calculus of variations. In particular, for linear PDE systems, an implementable Sobolev-type regularization allows to reconstruct a solution that not only achieves statistical accuracy but also maintains consistency with the underlying physics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/10/2023

On the Stability and Convergence of Physics Informed Neural Networks

Physics Informed Neural Networks is a numerical method which uses neural...
research
04/03/2020

On the Convergence and generalization of Physics Informed Neural Networks

Physics informed neural networks (PINNs) are deep learning based techniq...
research
12/22/2020

Enforcing exact physics in scientific machine learning: a data-driven exterior calculus on graphs

As traditional machine learning tools are increasingly applied to scienc...
research
09/07/2022

Error Estimates and Physics Informed Augmentation of Neural Networks for Thermally Coupled Incompressible Navier Stokes Equations

Physics Informed Neural Networks (PINNs) are shown to be a promising met...
research
02/24/2020

Physics Constrained Learning for Data-driven Inverse Modeling from Sparse Observations

Deep neural networks (DNN) have been used to model nonlinear relations b...
research
09/21/2023

Physics-informed State-space Neural Networks for Transport Phenomena

This work introduces Physics-informed State-space neural network Models ...
research
10/29/2021

Towards Comparative Physical Interpretation of Spatial Variability Aware Neural Networks: A Summary of Results

Given Spatial Variability Aware Neural Networks (SVANNs), the goal is to...

Please sign up or login with your details

Forgot password? Click here to reset