Accelerating Physics-Informed Neural Network Training with Prior Dictionaries

04/17/2020
by   Wei Peng, et al.
49

Physics-Informed Neural Networks (PINNs) can be regarded as general-purpose PDE solvers, but it might be slow to train PINNs on particular problems, and there is no theoretical guarantee of corresponding error bounds. In this manuscript, we propose a variant called Prior Dictionary based Physics-Informed Neural Networks (PD-PINNs). Equipped with task-dependent dictionaries, PD-PINNs enjoy enhanced representation power on the tasks, which helps to capture features provided by dictionaries so that the proposed neural networks can achieve faster convergence in the process of training. In various numerical simulations, compared with existing PINN methods, combining prior dictionaries can significantly enhance convergence speed. In terms of theory, we obtain the error bounds applicable to PINNs and PD-PINNs for solving elliptic partial differential equations of second order. It is proved that under certain mild conditions, the prediction error made by neural networks can be bounded by expected loss of PDEs and boundary conditions.

READ FULL TEXT

page 12

page 13

page 15

page 16

research
06/05/2023

MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networks

Physics-informed Neural Networks (PINNs) have recently achieved remarkab...
research
04/03/2020

On the Convergence and generalization of Physics Informed Neural Networks

Physics informed neural networks (PINNs) are deep learning based techniq...
research
05/23/2022

Generic bounds on the approximation error for physics-informed (and) operator learning

We propose a very general framework for deriving rigorous bounds on the ...
research
08/10/2023

GaborPINN: Efficient physics informed neural networks using multiplicative filtered networks

The computation of the seismic wavefield by solving the Helmholtz equati...
research
08/31/2023

Solving Poisson Problems in Polygonal Domains with Singularity Enriched Physics Informed Neural Networks

Physics informed neural networks (PINNs) represent a very powerful class...
research
02/02/2022

PINNs and GaLS: An Priori Error Estimates for Shallow Physically Informed Neural Network Applied to Elliptic Problems

Recently Physically Informed Neural Networks have gained more and more p...
research
06/24/2023

Current density impedance imaging with PINNs

In this paper, we introduce CDII-PINNs, a computationally efficient meth...

Please sign up or login with your details

Forgot password? Click here to reset