Numerical Solution of Stiff Ordinary Differential Equations with Random Projection Neural Networks

by   Evangelos Galaris, et al.

We propose a numerical scheme based on Random Projection Neural Networks (RPNN) for the solution of Ordinary Differential Equations (ODEs) with a focus on stiff problems. In particular, we use an Extreme Learning Machine, a single-hidden layer Feedforward Neural Network with Radial Basis Functions which widths are uniformly distributed random variables, while the values of the weights between the input and the hidden layer are set equal to one. The numerical solution is obtained by constructing a system of nonlinear algebraic equations, which is solved with respect to the output weights using the Gauss-Newton method. For our illustrations, we apply the proposed machine learning approach to solve two benchmark stiff problems, namely the Rober and the van der Pol ones (the latter with large values of the stiffness parameter), and we perform a comparison with well-established methods such as the adaptive Runge-Kutta method based on the Dormand-Prince pair, and a variable-step variable-order multistep solver based on numerical differentiation formulas, as implemented in the and MATLAB functions, respectively. We show that our proposed scheme yields good numerical approximation accuracy without being affected by the stiffness, thus outperforming in same cases the and functions. Importantly, upon training using a fixed number of collocation points, the proposed scheme approximates the solution in the whole domain in contrast to the classical time integration methods.


page 1

page 2

page 3

page 4


Extreme learning machine collocation for the numerical solution of elliptic PDEs with sharp gradients

We introduce a new numerical method based on machine learning to approxi...

Parsimonious Physics-Informed Random Projection Neural Networks for Initial-Value Problems of ODEs and index-1 DAEs

We address a physics-informed neural network based on the concept of ran...

Differential equations as models of deep neural networks

In this work we systematically analyze general properties of differentia...

Slow Invariant Manifolds of Singularly Perturbed Systems via Physics-Informed Machine Learning

We present a physics-informed machine-learning (PIML) approach for the a...

Black Box Probabilistic Numerics

Probabilistic numerics casts numerical tasks, such the numerical solutio...

A Connectionist Network Approach to Find Numerical Solutions of Diophantine Equations

The paper introduces a connectionist network approach to find numerical ...

Please sign up or login with your details

Forgot password? Click here to reset