DeepAI AI Chat
Log In Sign Up

Personalized Algorithm Generation: A Case Study in Meta-Learning ODE Integrators

by   Yue Guo, et al.

We study the meta-learning of numerical algorithms for scientific computing, which combines the mathematically driven, handcrafted design of general algorithm structure with a data-driven adaptation to specific classes of tasks. This represents a departure from the classical approaches in numerical analysis, which typically do not feature such learning-based adaptations. As a case study, we develop a machine learning approach that automatically learns effective solvers for initial value problems in the form of ordinary differential equations (ODEs), based on the Runge-Kutta (RK) integrator architecture. By combining neural network approximations and meta-learning, we show that we can obtain high-order integrators for targeted families of differential equations without the need for computing integrator coefficients by hand. Moreover, we demonstrate that in certain cases we can obtain superior performance to classical RK methods. This can be attributed to certain properties of the ODE families being identified and exploited by the approach. Overall, this work demonstrates an effective, learning-based approach to the design of algorithms for the numerical solution of differential equations, an approach that can be readily extended to other numerical tasks.


page 1

page 2

page 3

page 4


An analysis of Universal Differential Equations for data-driven discovery of Ordinary Differential Equations

In the last decade, the scientific community has devolved its attention ...

A Recursively Recurrent Neural Network (R2N2) Architecture for Learning Iterative Algorithms

Meta-learning of numerical algorithms for a given task consist of the da...

Accelerating numerical methods by gradient-based meta-solving

In science and engineering applications, it is often required to solve s...

Efficient time stepping for numerical integration using reinforcement learning

Many problems in science and engineering require the efficient numerical...

Meta-learning Pseudo-differential Operators with Deep Neural Networks

This paper introduces a meta-learning approach for parameterized pseudo-...

Physics-aware Spatiotemporal Modules with Auxiliary Tasks for Meta-Learning

Modeling the dynamics of real-world physical systems is critical for spa...

Constructing Runge-Kutta Methods with the Use of Artificial Neural Networks

A methodology that can generate the optimal coefficients of a numerical ...