PETSc TSAdjoint: a discrete adjoint ODE solver for first-order and second-order sensitivity analysis

12/16/2019
by   Hong Zhang, et al.
0

We present a new software system PETSc TSAdjoint for first-order and second-order adjoint sensitivity analysis of time-dependent nonlinear differential equations. The derivative calculation in PETSc TSAdjoint is essentially a high-level algorithmic differentiation process. The adjoint models are derived by differentiating the timestepping algorithms and implemented based on the parallel infrastructure in PETSc. Full differentiation of the library code including MPI routines thus is avoided, and users do not need to derive their own adjoint models for their specific applications. PETSc TSAdjoint can compute the first-order derivative, that is, the gradient of a scalar functional, and the Hessian-vector product that carries second-order derivative information, while requiring minimal input (a few callbacks) from the users. Optimal checkpointing schemes are employed by the adjoint model in a manner that is transparent to users. Usability, efficiency, and scalability are demonstrated through examples from a variety of applications.

READ FULL TEXT

page 2

page 16

page 19

page 20

research
05/04/2022

Second-Order Sensitivity Analysis for Bilevel Optimization

In this work we derive a second-order approach to bilevel optimization, ...
research
01/01/2022

Batched Second-Order Adjoint Sensitivity for Reduced Space Methods

This paper presents an efficient method for extracting the second-order ...
research
07/12/2023

Integrating Enzyme-generated functions into CoDiPack

In operator overloading algorithmic differentiation, it can be beneficia...
research
02/12/2019

Derivative-based global sensitivity analysis for models with high-dimensional inputs and functional outputs

We present a framework for derivative-based global sensitivity analysis ...
research
07/28/2022

How Many Equations of Motion Describe a Moving Human?

A human is a thing that moves in space. Like all things that move in spa...
research
06/26/2019

Convergence of Milstein Brownian bridge Monte Carlo methods and stable Greeks calculation

We consider the pricing and the sensitivity calculation of continuously ...
research
05/08/2023

ASDL: A Unified Interface for Gradient Preconditioning in PyTorch

Gradient preconditioning is a key technique to integrate the second-orde...

Please sign up or login with your details

Forgot password? Click here to reset