Sequential model correction for nonlinear inverse problems

01/24/2023
by   Arttu Arjas, et al.
0

Inverse problems are in many cases solved with optimization techniques. When the underlying model is linear, first-order gradient methods are usually sufficient. With nonlinear models, due to nonconvexity, one must often resort to second-order methods that are computationally more expensive. In this work we aim to approximate a nonlinear model with a linear one and correct the resulting approximation error. We develop a sequential method that iteratively solves a linear inverse problem and updates the approximation error by evaluating it at the new solution. We separately consider cases where the approximation is fixed over iterations and where the approximation is adaptive. In the fixed case we show theoretically under what assumptions the sequence converges. In the adaptive case, particularly considering the special case of approximation by first-order Taylor expansion, we show that the sequence converges to a neighborhood of a local minimizer of the objective function with respect to the exact model. Furthermore, we show that with quadratic objective functions the sequence corresponds to the Gauss-Newton method. Finally, we showcase numerical results superior to the conventional model correction method. We also show, that a fixed approximation can provide competitive results with considerable computational speed-up.

READ FULL TEXT

page 11

page 15

page 16

page 17

page 18

research
12/11/2020

Non-asymptotic error estimates for the Laplace approximation in Bayesian inverse problems

In this paper we study properties of the Laplace approximation of the po...
research
01/12/2013

Perturbative Corrections for Approximate Inference in Gaussian Latent Variable Models

Expectation Propagation (EP) provides a framework for approximate infere...
research
02/19/2020

Relaxed Gauss-Newton methods with applications to electrical impedance tomography

As second-order methods, Gauss–Newton-type methods can be more effective...
research
05/11/2021

Sequential Projected Newton method for regularization of nonlinear least squares problems

We develop an efficient algorithm for the regularization of nonlinear in...
research
01/03/2023

On Unifying Randomized Methods For Inverse Problems

This work unifies the analysis of various randomized methods for solving...
research
05/20/2022

pISTA: preconditioned Iterative Soft Thresholding Algorithm for Graphical Lasso

We propose a novel quasi-Newton method for solving the sparse inverse co...
research
05/08/2023

Solving Linear Inverse Problems using Higher-Order Annealed Langevin Diffusion

We propose a solution for linear inverse problems based on higher-order ...

Please sign up or login with your details

Forgot password? Click here to reset