Inverse problem regularization with hierarchical variational autoencoders

by   Jean Prost, et al.

In this paper, we propose to regularize ill-posed inverse problems using a deep hierarchical variational autoencoder (HVAE) as an image prior. The proposed method synthesizes the advantages of i) denoiser-based Plug & Play approaches and ii) generative model based approaches to inverse problems. First, we exploit VAE properties to design an efficient algorithm that benefits from convergence guarantees of Plug-and-Play (PnP) methods. Second, our approach is not restricted to specialized datasets and the proposed PnP-HVAE model is able to solve image restoration problems on natural images of any size. Our experiments show that the proposed PnP-HVAE method is competitive with both SOTA denoiser-based PnP approaches, and other SOTA restoration methods based on generative models.


page 12

page 14

page 15

page 24

page 25

page 26

page 27

page 28


Regularising Inverse Problems with Generative Machine Learning Models

Deep neural network approaches to inverse imaging problems have produced...

Adaptive Quantile Sparse Image (AQuaSI) Prior for Inverse Imaging Problems

Inverse problems play a central role for many classical computer vision ...

Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Prior

In this work we address the problem of solving ill-posed inverse problem...

Deep Unfolding of a Proximal Interior Point Method for Image Restoration

Variational methods are widely applied to ill-posed inverse problems for...

Probabilistic Residual Learning for Aleatoric Uncertainty in Image Restoration

Aleatoric uncertainty is an intrinsic property of ill-posed inverse and ...

Source Localization of Graph Diffusion via Variational Autoencoders for Graph Inverse Problems

Graph diffusion problems such as the propagation of rumors, computer vir...

Blind image deblurring using class-adapted image priors

Blind image deblurring (BID) is an ill-posed inverse problem, usually ad...

Please sign up or login with your details

Forgot password? Click here to reset