Ill-Posed Image Reconstruction Without an Image Prior

by   Oscar Leong, et al.

We consider solving ill-posed imaging inverse problems without access to an image prior or ground-truth examples. An overarching challenge in these inverse problems is that an infinite number of images, including many that are implausible, are consistent with the observed measurements. Thus, image priors are required to reduce the space of possible solutions to more desireable reconstructions. However, in many applications it is difficult or potentially impossible to obtain example images to construct an image prior. Hence inaccurate priors are often used, which inevitably result in biased solutions. Rather than solving an inverse problem using priors that encode the spatial structure of any one image, we propose to solve a set of inverse problems jointly by incorporating prior constraints on the collective structure of the underlying images. The key assumption of our work is that the underlying images we aim to reconstruct share common, low-dimensional structure. We show that such a set of inverse problems can be solved simultaneously without the use of a spatial image prior by instead inferring a shared image generator with a low-dimensional latent space. The parameters of the generator and latent embeddings are found by maximizing a proxy for the Evidence Lower Bound (ELBO). Once identified, the generator and latent embeddings can be combined to provide reconstructed images for each inverse problem. The framework we propose can handle general forward model corruptions, and we show that measurements derived from only a small number of ground-truth images (⩽ 150) are sufficient for "prior-free" image reconstruction. We demonstrate our approach on a variety of convex and non-convex inverse problems, ranging from denoising, phase retrieval, and black hole video reconstruction.


page 6

page 7

page 8

page 21

page 22

page 23

page 24

page 25


Image Reconstruction without Explicit Priors

We consider solving ill-posed imaging inverse problems without access to...

Sampling possible reconstructions of undersampled acquisitions in MR imaging

Undersampling the k-space during MR acquisitions saves time, however res...

Gradient Distribution Priors for Biomedical Image Processing

Ill-posed inverse problems are commonplace in biomedical image processin...

Deep Mesh Projectors for Inverse Problems

We develop a new learning-based approach to ill-posed inverse problems. ...

Solving Bilinear Inverse Problems using Deep Generative Priors

This paper proposes a new framework to handle the bilinear inverse probl...

Variational Inference for Computational Imaging Inverse Problems

We introduce a method to infer a variational approximation to the poster...

Dictionary and prior learning with unrolled algorithms for unsupervised inverse problems

Inverse problems consist in recovering a signal given noisy observations...

Please sign up or login with your details

Forgot password? Click here to reset