Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution

04/07/2021
by   Xiu Li, et al.
0

High quality imaging usually requires bulky and expensive lenses to compensate geometric and chromatic aberrations. This poses high constraints on the optical hash or low cost applications. Although one can utilize algorithmic reconstruction to remove the artifacts of low-end lenses, the degeneration from optical aberrations is spatially varying and the computation has to trade off efficiency for performance. For example, we need to conduct patch-wise optimization or train a large set of local deep neural networks to achieve high reconstruction performance across the whole image. In this paper, we propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors, thus leading to a universal and flexible optical aberration correction method. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters, which largely alleviates the time and memory consumption of model learning. The approach is of high efficiency in both training and testing stages. Extensive results verify the promising applications of our proposed approach for compact low-end cameras.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
06/22/2023

Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformers

High-quality panoramic images with a Field of View (FoV) of 360-degree a...
research
05/10/2023

Optical Aberration Correction in Postprocessing using Imaging Simulation

As the popularity of mobile photography continues to grow, considerable ...
research
10/29/2020

FlatNet: Towards Photorealistic Scene Reconstruction from Lensless Measurements

Lensless imaging has emerged as a potential solution towards realizing u...
research
10/25/2018

Convolutional Deblurring for Natural Imaging

In this paper, we propose a novel design of image deblurring in the form...
research
04/10/2023

Neural Lens Modeling

Recent methods for 3D reconstruction and rendering increasingly benefit ...
research
03/30/2020

Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imaging

Snapshot compressive imaging (SCI) aims to capture the high-dimensional ...
research
07/26/2022

Bessel Equivariant Networks for Inversion of Transmission Effects in Multi-Mode Optical Fibres

We develop a new type of model for solving the task of inverting the tra...

Please sign up or login with your details

Forgot password? Click here to reset