Deep learning-based virtual refocusing of images using an engineered point-spread function

by   Xilin Yang, et al.

We present a virtual image refocusing method over an extended depth of field (DOF) enabled by cascaded neural networks and a double-helix point-spread function (DH-PSF). This network model, referred to as W-Net, is composed of two cascaded generator and discriminator network pairs. The first generator network learns to virtually refocus an input image onto a user-defined plane, while the second generator learns to perform a cross-modality image transformation, improving the lateral resolution of the output image. Using this W-Net model with DH-PSF engineering, we extend the DOF of a fluorescence microscope by  20-fold. This approach can be applied to develop deep learning-enabled image reconstruction methods for localization microscopy techniques that utilize engineered PSFs to improve their imaging performance, including spatial resolution and volumetric imaging throughput.


page 2

page 4


Axial-to-lateral super-resolution for 3D fluorescence microscopy using unsupervised deep learning

Volumetric imaging by fluorescence microscopy is often limited by anisot...

Estimating the resolution of real images

Image resolvability is the primary concern in imaging. This paper report...

Recurrent neural network-based volumetric fluorescence microscopy

Volumetric imaging of samples using fluorescence microscopy plays an imp...

Super-resolution reconstruction of cytoskeleton image based on A-net deep learning network

To date, live-cell imaging at the nanometer scale remains challenging. E...

Learning an optimal PSF-pair for ultra-dense 3D localization microscopy

A long-standing challenge in multiple-particle-tracking is the accurate ...

Spatially variant PSF modeling in confocal macroscopy

Point spread function (PSF) plays an essential role in image reconstruct...

Please sign up or login with your details

Forgot password? Click here to reset