DeStripe: A Self2Self Spatio-Spectral Graph Neural Network with Unfolded Hessian for Stripe Artifact Removal in Light-sheet Microscopy

by   Yu Liu, et al.

Light-sheet fluorescence microscopy (LSFM) is a cutting-edge volumetric imaging technique that allows for three-dimensional imaging of mesoscopic samples with decoupled illumination and detection paths. Although the selective excitation scheme of such a microscope provides intrinsic optical sectioning that minimizes out-of-focus fluorescence background and sample photodamage, it is prone to light absorption and scattering effects, which results in uneven illumination and striping artifacts in the images adversely. To tackle this issue, in this paper, we propose a blind stripe artifact removal algorithm in LSFM, called DeStripe, which combines a self-supervised spatio-spectral graph neural network with unfolded Hessian prior. Specifically, inspired by the desirable properties of Fourier transform in condensing striping information into isolated values in the frequency domain, DeStripe firstly localizes the potentially corrupted Fourier coefficients by exploiting the structural difference between unidirectional stripe artifacts and more isotropic foreground images. Affected Fourier coefficients can then be fed into a graph neural network for recovery, with a Hessian regularization unrolled to further ensure structures in the standard image space are well preserved. Since in realistic, stripe-free LSFM barely exists with a standard image acquisition protocol, DeStripe is equipped with a Self2Self denoising loss term, enabling artifact elimination without access to stripe-free ground truth images. Competitive experimental results demonstrate the efficacy of DeStripe in recovering corrupted biomarkers in LSFM with both synthetic and real stripe artifacts.


page 7

page 8


Improving Blind Spot Denoising for Microscopy

Many microscopy applications are limited by the total amount of usable l...

Improving Lens Flare Removal with General Purpose Pipeline and Multiple Light Sources Recovery

When taking images against strong light sources, the resulting images of...

Multilevel Illumination Coding for Fourier Transform Interferometry in Fluorescence Spectroscopy

Fourier Transform Interferometry (FTI) is an interferometric procedure f...

Compressive Single-pixel Fourier Transform Imaging using Structured Illumination

Single Pixel (SP) imaging is now a reality in many applications, e.g., b...

Learning MRI Artifact Removal With Unpaired Data

Retrospective artifact correction (RAC) improves image quality post acqu...

Image quality measurements and denoising using Fourier Ring Correlations

Image quality is a nebulous concept with different meanings to different...

PgNN: Physics-guided Neural Network for Fourier Ptychographic Microscopy

Fourier ptychography (FP) is a newly developed computational imaging app...

Please sign up or login with your details

Forgot password? Click here to reset