Single-Image based unsupervised joint segmentation and denoising

09/19/2023
by   Nadja Gruber, et al.
0

In this work, we develop an unsupervised method for the joint segmentation and denoising of a single image. To this end, we combine the advantages of a variational segmentation method with the power of a self-supervised, single-image based deep learning approach. One major strength of our method lies in the fact, that in contrast to data-driven methods, where huge amounts of labeled samples are necessary, our model can segment an image into multiple meaningful regions without any training database. Further, we introduce a novel energy functional in which denoising and segmentation are coupled in a way that both tasks benefit from each other. The limitations of existing single-image based variational segmentation methods, which are not capable of dealing with high noise or generic texture, are tackled by this specific combination with self-supervised image denoising. We propose a unified optimisation strategy and show that, especially for very noisy images available in microscopy, our proposed joint approach outperforms its sequential counterpart as well as alternative methods focused purely on denoising or segmentation. Another comparison is conducted with a supervised deep learning approach designed for the same application, highlighting the good performance of our approach.

READ FULL TEXT

page 7

page 8

page 11

page 21

page 22

page 23

page 24

page 26

research
09/14/2022

Noise2SR: Learning to Denoise from Super-Resolved Single Noisy Fluorescence Image

Fluorescence microscopy is a key driver to promote discoveries of biomed...
research
09/22/2021

Joint Optical Neuroimaging Denoising with Semantic Tasks

Optical neuroimaging is a vital tool for understanding the brain structu...
research
05/06/2020

DenoiSeg: Joint Denoising and Segmentation

Microscopy image analysis often requires the segmentation of objects, bu...
research
08/09/2023

Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoising

Real-world single image denoising is crucial and practical in computer v...
research
11/27/2019

Leveraging Self-supervised Denoising for Image Segmentation

Deep learning (DL) has arguably emerged as the method of choice for the ...
research
09/21/2017

A First Derivative Potts Model for Segmentation and Denoising Using MILP

Unsupervised image segmentation and denoising are two fundamental tasks ...
research
04/17/2023

Unsupervised Image Denoising with Score Function

Though achieving excellent performance in some cases, current unsupervis...

Please sign up or login with your details

Forgot password? Click here to reset