Deep Learning Based Instance Segmentation in 3D Biomedical Images Using Weak Annotation

by   Zhuo Zhao, et al.

Instance segmentation in 3D images is a fundamental task in biomedical image analysis. While deep learning models often work well for 2D instance segmentation, 3D instance segmentation still faces critical challenges, such as insufficient training data due to various annotation difficulties in 3D biomedical images. Common 3D annotation methods (e.g., full voxel annotation) incur high workloads and costs for labeling enough instances for training deep learning 3D instance segmentation models. In this paper, we propose a new weak annotation approach for training a fast deep learning 3D instance segmentation model without using full voxel mask annotation. Our approach needs only 3D bounding boxes for all instances and full voxel annotation for a small fraction of the instances, and uses a novel two-stage 3D instance segmentation model utilizing these two kinds of annotation, respectively. We evaluate our approach on several biomedical image datasets, and the experimental results show that (1) with full annotated boxes and a small amount of masks, our approach can achieve similar performance as the best known methods using full annotation, and (2) with similar annotation time, our approach outperforms the best known methods that use full annotation.


BoxNet: Deep Learning Based Biomedical Image Segmentation Using Boxes Only Annotation

In recent years, deep learning (DL) methods have become powerful tools f...

Deep-learning in the bioimaging wild: Handling ambiguous data with deepflash2

We present deepflash2, a deep learning solution that facilitates the obj...

Two-Dimensional Quantum Material Identification via Self-Attention and Soft-labeling in Deep Learning

In quantum machine field, detecting two-dimensional (2D) materials in Si...

DArch: Dental Arch Prior-assisted 3D Tooth Instance Segmentation

Automatic tooth instance segmentation on 3D dental models is a fundament...

Kartezio: Evolutionary Design of Explainable Pipelines for Biomedical Image Analysis

An unresolved issue in contemporary biomedicine is the overwhelming numb...

An annotated instance segmentation XXL-CT dataset from a historic airplane

The Me 163 was a Second World War fighter airplane and a result of the G...

Generating Instance Segmentation Annotation by Geometry-guided GAN

Instance segmentation is a problem of significance in computer vision. H...

Please sign up or login with your details

Forgot password? Click here to reset