DeepAI AI Chat
Log In Sign Up

Euler Characteristic Transform Based Topological Loss for Reconstructing 3D Images from Single 2D Slices

03/08/2023
by   Kalyan Varma Nadimpalli, et al.
IIIT Bangalore
HZM DEUTSCHES FORSCHUNGSZENTRUM FUR GESUNDHEIT UND UMWELT (G
44

The computer vision task of reconstructing 3D images, i.e., shapes, from their single 2D image slices is extremely challenging, more so in the regime of limited data. Deep learning models typically optimize geometric loss functions, which may lead to poor reconstructions as they ignore the structural properties of the shape. To tackle this, we propose a novel topological loss function based on the Euler Characteristic Transform. This loss can be used as an inductive bias to aid the optimization of any neural network toward better reconstructions in the regime of limited data. We show the effectiveness of the proposed loss function by incorporating it into SHAPR, a state-of-the-art shape reconstruction model, and test it on two benchmark datasets, viz., Red Blood Cells and Nuclei datasets. We also show a favourable property, namely injectivity and discuss the stability of the topological loss function based on the Euler Characteristic Transform.

READ FULL TEXT
03/03/2022

Capturing Shape Information with Multi-Scale Topological Loss Terms for 3D Reconstruction

Reconstructing 3D objects from 2D images is both challenging for our bra...
02/16/2021

Euler Characteristic Surfaces

We study the use of the Euler characteristic for multiparameter topologi...
05/24/2018

How Many Directions Determine a Shape and other Sufficiency Results for Two Topological Transforms

In this paper we consider two topological transforms based on Euler calc...
11/28/2018

Challenges in Reconstructing Shapes from Euler Characteristic Curves

Shape recognition and classification is a problem with a wide variety of...
05/15/2020

On approximation theorems for the Euler characteristic with applications to the bootstrap

We study approximation theorems for the Euler characteristic of the Viet...
07/30/2021

Topological Similarity Index and Loss Function for Blood Vessel Segmentation

Blood vessel segmentation is one of the most studied topics in computer ...
06/14/2021

Phase Transitions, Distance Functions, and Implicit Neural Representations

Representing surfaces as zero level sets of neural networks recently eme...