Non-Rigid Volume to Surface Registration using a Data-Driven Biomechanical Model

by   Micha Pfeiffer, et al.

Non-rigid registration is a key component in soft-tissue navigation. We focus on laparoscopic liver surgery, where we register the organ model obtained from a preoperative CT scan to the intraoperative partial organ surface, reconstructed from the laparoscopic video. This is a challenging task due to sparse and noisy intraoperative data, real-time requirements and many unknowns - such as tissue properties and boundary conditions. Furthermore, establishing correspondences between pre- and intraoperative data can be extremely difficult since the liver usually lacks distinct surface features and the used imaging modalities suffer from very different types of noise. In this work, we train a convolutional neural network to perform both the search for surface correspondences as well as the non-rigid registration in one step. The network is trained on physically accurate biomechanical simulations of randomly generated, deforming organ-like structures. This enables the network to immediately generalize to a new patient organ without the need to re-train. We add various amounts of noise to the intraoperative surfaces during training, making the network robust to noisy intraoperative data. During inference, the network outputs the displacement field which matches the preoperative volume to the partial intraoperative surface. In multiple experiments, we show that the network translates well to real data while maintaining a high inference speed. Our code is made available online.


page 2

page 11

page 12


Learning Soft Tissue Behavior of Organs for Surgical Navigation with Convolutional Neural Networks

Purpose: In surgical navigation, pre-operative organ models are presente...

How to Register a Live onto a Liver ? Partial Matching in the Space of Varifolds

Partial shapes correspondences is a problem that often occurs in compute...

Non-iterative Simultaneous Rigid Registration Method for Serial Sections of Biological Tissue

In this paper, we propose a novel non-iterative algorithm to simultaneou...

Learning Feature Descriptors for Pre- and Intra-operative Point Cloud Matching for Laparoscopic Liver Registration

Purpose: In laparoscopic liver surgery (LLS), pre-operative information ...

GiNGR: Generalized Iterative Non-Rigid Point Cloud and Surface Registration Using Gaussian Process Regression

In this paper, we unify popular non-rigid registration methods for point...

Video-based computer aided arthroscopy for patient specific reconstruction of the Anterior Cruciate Ligament

The Anterior Cruciate Ligament (ACL) tear is a common medical condition ...

Real-time elastic partial shape matching using a neural network-based adjoint method

Surface matching usually provides significant deformations that can lead...

Please sign up or login with your details

Forgot password? Click here to reset