AutoSNAP: Automatically Learning Neural Architectures for Instrument Pose Estimation

06/26/2020
by   David Kügler, et al.
0

Despite recent successes, the advances in Deep Learning have not yet been fully translated to Computer Assisted Intervention (CAI) problems such as pose estimation of surgical instruments. Currently, neural architectures for classification and segmentation tasks are adopted ignoring significant discrepancies between CAI and these tasks. We propose an automatic framework (AutoSNAP) for instrument pose estimation problems, which discovers and learns the architectures for neural networks. We introduce 1) an efficient testing environment for pose estimation, 2) a powerful architecture representation based on novel Symbolic Neural Architecture Patterns (SNAPs), and 3) an optimization of the architecture using an efficient search scheme. Using AutoSNAP, we discover an improved architecture (SNAPNet) which outperforms both the hand-engineered i3PosNet and the state-of-the-art architecture search method DARTS.

READ FULL TEXT
research
03/03/2020

Single-Shot Pose Estimation of Surgical Robot Instruments' Shafts from Monocular Endoscopic Images

Surgical robots are used to perform minimally invasive surgery and allev...
research
07/07/2023

Equivariant Single View Pose Prediction Via Induced and Restricted Representations

Learning about the three-dimensional world from two-dimensional images i...
research
12/13/2020

EfficientPose: Efficient Human Pose Estimation with Neural Architecture Search

Human pose estimation from image and video is a vital task in many multi...
research
06/20/2018

How Bad is Good enough: Noisy annotations for instrument pose estimation

Though analysis of Medical Images by Deep Learning achieves unprecedente...
research
02/24/2022

HMD-EgoPose: Head-Mounted Display-Based Egocentric Marker-Less Tool and Hand Pose Estimation for Augmented Surgical Guidance

The success or failure of modern computer-assisted surgery procedures hi...
research
11/29/2019

An adaptive and fully automatic method for estimating the 3D position of bendable instruments using endoscopic images

Background. Flexible bendable instruments are key tools for performing s...
research
03/03/2023

Deep Neural Network Architecture Search for Accurate Visual Pose Estimation aboard Nano-UAVs

Miniaturized autonomous unmanned aerial vehicles (UAVs) are an emerging ...

Please sign up or login with your details

Forgot password? Click here to reset