U-NetPlus: A Modified Encoder-Decoder U-Net Architecture for Semantic and Instance Segmentation of Surgical Instrument

by   S. M. Kamrul Hasan, et al.

Conventional therapy approaches limit surgeons' dexterity control due to limited field-of-view. With the advent of robot-assisted surgery, there has been a paradigm shift in medical technology for minimally invasive surgery. However, it is very challenging to track the position of the surgical instruments in a surgical scene, and accurate detection & identification of surgical tools is paramount. Deep learning-based semantic segmentation in frames of surgery videos has the potential to facilitate this task. In this work, we modify the U-Net architecture named U-NetPlus, by introducing a pre-trained encoder and re-design the decoder part, by replacing the transposed convolution operation with an upsampling operation based on nearest-neighbor (NN) interpolation. To further improve performance, we also employ a very fast and flexible data augmentation technique. We trained the framework on 8 x 225 frame sequences of robotic surgical videos, available through the MICCAI 2017 EndoVis Challenge dataset and tested it on 8 x 75 frame and 2 x 300 frame videos. Using our U-NetPlus architecture, we report a 90.20 segmentation, 76.26 instrument type (i.e., all instruments) segmentation, outperforming the results of previous techniques implemented and tested on these data.


page 1

page 2

page 3

page 6


Video-Instrument Synergistic Network for Referring Video Instrument Segmentation in Robotic Surgery

Robot-assisted surgery has made significant progress, with instrument se...

ISINet: An Instance-Based Approach for Surgical Instrument Segmentation

We study the task of semantic segmentation of surgical instruments in ro...

One to Many: Adaptive Instrument Segmentation via Meta Learning and Dynamic Online Adaptation in Robotic Surgical Video

Surgical instrument segmentation in robot-assisted surgery (RAS) - espec...

A Nested U-Structure for Instrument Segmentation in Robotic Surgery

Robot-assisted surgery has made great progress with the development of m...

Multi-frame Feature Aggregation for Real-time Instrument Segmentation in Endoscopic Video

Deep learning-based methods have achieved promising results on surgical ...

Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Room

Image-based tracking of medical instruments is an integral part of many ...

Using Conditional Generative Adversarial Networks to Reduce the Effects of Latency in Robotic Telesurgery

The introduction of surgical robots brought about advancements in surgic...

Please sign up or login with your details

Forgot password? Click here to reset