Live Laparoscopic Video Retrieval with Compressed Uncertainty

by   Tong Yu, et al.

Searching through large volumes of medical data to retrieve relevant information is a challenging yet crucial task for clinical care. However the primitive and most common approach to retrieval, involving text in the form of keywords, is severely limited when dealing with complex media formats. Content-based retrieval offers a way to overcome this limitation, by using rich media as the query itself. Surgical video-to-video retrieval in particular is a new and largely unexplored research problem with high clinical value, especially in the real-time case: using real-time video hashing, search can be achieved directly inside of the operating room. Indeed, the process of hashing converts large data entries into compact binary arrays or hashes, enabling large-scale search operations at a very fast rate. However, due to fluctuations over the course of a video, not all bits in a given hash are equally reliable. In this work, we propose a method capable of mitigating this uncertainty while maintaining a light computational footprint. We present superior retrieval results (3-4 protocol for surgery, using cholecystectomy phases, bypass phases, and coming from an entirely new dataset introduced here, critical events across six different surgery types. Success on this multi-task benchmark shows the generalizability of our approach for surgical video retrieval.


page 2

page 5

page 6

page 7

page 8

page 9

page 11


Encode the Unseen: Predictive Video Hashing for Scalable Mid-Stream Retrieval

This paper tackles a new problem in computer vision: mid-stream video-to...

Deep supervised hashing for fast retrieval of radio image cubes

The shear number of sources that will be detected by next-generation rad...

Unsupervised Cross-Media Hashing with Structure Preservation

Recent years have seen the exponential growth of heterogeneous multimedi...

A Revisit on Deep Hashings for Large-scale Content Based Image Retrieval

There is a growing trend in studying deep hashing methods for content-ba...

Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising

The advancement of the communication technology and the popularity of th...

Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract

Endoscopy is a routine imaging technique used for both diagnosis and min...

Please sign up or login with your details

Forgot password? Click here to reset