Face Detection in the Operating Room: Comparison of State-of-the-art Methods and a Self-supervised Approach

by   Thibaut Issenhuth, et al.

Purpose: Face detection is a needed component for the automatic analysis and assistance of human activities during surgical procedures. Efficient face detection algorithms can indeed help to detect and identify the persons present in the room, and also be used to automatically anonymize the data. However, current algorithms trained on natural images do not generalize well to the operating room (OR) images. In this work, we provide a comparison of state-of-the-art face detectors on OR data and also present an approach to train a face detector for the OR by exploiting non-annotated OR images. Methods: We propose a comparison of 6 state-of-the-art face detectors on clinical data using Multi-View Operating Room Faces (MVOR-Faces), a dataset of operating room images capturing real surgical activities. We then propose to use self-supervision, a domain adaptation method, for the task of face detection in the OR. The approach makes use of non-annotated images to fine-tune a state-of-the-art detector for the OR without using any human supervision. Results: The results show that the best model, namely the tiny face detector, yields an average precision of 0.536 at Intersection over Union (IoU) of 0.5. Our self-supervised model using non-annotated clinical data outperforms this result by 9.2 state-of-the-art face detectors on operating room images and show that results can be significantly improved by using self-supervision on non-annotated data.


page 2

page 8

page 9


Situation Awareness for Automated Surgical Check-listing in AI-Assisted Operating Room

Nowadays, there are more surgical procedures that are being performed us...

DisguisOR: Holistic Face Anonymization for the Operating Room

Purpose: Recent advances in Surgical Data Science (SDS) have contributed...

FDDB-360: Face Detection in 360-degree Fisheye Images

360-degree cameras offer the possibility to cover a large area, for exam...

NHA12D: A New Pavement Crack Dataset and a Comparison Study Of Crack Detection Algorithms

Crack detection plays a key role in automated pavement inspection. Altho...

FaceOff: Anonymizing Videos in the Operating Rooms

Video capture in the surgical operating room (OR) is increasingly possib...

Articulated Clinician Detection Using 3D Pictorial Structures on RGB-D Data

Reliable human pose estimation (HPE) is essential to many clinical appli...

A Two-Step Learning Method For Detecting Landmarks on Faces From Different Domains

The detection of fiducial points on faces has significantly been favored...

Please sign up or login with your details

Forgot password? Click here to reset