Intel Labs at Ego4D Challenge 2022: A Better Baseline for Audio-Visual Diarization

10/14/2022

∙

by   Kyle Min, et al.

∙

0

∙

share

This report describes our approach for the Audio-Visual Diarization (AVD) task of the Ego4D Challenge 2022. Specifically, we present multiple technical improvements over the official baselines. First, we improve the detection performance of the camera wearer's voice activity by modifying the training scheme of its model. Second, we discover that an off-the-shelf voice activity detection model can effectively remove false positives when it is applied solely to the camera wearer's voice activities. Lastly, we show that better active speaker detection leads to a better AVD outcome. Our final method obtains 65.9 the baselines. Our submission achieved 1st place in the Ego4D Challenge 2022.