Ego-Surfing: Person Localization in First-Person Videos Using Ego-Motion Signatures

by   Ryo Yonetani, et al.

We envision a future time when wearable cameras are worn by the masses and recording first-person point-of-view videos of everyday life. While these cameras can enable new assistive technologies and novel research challenges, they also raise serious privacy concerns. For example, first-person videos passively recorded by wearable cameras will necessarily include anyone who comes into the view of a camera -- with or without consent. Motivated by these benefits and risks, we developed a self-search technique tailored to first-person videos. The key observation of our work is that the egocentric head motion of a target person (ie, the self) is observed both in the point-of-view video of the target and observer. The motion correlation between the target person's video and the observer's video can then be used to identify instances of the self uniquely. We incorporate this feature into the proposed approach that computes the motion correlation over densely-sampled trajectories to search for a target individual in observer videos. Our approach significantly improves self-search performance over several well-known face detectors and recognizers. Furthermore, we show how our approach can enable several practical applications such as privacy filtering, target video retrieval, and social group clustering.


page 1

page 2

page 7

page 8

page 9

page 10


Co-interest Person Detection from Multiple Wearable Camera Videos

Wearable cameras, such as Google Glass and Go Pro, enable video data col...

EgoReID: Person re-identification in Egocentric Videos Acquired by Mobile Devices with First-Person Point-of-View

Widespread use of wearable cameras and recording devices such as cellpho...

Egocentric Field-of-View Localization Using First-Person Point-of-View Devices

We present a technique that uses images, videos and sensor data taken fr...

Privacy-Aware Activity Classification from First Person Office Videos

In the advent of wearable body-cameras, human activity classification fr...

When We First Met: Visual-Inertial Person Localization for Co-Robot Rendezvous

We aim to enable robots to visually localize a target person through the...

Egocentric Meets Top-view

Thanks to the availability and increasing popularity of Egocentric camer...

EgoTransfer: Transferring Motion Across Egocentric and Exocentric Domains using Deep Neural Networks

Mirror neurons have been observed in the primary motor cortex of primate...

Please sign up or login with your details

Forgot password? Click here to reset