DeepAI AI Chat
Log In Sign Up

Egocentric Visitors Localization in Cultural Sites

04/10/2019
by   Francesco Ragusa, et al.
University of Catania
1

We consider the problem of localizing visitors in a cultural site from egocentric (first person) images. Localization information can be useful both to assist the user during his visit (e.g., by suggesting where to go and what to see next) and to provide behavioral information to the manager of the cultural site (e.g., how much time has been spent by visitors at a given location? What has been liked most?). To tackle the problem, we collected a large dataset of egocentric videos using two cameras: a head-mounted HoloLens device and a chest-mounted GoPro. Each frame has been labeled according to the location of the visitor and to what he was looking at. The dataset is freely available in order to encourage research in this domain. The dataset is complemented with baseline experiments performed considering a state-of-the-art method for location-based temporal segmentation of egocentric videos. Experiments show that compelling results can be achieved to extract useful information for both the visitor and the site-manager.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 8

page 12

page 13

02/03/2020

EGO-CH: Dataset and Fundamental Tasks for Visitors BehavioralUnderstanding using Egocentric Vision

Equipping visitors of a cultural site with a wearable device allows to e...
09/26/2014

Location Recognition Over Large Time Lags

Would it be possible to automatically associate ancient pictures to mode...
08/30/2021

A Service for Supporting Digital and Immersive Cultural Experiences

Cultural heritage sites in Italy typically attract a large number of tou...
08/04/2020

Synthetic to Real Unsupervised Domain Adaptation for Single-Stage Artwork Recognition in Cultural Sites

Recognizing artworks in a cultural site using images acquired from the u...
11/27/2018

Informative Path Planning for Location Fingerprint Collection

Fingerprint-based indoor localization methods are promising due to the h...