Exploiting Out-of-band Motion Sensor Data to De-anonymize Virtual Reality Users

01/22/2023
by   Mohd Sabra, et al.
0

Virtual Reality (VR) is an exciting new consumer technology which offers an immersive audio-visual experience to users through which they can navigate and interact with a digitally represented 3D space (i.e., a virtual world) using a headset device. By (visually) transporting users from the real or physical world to exciting and realistic virtual spaces, VR systems can enable true-to-life and more interactive versions of traditional applications such as gaming, remote conferencing, social networking and virtual tourism. However, as with any new consumer technology, VR applications also present significant user-privacy challenges. This paper studies a new type of privacy attack targeting VR users by connecting their activities visible in the virtual world (enabled by some VR application/service) to their physical state sensed in the real world. Specifically, this paper analyzes the feasibility of carrying out a de-anonymization or identification attack on VR users by correlating visually observed movements of users' avatars in the virtual world with some auxiliary data (e.g., motion sensor data from mobile/wearable devices held by users) representing their context/state in the physical world. To enable this attack, this paper proposes a novel framework which first employs a learning-based activity classification approach to translate the disparate visual movement data and motion sensor data into an activity-vector to ease comparison, followed by a filtering and identity ranking phase outputting an ordered list of potential identities corresponding to the target visual movement data. Extensive empirical evaluation of the proposed framework, under a comprehensive set of experimental settings, demonstrates the feasibility of such a de-anonymization attack.

READ FULL TEXT

page 5

page 7

page 8

page 9

page 10

page 12

research
03/05/2021

Reducing cybersickness in 360-degree virtual reality

Despite the technological advancements in Virtual Reality (VR), users ar...
research
11/02/2018

Machine learning architectures to predict motion sickness using a Virtual Reality rollercoaster simulation tool

Virtual Reality (VR) can cause an unprecedented immersion and feeling of...
research
08/14/2023

BehaVR: User Identification Based on VR Sensor Data

Virtual reality (VR) platforms enable a wide range of applications, howe...
research
04/05/2023

Tangible Web: An Interactive Immersion Virtual RealityCreativity System that Travels Across Reality

With the advancement of virtual reality (VR) technology, virtual display...
research
04/21/2023

Immersive Virtual Reality and Robotics for Upper Extremity Rehabilitation

Stroke patients often experience upper limb impairments that restrict th...
research
02/15/2023

Extensible Motion-based Identification of XR Users with Non-Specific Motion

Recently emerged solutions demonstrate that the movements of users inter...
research
08/11/2022

Going Incognito in the Metaverse

Virtual reality (VR) telepresence applications and the so-called "metave...

Please sign up or login with your details

Forgot password? Click here to reset