My(o) Armband Leaks Passwords: An EMG and IMU Based Keylogging Side-Channel Attack

12/04/2021
by   Matthias Gazzari, et al.
0

Wearables that constantly collect various sensor data of their users increase the chances for inferences of unintentional and sensitive information such as passwords typed on a physical keyboard. We take a thorough look at the potential of using electromyographic (EMG) data, a sensor modality which is new to the market but has lately gained attention in the context of wearables for augmented reality (AR), for a keylogging side-channel attack. Our approach is based on neural networks for a between-subject attack in a realistic scenario using the Myo Armband to collect the sensor data. In our approach, the EMG data has proven to be the most prominent source of information compared to the accelerometer and gyroscope, increasing the keystroke detection performance. For our end-to-end approach on raw data, we report a mean balanced accuracy of about 76 32 strengths. We have created an extensive dataset including more than 310 000 keystrokes recorded from 37 volunteers, which is available as open access along with the source code used to create the given results.

READ FULL TEXT

page 5

page 16

page 17

research
10/05/2021

Reducing Gaze Distraction for Real-time Vibration Monitoring Using Augmented Reality

Operators want to maintain awareness of the structure being tested while...
research
01/16/2020

A Markerless Deep Learning-based 6 Degrees of Freedom PoseEstimation for with Mobile Robots using RGB Data

Augmented Reality has been subject to various integration efforts within...
research
08/17/2023

That Doesn't Go There: Attacks on Shared State in Multi-User Augmented Reality Applications

Augmented Reality (AR) is expected to become a pervasive component in en...
research
03/23/2020

DYSAN: Dynamically sanitizing motion sensor data against sensitive inferences through adversarial networks

With the widespread adoption of the quantified self movement, an increas...
research
07/27/2018

End-to-end Deep Learning from Raw Sensor Data: Atrial Fibrillation Detection using Wearables

We present a convolutional-recurrent neural network architecture with lo...
research
12/09/2015

Motion model transitions in GPS-IMU sensor fusion for user tracking in augmented reality

Finding the position of the user is an important processing step for aug...

Please sign up or login with your details

Forgot password? Click here to reset