S3: Side-Channel Attack on Stylus Pencil through Sensors

by   Habiba Farrukh, et al.

With smart devices being an essential part of our everyday lives, unsupervised access to the mobile sensors' data can result in a multitude of side-channel attacks. In this paper, we study potential data leaks from Apple Pencil (2nd generation) supported by the Apple iPad Pro, the latest stylus pen which attaches to the iPad body magnetically for charging. We observe that the Pencil's body affects the magnetic readings sensed by the iPad's magnetometer when a user is using the Pencil. Therefore, we ask: Can we infer what a user is writing on the iPad screen with the Apple Pencil, given access to only the iPad's motion sensors' data? To answer this question, we present Side-channel attack on Stylus pencil through Sensors (S3), a system that identifies what a user is writing from motion sensor readings. We first use the sharp fluctuations in the motion sensors' data to determine when a user is writing on the iPad. We then introduce a high-dimensional particle filter to track the location and orientation of the Pencil during usage. Lastly, to guide particles, we build the Pencil's magnetic map serving as a bridge between the measured magnetic data and the Pencil location and orientation. We evaluate S3 with 10 subjects and demonstrate that we correctly identify 93.9 and 93.33 the motion sensors' data.


page 2

page 6

page 8

page 20


A Multiple Source Framework for the Identification of Activities of Daily Living Based on Mobile Device Data

The monitoring of the lifestyles may be performed based on a system for ...

Data Fusion on Motion and Magnetic Sensors embedded on Mobile Devices for the Identification of Activities of Daily Living

Several types of sensors have been available in off-the-shelf mobile dev...

Closed-loop Control of Catalytic Janus Microrobots

We report a closed-loop control system for paramagnetic catalytically se...

Digitizing Handwriting with a Sensor Pen: A Writer-Independent Recognizer

Online handwriting recognition has been studied for a long time with onl...

User Environment Detection with Acoustic Sensors Embedded on Mobile Devices for the Recognition of Activities of Daily Living

The detection of the environment where user is located, is of extreme us...

Snoopy: Sniffing Your Smartwatch Passwords via Deep Sequence Learning

Demand for smartwatches has taken off in recent years with new models wh...

SkinSense: Efficient Vibration-based Communications Over Human Body Using Motion Sensors

Recent growth in popularity of mobile and wearable devices has re-ignite...

Please sign up or login with your details

Forgot password? Click here to reset