Attention-based Convolutional Neural Network for Weakly Labeled Human Activities Recognition with Wearable Sensors

by   Kun Wang, et al.
Nanjing Normal University
Nanjing University of Information Science and Technology

Unlike images or videos data which can be easily labeled by human being, sensor data annotation is a time-consuming process. However, traditional methods of human activity recognition require a large amount of such strictly labeled data for training classifiers. In this paper, we present an attention-based convolutional neural network for human recognition from weakly labeled data. The proposed attention model can focus on labeled activity among a long sequence of sensor data, and while filter out a large amount of background noise signals. In experiment on the weakly labeled dataset, we show that our attention model outperforms classical deep learning methods in accuracy. Besides, we determine the specific locations of the labeled activity in a long sequence of weakly labeled data by converting the compatibility score which is generated from attention model to compatibility density. Our method greatly facilitates the process of sensor data annotation, and makes data collection more easy.


Sequential Weakly Labeled Multi-Activity Recognition and Location on Wearable Sensors using Recurrent Attention Network

With the popularity and development of the wearable devices such as smar...

Video2IMU: Realistic IMU features and signals from videos

Human Activity Recognition (HAR) from wearable sensor data identifies mo...

Yet it moves: Learning from Generic Motions to Generate IMU data from YouTube videos

Human activity recognition (HAR) using wearable sensors has benefited mu...

Using system context information to complement weakly labeled data

Real-world datasets collected with sensor networks often contain incompl...

EXTRACT: Strong Examples from Weakly-Labeled Sensor Data

Thanks to the rise of wearable and connected devices, sensor-generated t...

Combining Public Human Activity Recognition Datasets to Mitigate Labeled Data Scarcity

The use of supervised learning for Human Activity Recognition (HAR) on m...

Please sign up or login with your details

Forgot password? Click here to reset