WatchPed: Pedestrian Crossing Intention Prediction Using Embedded Sensors of Smartwatch

by   Jibran Ali Abbasi, et al.

The pedestrian intention prediction problem is to estimate whether or not the target pedestrian will cross the street. State-of-the-art approaches heavily rely on visual information collected with the front camera of the ego-vehicle to make a prediction of the pedestrian's intention. As such, the performance of existing methods significantly degrades when the visual information is not accurate, e.g., when the distance between the pedestrian and ego-vehicle is far, or the lighting conditions are not good enough. In this paper, we design, implement, and evaluate the first pedestrian intention prediction model based on integration of motion sensor data gathered with the smartwatch (or smartphone) of the pedestrian. A novel machine learning architecture is proposed to effectively incorporate the motion sensor data to reinforce the visual information to significantly improve the performance in adverse situations where the visual information may be unreliable. We also conduct a large-scale data collection and present the first pedestrian intention prediction dataset integrated with time-synchronized motion sensor data. The dataset consists of a total of 128 video clips with different distances and varying levels of lighting conditions. We trained our model using the widely-used JAAD and our own datasets and compare the performance with a state-of-the-art model. The results demonstrate that our model outperforms the state-of-the-art method particularly when the distance to the pedestrian is far (over 70m), and the lighting conditions are not sufficient.


page 3

page 4

page 5

page 7


Intention-aware Residual Bidirectional LSTM for Long-term Pedestrian Trajectory Prediction

Trajectory prediction is one of the key capabilities for robots to safel...

PORCA: Modeling and Planning for Autonomous Driving among Many Pedestrians

This paper presents a planning system for autonomous driving among many ...

Pedestrian Motion State Estimation From 2D Pose

Traffic violation and the flexible and changeable nature of pedestrians ...

A streaming feature-based compression method for data from instrumented infrastructure

An increasing amount of civil engineering applications are utilising dat...

IntFormer: Predicting pedestrian intention with the aid of the Transformer architecture

Understanding pedestrian crossing behavior is an essential goal in intel...

The Simpler the Better: Constant Velocity for Pedestrian Motion Prediction

Pedestrian motion prediction is a fundamental task for autonomous robots...

A Follow-the-Leader Strategy using Hierarchical Deep Neural Networks with Grouped Convolutions

The task of following-the-leader is implemented using a hierarchical Dee...

Please sign up or login with your details

Forgot password? Click here to reset