The Emotionally Intelligent Robot: Improving Social Navigation in Crowded Environments

by   Aniket Bera, et al.

We present a real-time algorithm for emotion-aware navigation of a robot among pedestrians. Our approach estimates time-varying emotional behaviors of pedestrians from their faces and trajectories using a combination of Bayesian-inference, CNN-based learning, and the PAD (Pleasure-Arousal-Dominance) model from psychology. These PAD characteristics are used for long-term path prediction and generating proxemic constraints for each pedestrian. We use a multi-channel model to classify pedestrian characteristics into four emotion categories (happy, sad, angry, neutral). In our validation results, we observe an emotion detection accuracy of 85.33 formulate emotion-based proxemic constraints to perform socially-aware robot navigation in low- to medium-density environments. We demonstrate the benefits of our algorithm in simulated environments with tens of pedestrians as well as in a real-world setting with Pepper, a social humanoid robot.


page 1

page 2

page 3

page 4

page 6

page 7


SocioSense: Robot Navigation Amongst Pedestrians with Social and Psychological Constraints

We present a real-time algorithm, SocioSense, for socially-aware navigat...

Pedestrian Dominance Modeling for Socially-Aware Robot Navigation

We present a Pedestrian Dominance Model (PDM) to identify the dominance ...

ProxEmo: Gait-based Emotion Learning and Multi-view Proxemic Fusion for Socially-Aware Robot Navigation

We present ProxEmo, a novel end-to-end emotion prediction algorithm for ...

Autonomous Social Distancing in Urban Environments using a Quadruped Robot

COVID-19 pandemic has become a global challenge faced by people all over...

Pedestrian-Robot Interaction Experiments in an Exit Corridor

The study of human-robot interaction (HRI) has received increasing resea...

CoMet: Modeling Group Cohesion for Socially Compliant Robot Navigation in Crowded Scenes

We present CoMet, a novel approach for computing a group's cohesion and ...

Please sign up or login with your details

Forgot password? Click here to reset