Software-hardware Integration and Human-centered Benchmarking for Socially-compliant Robot Navigation

by   Iaroslav Okunevich, et al.

The social compatibility (SC) is one of the most important parameters for service robots. It characterises the interaction quality between a robot and a human. In this paper, we first introduce an open-source software-hardware integration scheme for socially-compliant robot navigation and then propose a human-centered benchmarking framework. For the former, we integrate one 3D lidar, one 2D lidar, and four RGB-D cameras for robot exterior perception. The software system is entirely based on the Robot Operating System (ROS) with high modularity and fully deployed to the embedded hardware-based edge while running at a rate that exceeds the release frequency of sensor data. For the latter, we propose a new human-centered performance evaluation metric that can be used to measure SC quickly and efficiently. The values of this metric correlate with the results of the Godspeed questionnaire, which is believed to be a golden standard approach for SC measurements. Together with other commonly used metrics, we benchmark two open-source socially-compliant robot navigation methods, in an end-to-end manner. We clarify all aspects of the benchmarking to ensure the reproducibility of the experiments. We also show that the proposed new metric can provide further justification for the selection of numerical metrics (objective) from a human perspective (subjective).


page 1

page 3

page 7


HuNavSim: A ROS 2 Human Navigation Simulator for Benchmarking Human-Aware Robot Navigation

This work presents the Human Navigation Simulator (HuNavSim), a novel op...

DeepClaw: A Robotic Hardware Benchmarking Platform for Learning Object Manipulation

We present DeepClaw as a reconfigurable benchmark of robotic hardware an...

Human-centered manipulation and navigation with Robot DE NIRO

Social assistance robots in health and elderly care have the potential t...

Benchmarking Metric Ground Navigation

Metric ground navigation addresses the problem of autonomously moving a ...

SENS: Semantic Synthetic Benchmarking Model for integrated supply chain simulation and analysis

Supply Chain (SC) modeling is essential to understand and influence SC b...

SEAN-EP: A Platform for Collecting Human Feedback for Social Robot Navigation at Scale

We introduce the SEAN Experimental Platform (SEAN-EP), an open-source sy...

Benchmarking LLM powered Chatbots: Methods and Metrics

Autonomous conversational agents, i.e. chatbots, are becoming an increas...

Please sign up or login with your details

Forgot password? Click here to reset