Semantic-Aware Environment Perception for Mobile Human-Robot Interaction

11/07/2022
by   Thorsten Hempel, et al.
0

Current technological advances open up new opportunities for bringing human-machine interaction to a new level of human-centered cooperation. In this context, a key issue is the semantic understanding of the environment in order to enable mobile robots more complex interactions and a facilitated communication with humans. Prerequisites are the vision-based registration of semantic objects and humans, where the latter are further analyzed for potential interaction partners. Despite significant research achievements, the reliable and fast registration of semantic information still remains a challenging task for mobile robots in real-world scenarios. In this paper, we present a vision-based system for mobile assistive robots to enable a semantic-aware environment perception without additional a-priori knowledge. We deploy our system on a mobile humanoid robot that enables us to test our methods in real-world applications.

READ FULL TEXT

page 1

page 3

research
03/08/2023

The dynamic nature of trust: Trust in Human-Robot Interaction revisited

The role of robots is expanding from tool to collaborator. Socially assi...
research
03/30/2023

Learning Human-to-Robot Handovers from Point Clouds

We propose the first framework to learn control policies for vision-base...
research
09/30/2022

A Taxonomy of Semantic Information in Robot-Assisted Disaster Response

This paper proposes a taxonomy of semantic information in robot-assisted...
research
10/20/2021

Semantic Sensing and Planning for Human-Robot Collaboration in Uncertain Environments

Autonomous robots can benefit greatly from human-provided semantic chara...
research
07/06/2022

Physical Interaction and Manipulation of the Environment using Aerial Robots

The physical interaction of aerial robots with their environment has cou...
research
09/21/2021

Learning to Guide Human Attention on Mobile Telepresence Robots with 360 degree Vision

Mobile telepresence robots (MTRs) allow people to navigate and interact ...
research
08/02/2021

Semantic-aware plant traversability estimation in plant-rich environments for agricultural mobile robots

This paper describes a method of estimating the traversability of plant ...

Please sign up or login with your details

Forgot password? Click here to reset