Analyzing Human Models that Adapt Online

03/09/2021
by   Andrea Bajcsy, et al.
11

Predictive human models often need to adapt their parameters online from human data. This raises previously ignored safety-related questions for robots relying on these models such as what the model could learn online and how quickly could it learn it. For instance, when will the robot have a confident estimate in a nearby human's goal? Or, what parameter initializations guarantee that the robot can learn the human's preferences in a finite number of observations? To answer such analysis questions, our key idea is to model the robot's learning algorithm as a dynamical system where the state is the current model parameter estimate and the control is the human data the robot observes. This enables us to leverage tools from reachability analysis and optimal control to compute the set of hypotheses the robot could learn in finite time, as well as the worst and best-case time it takes to learn them. We demonstrate the utility of our analysis tool in four human-robot domains, including autonomous driving and indoor navigation.

READ FULL TEXT

page 4

page 5

page 6

page 7

research
10/03/2022

Online Update of Safety Assurances Using Confidence-Based Predictions

Robots such as autonomous vehicles and assistive manipulators are increa...
research
09/29/2021

Safety Assurances for Human-Robot Interaction via Confidence-aware Game-theoretic Human Models

An outstanding challenge with safety methods for human-robot interaction...
research
12/11/2018

Guided Exploration of Human Intentions for Human-Robot Interaction

Robot understanding of human intentions is essential for fluid human-rob...
research
07/02/2021

Here's What I've Learned: Asking Questions that Reveal Reward Learning

Robots can learn from humans by asking questions. In these questions the...
research
08/19/2023

StROL: Stabilized and Robust Online Learning from Humans

Today's robots can learn the human's reward function online, during the ...
research
10/04/2022

Opinion-Driven Robot Navigation: Human-Robot Corridor Passing

We propose, analyze, and experimentally verify a new approach for robot ...
research
11/18/2020

Learning control for transmission and navigation with a mobile robot under unknown communication rates

In tasks such as surveying or monitoring remote regions, an autonomous r...

Please sign up or login with your details

Forgot password? Click here to reset