Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport

10/28/2022
by   Dinesh Jayaraman, et al.
0

We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel Long-HOT environment focused on deep exploration and long-horizon planning where the agent is required to efficiently find and pick up target objects to be carried and dropped at a goal location, with load constraints and optional access to a container if it finds one. Further, we propose a modular hierarchical transport policy (HTP) that builds a topological graph of the scene to perform exploration with the help of weighted frontiers. Our hierarchical approach uses a combination of motion planning algorithms to reach point goals within explored locations and object navigation policies for moving towards semantic targets at unknown locations. Experiments on both our proposed Habitat transport task and on MultiOn benchmarks show that our method significantly outperforms baselines and prior works. Further, we validate the effectiveness of our modular approach for long-horizon transport by demonstrating meaningful generalization to much harder transport scenes with training only on simpler versions of the task.

READ FULL TEXT
research
01/24/2023

Effective Baselines for Multiple Object Rearrangement Planning in Partially Observable Mapped Environments

Many real-world tasks, from house-cleaning to cooking, can be formulated...
research
04/07/2023

Reduce, Reuse, Recycle: Modular Multi-Object Navigation

Our work focuses on the Multi-Object Navigation (MultiON) task, where an...
research
12/14/2020

Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphs

We present a visually grounded hierarchical planning algorithm for long-...
research
06/11/2022

Development of a Novel Framework for the Design of Transport Policies to Achieve Environmental Targets

The formulation of policies requires the selection and configuration of ...
research
03/24/2022

Object Memory Transformer for Object Goal Navigation

This paper presents a reinforcement learning method for object goal navi...
research
03/25/2021

The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AI

We introduce a visually-guided and physics-driven task-and-motion planni...
research
10/24/2019

HRL4IN: Hierarchical Reinforcement Learning for Interactive Navigation with Mobile Manipulators

Most common navigation tasks in human environments require auxiliary arm...

Please sign up or login with your details

Forgot password? Click here to reset