Sequential Manipulation Planning on Scene Graph

07/10/2022
by   Ziyuan Jiao, et al.
0

We devise a 3D scene graph representation, contact graph+ (cg+), for efficient sequential task planning. Augmented with predicate-like attributes, this contact graph-based representation abstracts scene layouts with succinct geometric information and valid robot-scene interactions. Goal configurations, naturally specified on contact graphs, can be produced by a genetic algorithm with a stochastic optimization method. A task plan is then initialized by computing the Graph Editing Distance (GED) between the initial contact graphs and the goal configurations, which generates graph edit operations corresponding to possible robot actions. We finalize the task plan by imposing constraints to regulate the temporal feasibility of graph edit operations, ensuring valid task and motion correspondences. In a series of simulations and experiments, robots successfully complete complex sequential object rearrangement tasks that are difficult to specify using conventional planning language like Planning Domain Definition Language (PDDL), demonstrating the high feasibility and potential of robot sequential task planning on contact graph.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
12/14/2020

Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphs

We present a visually grounded hierarchical planning algorithm for long-...
research
08/15/2020

Graph Edit Distance Reward: Learning to Edit Scene Graph

Scene Graph, as a vital tool to bridge the gap between language domain a...
research
02/08/2021

Manipulation Planning Among Movable Obstacles Using Physics-Based Adaptive Motion Primitives

Robot manipulation in cluttered scenes often requires contact-rich inter...
research
06/01/2022

Multi-Contact Motion Retargeting using Whole-body Optimization of Full Kinematics and Sequential Force Equilibrium

This paper presents a multi-contact motion adaptation framework that ena...
research
09/17/2023

Optimal Scene Graph Planning with Large Language Model Guidance

Recent advances in metric, semantic, and topological mapping have equipp...
research
09/16/2023

Asynchronous Task Plan Refinement for Multi-Robot Task and Motion Planning

This paper explores general multi-robot task and motion planning, where ...
research
09/19/2019

Robust Humanoid Contact Planning with Learned Zero- and One-Step Capturability Prediction

Humanoid robots maintain balance and navigate by controlling the contact...

Please sign up or login with your details

Forgot password? Click here to reset