Graph-Transporter: A Graph-based Learning Method for Goal-Conditioned Deformable Object Rearranging Task

by   Yuhong Deng, et al.
Tsinghua University

Rearranging deformable objects is a long-standing challenge in robotic manipulation for the high dimensionality of configuration space and the complex dynamics of deformable objects. We present a novel framework, Graph-Transporter, for goal-conditioned deformable object rearranging tasks. To tackle the challenge of complex configuration space and dynamics, we represent the configuration space of a deformable object with a graph structure and the graph features are encoded by a graph convolution network. Our framework adopts an architecture based on Fully Convolutional Network (FCN) to output pixel-wise pick-and-place actions from only visual input. Extensive experiments have been conducted to validate the effectiveness of the graph representation of deformable object configuration. The experimental results also demonstrate that our framework is effective and general in handling goal-conditioned deformable object rearranging tasks.


page 1

page 3

page 4

page 6


Learning Language-Conditioned Deformable Object Manipulation with Graph Dynamics

Vision-based deformable object manipulation is a challenging problem in ...

Learning to Rearrange Deformable Cables, Fabrics, and Bags with Goal-Conditioned Transporter Networks

Rearranging and manipulating deformable objects such as cables, fabrics,...

Deep Reinforcement Learning Based on Local GNN for Goal-conditioned Deformable Object Rearranging

Object rearranging is one of the most common deformable manipulation tas...

Deformable Linear Object Prediction Using Locally Linear Latent Dynamics

We propose a framework for deformable linear object prediction. Predicti...

Learning Latent Graph Dynamics for Deformable Object Manipulation

Manipulating deformable objects, such as cloth and ropes, is a long-stan...

Realtime Simulation of Thin-Shell Deformable Materials using CNN-Based Mesh Embedding

We address the problem of accelerating thin-shell deformable object simu...

Self-Supervised Goal-Conditioned Pick and Place

Robots have the capability to collect large amounts of data autonomously...

Please sign up or login with your details

Forgot password? Click here to reset