DeepAI AI Chat
Log In Sign Up

Robust Shape Estimation for 3D Deformable Object Manipulation

by   Tao Han, et al.

Existing shape estimation methods for deformable object manipulation suffer from the drawbacks of being off-line, model dependent, noise-sensitive or occlusion-sensitive, and thus are not appropriate for manipulation tasks requiring high precision. In this paper, we present a real-time shape estimation approach for autonomous robotic manipulation of 3D deformable objects. Our method fulfills all the requirements necessary for the high-quality deformable object manipulation in terms of being real-time, model-free and robust to noise and occlusion. These advantages are accomplished using a joint tracking and reconstruction framework, in which we track the object deformation by aligning a reference shape model with the stream input from the RGB-D camera, and simultaneously upgrade the reference shape model according to the newly captured RGB-D data. We have evaluated the quality and robustness of our real-time shape estimation pipeline on a set of deformable manipulation tasks implemented on physical robots. Videos are available at


page 2

page 3

page 6

page 7


ViSE: Vision-Based 3D Real-Time Shape Estimation of Continuously Deformable Robots

The precise control of soft and continuum robots requires knowledge of t...

HMDO: Markerless Multi-view Hand Manipulation Capture with Deformable Objects

We construct the first markerless deformable interaction dataset recordi...

Shape Estimation for Elongated Deformable Object using B-spline Chained Multiple Random Matrices Model

In this paper, a B-spline chained multiple random matrices representatio...

Neural Textured Deformable Meshes for Robust Analysis-by-Synthesis

Human vision demonstrates higher robustness than current AI algorithms u...

Learning to Simulate Tree-Branch Dynamics for Manipulation

We propose to use a simulation driven inverse inference approach to mode...

Dynamic High Resolution Deformable Articulated Tracking

The last several years have seen significant progress in using depth cam...

Semantic State Estimation in Cloth Manipulation Tasks

Understanding of deformable object manipulations such as textiles is a c...

Code Repositories