Distributional Depth-Based Estimation of Object Articulation Models

08/12/2021
by   Ajinkya Jain, et al.
0

We propose a method that efficiently learns distributions over articulation model parameters directly from depth images without the need to know articulation model categories a priori. By contrast, existing methods that learn articulation models from raw observations typically only predict point estimates of the model parameters, which are insufficient to guarantee the safe manipulation of articulated objects. Our core contributions include a novel representation for distributions over rigid body transformations and articulation model parameters based on screw theory, von Mises-Fisher distributions, and Stiefel manifolds. Combining these concepts allows for an efficient, mathematically sound representation that implicitly satisfies the constraints that rigid body transformations and articulations must adhere to. Leveraging this representation, we introduce a novel deep learning based approach, DUST-net, that performs category-independent articulation model estimation while also providing model uncertainties. We evaluate our approach on several benchmarking datasets and real-world objects and compare its performance with two current state-of-the-art methods. Our results demonstrate that DUST-net can successfully learn distributions over articulation models for novel objects across articulation model categories, which generate point estimates with better accuracy than state-of-the-art methods and effectively capture the uncertainty over predicted model parameters due to noisy inputs.

READ FULL TEXT

page 2

page 13

page 14

research
08/24/2020

ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theory

Robots in human environments will need to interact with a wide variety o...
research
11/30/2021

Probabilistic Estimation of 3D Human Shape and Pose with a Semantic Local Parametric Model

This paper addresses the problem of 3D human body shape and pose estimat...
research
06/08/2016

SE3-Nets: Learning Rigid Body Motion using Deep Neural Networks

We introduce SE3-Nets, which are deep neural networks designed to model ...
research
06/05/2023

Quantification of Uncertainties in Deep Learning-based Environment Perception

In this work, we introduce a novel Deep Learning-based method to perceiv...
research
07/09/2021

Excavation Learning for Rigid Objects in Clutter

Autonomous excavation for hard or compact materials, especially irregula...
research
08/24/2023

Learning to predict 3D rotational dynamics from images of a rigid body with unknown mass distribution

In many real-world settings, image observations of freely rotating 3D ri...
research
12/12/2019

Inferring Distributions Over Depth from a Single Image

When building a geometric scene understanding system for autonomous vehi...

Please sign up or login with your details

Forgot password? Click here to reset