Goal-Image Conditioned Dynamic Cable Manipulation through Bayesian Inference and Multi-Objective Black-Box Optimization

by   Kuniyuki Takahashi, et al.

To perform dynamic cable manipulation to realize the configuration specified by a target image, we formulate dynamic cable manipulation as a stochastic forward model. Then, we propose a method to handle uncertainty by maximizing the expectation, which also considers estimation errors of the trained model. To avoid issues like multiple local minima and requirement of differentiability by gradient-based methods, we propose using a black-box optimization (BBO) to optimize joint angles to realize a goal image. Among BBO, we use the Tree-structured Parzen Estimator (TPE), a type of Bayesian optimization. By incorporating constraints into the TPE, the optimized joint angles are constrained within the range of motion. Since TPE is population-based, it is better able to detect multiple feasible configurations using the estimated inverse model. We evaluated image similarity between the target and cable images captured by executing the robot using optimal transport distance. The results show that the proposed method improves accuracy compared to conventional gradient-based approaches and methods that use deterministic models that do not consider uncertainty.


page 1

page 4

page 5

page 6


A New Knowledge Gradient-based Method for Constrained Bayesian Optimization

Black-box problems are common in real life like structural design, drug ...

Differentiating the Black-Box: Optimization with Local Generative Surrogates

We propose a novel method for gradient-based optimization of black-box s...

Adversarial Example Generation using Evolutionary Multi-objective Optimization

This paper proposes Evolutionary Multi-objective Optimization (EMO)-base...

Differentiable Multi-Target Causal Bayesian Experimental Design

We introduce a gradient-based approach for the problem of Bayesian optim...

A transport approach to sequential simulation-based inference

We present a new transport-based approach to efficiently perform sequent...

Design of Dynamic Experiments for Black-Box Model Discrimination

Diverse domains of science and engineering require and use mechanistic m...

A Distance-Geometric Method for Recovering Robot Joint Angles From an RGB Image

Autonomous manipulation systems operating in domains where human interve...

Please sign up or login with your details

Forgot password? Click here to reset