BulletArm: An Open-Source Robotic Manipulation Benchmark and Learning Framework

05/28/2022
by   Dian Wang, et al.
0

We present BulletArm, a novel benchmark and learning-environment for robotic manipulation. BulletArm is designed around two key principles: reproducibility and extensibility. We aim to encourage more direct comparisons between robotic learning methods by providing a set of standardized benchmark tasks in simulation alongside a collection of baseline algorithms. The framework consists of 31 different manipulation tasks of varying difficulty, ranging from simple reaching and picking tasks to more realistic tasks such as bin packing and pallet stacking. In addition to the provided tasks, BulletArm has been built to facilitate easy expansion and provides a suite of tools to assist users when adding new tasks to the framework. Moreover, we introduce a set of five benchmarks and evaluate them using a series of state-of-the-art baseline algorithms. By including these algorithms as part of our framework, we hope to encourage users to benchmark their work on any new tasks against these baselines.

READ FULL TEXT

page 6

page 7

page 8

page 9

page 23

research
05/12/2021

An Open-Source Multi-Goal Reinforcement Learning Environment for Robotic Manipulation with Pybullet

This work re-implements the OpenAI Gym multi-goal robotic manipulation e...
research
10/08/2020

CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning

Despite recent successes of reinforcement learning (RL), it remains a ch...
research
11/05/2019

Benchmarking Simulated Robotic Manipulation through a Real World Dataset

We present a benchmark to facilitate simulated manipulation; an attempt ...
research
01/24/2023

PushWorld: A benchmark for manipulation planning with tools and movable obstacles

While recent advances in artificial intelligence have achieved human-lev...
research
05/19/2023

An Approach to Multiple Comparison Benchmark Evaluations that is Stable Under Manipulation of the Comparate Set

The measurement of progress using benchmarks evaluations is ubiquitous i...
research
09/26/2019

RLBench: The Robot Learning Benchmark Learning Environment

We present a challenging new benchmark and learning-environment for robo...
research
09/17/2016

The ACRV Picking Benchmark (APB): A Robotic Shelf Picking Benchmark to Foster Reproducible Research

Robotic challenges like the Amazon Picking Challenge (APC) or the DARPA ...

Please sign up or login with your details

Forgot password? Click here to reset