Evolution Gym: A Large-Scale Benchmark for Evolving Soft Robots

by   Jagdeep Singh Bhatia, et al.

Both the design and control of a robot play equally important roles in its task performance. However, while optimal control is well studied in the machine learning and robotics community, less attention is placed on finding the optimal robot design. This is mainly because co-optimizing design and control in robotics is characterized as a challenging problem, and more importantly, a comprehensive evaluation benchmark for co-optimization does not exist. In this paper, we propose Evolution Gym, the first large-scale benchmark for co-optimizing the design and control of soft robots. In our benchmark, each robot is composed of different types of voxels (e.g., soft, rigid, actuators), resulting in a modular and expressive robot design space. Our benchmark environments span a wide range of tasks, including locomotion on various types of terrains and manipulation. Furthermore, we develop several robot co-evolution algorithms by combining state-of-the-art design optimization methods and deep reinforcement learning techniques. Evaluating the algorithms on our benchmark platform, we observe robots exhibiting increasingly complex behaviors as evolution progresses, with the best evolved designs solving many of our proposed tasks. Additionally, even though robot designs are evolved autonomously from scratch without prior knowledge, they often grow to resemble existing natural creatures while outperforming hand-designed robots. Nevertheless, all tested algorithms fail to find robots that succeed in our hardest environments. This suggests that more advanced algorithms are required to explore the high-dimensional design space and evolve increasingly intelligent robots – an area of research in which we hope Evolution Gym will accelerate progress. Our website with code, environments, documentation, and tutorials is available at http://evogym.csail.mit.edu.


page 8

page 9

page 19

page 27

page 29

page 31

page 39


ROBEL: Robotics Benchmarks for Learning with Low-Cost Robots

ROBEL is an open-source platform of cost-effective robots designed for r...

Neural Approaches to Co-Optimization in Robotics

Robots and intelligent systems that sense or interact with the world are...

Scale invariant robot behavior with fractals

Robots deployed at orders of magnitude different size scales, and that r...

cRoK: A Composable Robotics Benchmark

Selecting an optimal robot and configuring it for a given task is curren...

A Robot to Shape your Natural Plant: The Machine Learning Approach to Model and Control Bio-Hybrid Systems

Bio-hybrid systems---close couplings of natural organisms with technolog...

Evolving soft locomotion in aquatic and terrestrial environments: effects of material properties and environmental transitions

Designing soft robots poses considerable challenges: automated design ap...

EvoRobogami: Co-designing with Humans in Evolutionary Robotics Experiments

We study the effects of injecting human-generated designs into the initi...

Please sign up or login with your details

Forgot password? Click here to reset