QED: using Quality-Environment-Diversity to evolve resilient robot swarms

by   David M. Bossens, et al.

In swarm robotics, any of the robots in a swarm may be affected by different faults, resulting in significant performance declines. To allow fault recovery from randomly injected faults to different robots in a swarm, a model-free approach may be preferable due to the accumulation of faults in models and the difficulty to predict the behaviour of neighbouring robots. One model-free approach to fault recovery involves two phases: during simulation, a quality-diversity algorithm evolves a behaviourally diverse archive of controllers; during the target application, a search for the best controller is initiated after fault injection. In quality-diversity algorithms, the choice of the behavioural descriptor is a key design choice that determines the quality of the evolved archives, and therefore the fault recovery performance. Although the environment is an important determinant of behaviour, the impact of environmental diversity is often ignored in the choice of a suitable behavioural descriptor. This study compares different behavioural descriptors, including two generic descriptors that work on a wide range of tasks, one hand-coded descriptor which fits the domain of interest, and one novel type of descriptor based on environmental diversity, which we call Quality-Environment-Diversity (QED). Results demonstrate that the above-mentioned model-free approach to fault recovery is feasible in the context of swarm robotics, reducing the fault impact by a factor 2-3. Further, the environmental diversity obtained with QED yields a unique behavioural diversity profile that allows it to recover from high-impact faults.


page 4

page 12


Rapidly adapting robot swarms with Swarm Map-based Bayesian Optimisation

Rapid performance recovery from unforeseen environmental perturbations r...

Unsupervised Behaviour Discovery with Quality-Diversity Optimisation

Quality-Diversity algorithms refer to a class of evolutionary algorithms...

Autonomous skill discovery with Quality-Diversity and Unsupervised Descriptors

Quality-Diversity optimization is a new family of optimization algorithm...

Evolution of a Functionally Diverse Swarm via a Novel Decentralised Quality-Diversity Algorithm

The presence of functional diversity within a group has been demonstrate...

Neural Network-based Fault Detection and Identification for Quadrotors using Dynamic Symmetry

Autonomous robotic systems, such as quadrotors, are susceptible to actua...

Quality-Diversity Optimisation on a Physical Robot Through Dynamics-Aware and Reset-Free Learning

Learning algorithms, like Quality-Diversity (QD), can be used to acquire...

Enhancing MapReduce Fault Recovery Through Binocular Speculation

MapReduce speculation plays an important role in finding potential task ...

Please sign up or login with your details

Forgot password? Click here to reset