Learning to Generate Genotypes with Neural Networks

by   Alexander W. Churchill, et al.
Queen Mary University of London

Neural networks and evolutionary computation have a rich intertwined history. They most commonly appear together when an evolutionary algorithm optimises the parameters and topology of a neural network for reinforcement learning problems, or when a neural network is applied as a surrogate fitness function to aid the evolutionary optimisation of expensive fitness functions. In this paper we take a different approach, asking the question of whether a neural network can be used to provide a mutation distribution for an evolutionary algorithm, and what advantages this approach may offer? Two modern neural network models are investigated, a Denoising Autoencoder modified to produce stochastic outputs and the Neural Autoregressive Distribution Estimator. Results show that the neural network approach to learning genotypes is able to solve many difficult discrete problems, such as MaxSat and HIFF, and regularly outperforms other evolutionary techniques.


page 15

page 18

page 19


NetSyn: Neural Evolutionary Technique to Synthesize Programs

Program synthesis using inputs and outputs is a fundamental problem in c...

Supervising Unsupervised Learning with Evolutionary Algorithm in Deep Neural Network

A method to control results of gradient descent unsupervised learning in...

Optimizing thermodynamic trajectories using evolutionary reinforcement learning

Using a model heat engine we show that neural network-based reinforcemen...

Towards co-evolution of fitness predictors and Deep Neural Networks

Deep neural networks proved to be a very useful and powerful tool with m...

The Learning Prescription, A Neural Network Hearing Aid Core

The definition of a hearing aid core which is based on a prescription ne...

Surrogate Models for Enhancing the Efficiency of Neuroevolution in Reinforcement Learning

In the last years, reinforcement learning received a lot of attention. O...

Automatic Model Selection for Neural Networks

Neural networks and deep learning are changing the way that artificial i...

Please sign up or login with your details

Forgot password? Click here to reset