Towards Modular Algorithm Induction

by   Daniel A. Abolafia, et al.

We present a modular neural network architecture Main that learns algorithms given a set of input-output examples. Main consists of a neural controller that interacts with a variable-length input tape and learns to compose modules together with their corresponding argument choices. Unlike previous approaches, Main uses a general domain-agnostic mechanism for selection of modules and their arguments. It uses a general input tape layout together with a parallel history tape to indicate most recently used locations. Finally, it uses a memoryless controller with a length-invariant self-attention based input tape encoding to allow for random access to tape locations. The Main architecture is trained end-to-end using reinforcement learning from a set of input-output examples. We evaluate Main on five algorithmic tasks and show that it can learn policies that generalizes perfectly to inputs of much longer lengths than the ones used for training.


Neuro-Symbolic Program Synthesis

Recent years have seen the proposal of a number of neural architectures ...

Learning Simple Algorithms from Examples

We present an approach for learning simple algorithms such as copying, m...

Neural Random-Access Machines

In this paper, we propose and investigate a new neural network architect...

Improving Input-Output Linearizing Controllers for Bipedal Robots via Reinforcement Learning

The main drawbacks of input-output linearizing controllers are the need ...

Pointer Networks

We introduce a new neural architecture to learn the conditional probabil...

Differentiable Algorithm Networks for Composable Robot Learning

This paper introduces the Differentiable Algorithm Network (DAN), a comp...

GRP Model for Sensorimotor Learning

Learning from complex demonstrations is challenging, especially when the...

Please sign up or login with your details

Forgot password? Click here to reset