SpikePropamine: Differentiable Plasticity in Spiking Neural Networks

by   Samuel Schmidgall, et al.

The adaptive changes in synaptic efficacy that occur between spiking neurons have been demonstrated to play a critical role in learning for biological neural networks. Despite this source of inspiration, many learning focused applications using Spiking Neural Networks (SNNs) retain static synaptic connections, preventing additional learning after the initial training period. Here, we introduce a framework for simultaneously learning the underlying fixed-weights and the rules governing the dynamics of synaptic plasticity and neuromodulated synaptic plasticity in SNNs through gradient descent. We further demonstrate the capabilities of this framework on a series of challenging benchmarks, learning the parameters of several plasticity rules including BCM, Oja's, and their respective set of neuromodulatory variants. The experimental results display that SNNs augmented with differentiable plasticity are sufficient for solving a set of challenging temporal learning tasks that a traditional SNN fails to solve, even in the presence of significant noise. These networks are also shown to be capable of producing locomotion on a high-dimensional robotic learning task, where near-minimal degradation in performance is observed in the presence of novel conditions not seen during the initial training period.


page 8

page 18

page 19

page 20

page 21

page 23


Beyond Weights: Deep learning in Spiking Neural Networks with pure synaptic-delay training

Biological evidence suggests that adaptation of synaptic delays on short...

Temporal support vectors for spiking neuronal networks

When neural circuits learn to perform a task, it is often the case that ...

Stochasticity and Robustness in Spiking Neural Networks

Artificial neural networks normally require precise weights to operate, ...

Stable Lifelong Learning: Spiking neurons as a solution to instability in plastic neural networks

Synaptic plasticity poses itself as a powerful method of self-regulated ...

Differentiable plasticity: training plastic neural networks with backpropagation

How can we build agents that keep learning from experience, quickly and ...

Backpropamine: training self-modifying neural networks with differentiable neuromodulated plasticity

The impressive lifelong learning in animal brains is primarily enabled b...

Tuning Synaptic Connections instead of Weights by Genetic Algorithm in Spiking Policy Network

Learning from the interaction is the primary way biological agents know ...

Please sign up or login with your details

Forgot password? Click here to reset