Spiking-GAN: A Spiking Generative Adversarial Network Using Time-To-First-Spike Coding

06/29/2021
by   Vineet Kotariya, et al.
0

Spiking Neural Networks (SNNs) have shown great potential in solving deep learning problems in an energy-efficient manner. However, they are still limited to simple classification tasks. In this paper, we propose Spiking-GAN, the first spike-based Generative Adversarial Network (GAN). It employs a kind of temporal coding scheme called time-to-first-spike coding. We train it using approximate backpropagation in the temporal domain. We use simple integrate-and-fire (IF) neurons with very high refractory period for our network which ensures a maximum of one spike per neuron. This makes the model much sparser than a spike rate-based system. Our modified temporal loss function called 'Aggressive TTFS' improves the inference time of the network by over 33 compared to previous works. Our experiments show that on training the network on the MNIST dataset using this approach, we can generate high quality samples. Thereby demonstrating the potential of this framework for solving such problems in the spiking domain.

READ FULL TEXT

page 9

page 10

research
10/21/2019

S4NN: temporal backpropagation for spiking neural networks with one spike per neuron

We propose a new supervised learning rule for multilayer spiking neural ...
research
05/17/2023

Spiking Generative Adversarial Network with Attention Scoring Decoding

Generative models based on neural networks present a substantial challen...
research
03/01/2018

Synthesizing realistic neural population activity patterns using Generative Adversarial Networks

The ability to synthesize realistic patterns of neural activity is cruci...
research
03/17/2020

SiamSNN: Spike-based Siamese Network for Energy-Efficient and Real-time Object Tracking

Although deep neural networks (DNNs) have achieved fantastic success in ...
research
03/26/2020

T2FSNN: Deep Spiking Neural Networks with Time-to-first-spike Coding

Spiking neural networks (SNNs) have gained considerable interest due to ...
research
07/24/2023

Sparse-firing regularization methods for spiking neural networks with time-to-first spike coding

The training of multilayer spiking neural networks (SNNs) using the erro...
research
03/26/2021

Visual Explanations from Spiking Neural Networks using Interspike Intervals

Spiking Neural Networks (SNNs) compute and communicate with asynchronous...

Please sign up or login with your details

Forgot password? Click here to reset