Capacity Studies for a Differential Growing Neural Gas

12/23/2022
by   P. Levi, et al.
0

In 2019 Kerdels and Peters proposed a grid cell model (GCM) based on a Differential Growing Neural Gas (DGNG) network architecture as a computationally efficient way to model an Autoassociative Memory Cell (AMC) <cit.>. An important feature of the DGNG architecture with respect to possible applications in the field of computational neuroscience is its capacity refering to its capability to process and uniquely distinguish input signals and therefore obtain a valid representation of the input space. This study evaluates the capacity of a two layered DGNG grid cell model on the Fashion-MNIST dataset. The focus on the study lies on the variation of layer sizes to improve the understanding of capacity properties in relation to network parameters as well as its scaling properties. Additionally, parameter discussions and a plausability check with a pixel/segment variation method are provided. It is concluded, that the DGNG model is able to obtain a meaningful and plausible representation of the input space and to cope with the complexity of the Fashion-MNIST dataset even at moderate layer sizes.

READ FULL TEXT

page 7

page 9

page 18

research
01/23/2019

An information theoretic approach to the autoencoder

We present a variation of the Autoencoder (AE) that explicitly maximizes...
research
03/03/2020

A Metric for Evaluating Neural Input Representation in Supervised Learning Networks

Supervised learning has long been attributed to several feed-forward neu...
research
04/22/2021

Hierarchical growing grid networks for skeleton based action recognition

In this paper, a novel cognitive architecture for action recognition is ...
research
02/18/2020

A Computationally Efficient Neural Network Invariant to the Action of Symmetry Subgroups

We introduce a method to design a computationally efficient G-invariant ...
research
03/09/2021

Enhancing sensor resolution improves CNN accuracy given the same number of parameters or FLOPS

High image resolution is critical to obtain a good performance in many c...
research
09/22/2016

Is the deconvolution layer the same as a convolutional layer?

In this note, we want to focus on aspects related to two questions most ...
research
04/26/2021

Model-centric Data Manifold: the Data Through the Eyes of the Model

We discover that deep ReLU neural network classifiers can see a low-dime...

Please sign up or login with your details

Forgot password? Click here to reset