AMSOM: Adaptive Moving Self-organizing Map for Clustering and Visualization

05/19/2016
by   Gerasimos Spanakis, et al.
0

Self-Organizing Map (SOM) is a neural network model which is used to obtain a topology-preserving mapping from the (usually high dimensional) input/feature space to an output/map space of fewer dimensions (usually two or three in order to facilitate visualization). Neurons in the output space are connected with each other but this structure remains fixed throughout training and learning is achieved through the updating of neuron reference vectors in feature space. Despite the fact that growing variants of SOM overcome the fixed structure limitation they increase computational cost and also do not allow the removal of a neuron after its introduction. In this paper, a variant of SOM is proposed called AMSOM (Adaptive Moving Self-Organizing Map) that on the one hand creates a more flexible structure where neuron positions are dynamically altered during training and on the other hand tackles the drawback of having a predefined grid by allowing neuron addition and/or removal during training. Experiments using multiple literature datasets show that the proposed method improves training performance of SOM, leads to a better visualization of the input dataset and provides a framework for determining the optimal number and structure of neurons.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/07/2013

A Note on Topology Preservation in Classification, and the Construction of a Universal Neuron Grid

It will be shown that according to theorems of K. Menger, every neuron g...
research
02/11/2016

Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networks

We can better understand deep neural networks by identifying which featu...
research
10/03/2016

Adaptive Neuron Apoptosis for Accelerating Deep Learning on Large Scale Systems

We present novel techniques to accelerate the convergence of Deep Learni...
research
10/04/2020

Understanding How Over-Parametrization Leads to Acceleration: A case of learning a single teacher neuron

Over-parametrization has become a popular technique in deep learning. It...
research
07/03/2020

Training of Deep Learning Neuro-Skin Neural Network

In this brief paper, a learning algorithm is developed for Deep Learning...
research
11/18/2020

Randomized Self Organizing Map

We propose a variation of the self organizing map algorithm by consideri...
research
02/23/2018

Coloring black boxes: visualization of neural network decisions

Neural networks are commonly regarded as black boxes performing incompre...

Please sign up or login with your details

Forgot password? Click here to reset