Supervised Topological Maps

by   Francesco Mannella, et al.

Controlling the internal representation space of a neural network is a desirable feature because it allows to generate new data in a supervised manner. In this paper we will show how this can be achieved while building a low-dimensional mapping of the input stream, by deriving a generalized algorithm starting from Self Organizing Maps (SOMs). SOMs are a kind of neural network which can be trained with unsupervised learning to produce a low-dimensional discretized mapping of the input space. They can be used for the generation of new data through backward propagation of interpolations made from the mapping grid. Unfortunately the final topology of the mapping space of a SOM is not known before learning, so interpolating new data in a supervised way is not an easy task. Here we will show a variation from the SOM algorithm consisting in constraining the update of prototypes so that it is also a function of the distance of its prototypes from extrinsically given targets in the mapping space. We will demonstrate how such variants, that we will call Supervised Topological Maps (STMs), allow for a supervised mapping where the position of internal representations in the mapping space is determined by the experimenter. Controlling the internal representation space in STMs reveals to be an easier task than what is currently done using other algorithms such as variational or adversarial autoencoders.


page 4

page 6

page 8

page 10

page 11


Mixing autoencoder with classifier: conceptual data visualization

In this short paper, a neural network that is able to form a low dimensi...

SOMz: photometric redshift PDFs with self organizing maps and random atlas

In this paper we explore the applicability of the unsupervised machine l...

Parametric UMAP: learning embeddings with deep neural networks for representation and semi-supervised learning

We propose Parametric UMAP, a parametric variation of the UMAP (Uniform ...

Deep Neural Maps

We introduce a new unsupervised representation learning and visualizatio...

Extraction of topological features from communication network topological patterns using self-organizing feature maps

Different classes of communication network topologies and their represen...

Incremental Semantic Mapping with Unsupervised On-line Learning

This paper introduces an incremental semantic mapping approach, with on-...

Sparse Function-space Representation of Neural Networks

Deep neural networks (NNs) are known to lack uncertainty estimates and s...

Please sign up or login with your details

Forgot password? Click here to reset