Preserving local densities in low-dimensional embeddings

01/31/2023
by   Jonas Fischer, et al.
0

Low-dimensional embeddings and visualizations are an indispensable tool for analysis of high-dimensional data. State-of-the-art methods, such as tSNE and UMAP, excel in unveiling local structures hidden in high-dimensional data and are therefore routinely applied in standard analysis pipelines in biology. We show, however, that these methods fail to reconstruct local properties, such as relative differences in densities (Fig. 1) and that apparent differences in cluster size can arise from computational artifact caused by differing sample sizes (Fig. 2). Providing a theoretical analysis of this issue, we then suggest dtSNE, which approximately conserves local densities. In an extensive study on synthetic benchmark and real world data comparing against five state-of-the-art methods, we empirically show that dtSNE provides similar global reconstruction, but yields much more accurate depictions of local distances and relative densities.

READ FULL TEXT

page 14

page 16

research
08/03/2021

Visualizing Data using GTSNE

We present a new method GTSNE to visualize high-dimensional data points ...
research
03/02/2021

Factoring out prior knowledge from low-dimensional embeddings

Low-dimensional embedding techniques such as tSNE and UMAP allow visuali...
research
07/25/2022

Laplacian-based Cluster-Contractive t-SNE for High Dimensional Data Visualization

Dimensionality reduction techniques aim at representing high-dimensional...
research
03/02/2018

Building a Telescope to Look Into High-Dimensional Image Spaces

An image pattern can be represented by a probability distribution whose ...
research
01/24/2016

Fast Binary Embedding via Circulant Downsampled Matrix -- A Data-Independent Approach

Binary embedding of high-dimensional data aims to produce low-dimensiona...
research
11/25/2022

A divide and conquer sequential Monte Carlo approach to high dimensional filtering

We propose a divide-and-conquer approach to filtering which decomposes t...
research
06/07/2022

On random embeddings and their application to optimisation

Random embeddings project high-dimensional spaces to low-dimensional one...

Please sign up or login with your details

Forgot password? Click here to reset