Heuristic Framework for Multi-Scale Testing of the Multi-Manifold Hypothesis

07/01/2018
by   F. Patricia Medina, et al.
4

When analyzing empirical data, we often find that global linear models overestimate the number of parameters required. In such cases, we may ask whether the data lies on or near a manifold or a set of manifolds (a so-called multi-manifold) of lower dimension than the ambient space. This question can be phrased as a (multi-) manifold hypothesis. The identification of such intrinsic multiscale features is a cornerstone of data analysis and representation and has given rise to a large body of work on manifold learning. In this work, we review key results on multi-scale data analysis and intrinsic dimension followed by the introduction of a heuristic, multiscale framework for testing the multi-manifold hypothesis. Our method implements a hypothesis test on a set of spline-interpolated manifolds constructed from variance-based intrinsic dimensions. The workflow is suitable for empirical data analysis as we demonstrate on two use cases.

READ FULL TEXT

page 13

page 24

page 28

research
05/27/2019

Intrinsic Multi-scale Evaluation of Generative Models

Generative models are often used to sample high-dimensional data points ...
research
06/19/2020

Fast Mixing of Multi-Scale Langevin Dynamics under the Manifold Hypothesis

Recently, the task of image generation has attracted much attention. In ...
research
06/19/2020

Fast Mixing of Multi-Scale Langevin Dynamics underthe Manifold Hypothesis

Recently, the task of image generation has attracted much attention. In ...
research
07/08/2021

Manifold Hypothesis in Data Analysis: Double Geometrically-Probabilistic Approach to Manifold Dimension Estimation

Manifold hypothesis states that data points in high-dimensional space ac...
research
01/26/2021

LDLE: Low Distortion Local Eigenmaps

We present Low Distortion Local Eigenmaps (LDLE), a manifold learning te...
research
09/30/2022

TOAST: Topological Algorithm for Singularity Tracking

The manifold hypothesis, which assumes that data lie on or close to an u...
research
04/24/2018

Measuring the Intrinsic Dimension of Objective Landscapes

Many recently trained neural networks employ large numbers of parameters...

Please sign up or login with your details

Forgot password? Click here to reset