Overlaying Spaces and Practical Applicability of Complex Geometries

by   Kirill Shevkunov, et al.
Moscow Institute of Physics and Technology

Recently, non-Euclidean spaces became popular for embedding structured data. Following hyperbolic and spherical spaces, more general product spaces have been proposed. However, searching for the best configuration of a product space is a resource-intensive procedure, which reduces the practical applicability of the idea. We introduce a novel concept of overlaying spaces that does not have the problem of configuration search and outperforms the competitors in structured data embedding tasks, when the aim is to preserve all distances. On the other hand, for local loss functions (e.g., for ranking losses), the dot-product similarity, which is often overlooked in graph embedding literature since it cannot be converted to a metric, outperforms all metric spaces. We discuss advantages of the dot product over proper metric spaces.


page 1

page 2

page 3

page 4


Gromov-Hausdorff Distances for Comparing Product Manifolds of Model Spaces

Recent studies propose enhancing machine learning models by aligning the...

Switch Spaces: Learning Product Spaces with Sparse Gating

Learning embedding spaces of suitable geometry is critical for represent...

Improving Heterogeneous Graph Learning with Weighted Mixed-Curvature Product Manifold

In graph representation learning, it is important that the complex geome...

Neural Embedding: Learning the Embedding of the Manifold of Physics Data

In this paper, we present a method of embedding physics data manifolds w...

Advances in Metric Ramsey Theory and its Applications

Metric Ramsey theory is concerned with finding large well-structured sub...

Beyond Vector Spaces: Compact Data Representationas Differentiable Weighted Graphs

Learning useful representations is a key ingredient to the success of mo...

Beyond Vector Spaces: Compact Data Representation as Differentiable Weighted Graphs

Learning useful representations is a key ingredient to the success of mo...

Please sign up or login with your details

Forgot password? Click here to reset