Mixed-curvature Variational Autoencoders

by   Ondrej Skopek, et al.

It has been shown that using geometric spaces with non-zero curvature instead of plain Euclidean spaces with zero curvature improves performance on a range of Machine Learning tasks for learning representations. Recent work has leveraged these geometries to learn latent variable models like Variational Autoencoders (VAEs) in spherical and hyperbolic spaces with constant curvature. While these approaches work well on particular kinds of data that they were designed for e.g. tree-like data for a hyperbolic VAE, there exists no generic approach unifying all three models. We develop a Mixed-curvature Variational Autoencoder, an efficient way to train a VAE whose latent space is a product of constant curvature Riemannian manifolds, where the per-component curvature can be learned. This generalizes the Euclidean VAE to curved latent spaces, as the model essentially reduces to the Euclidean VAE if curvatures of all latent space components go to 0.


page 38

page 41


Gromov-Hausdorff Distances for Comparing Product Manifolds of Model Spaces

Recent studies propose enhancing machine learning models by aligning the...

Adversarial Autoencoders with Constant-Curvature Latent Manifolds

Constant-curvature Riemannian manifolds (CCMs) have been shown to be ide...

Switch Spaces: Learning Product Spaces with Sparse Gating

Learning embedding spaces of suitable geometry is critical for represent...

Projections of Model Spaces for Latent Graph Inference

Graph Neural Networks leverage the connectivity structure of graphs as a...

Curved Geometric Networks for Visual Anomaly Recognition

Learning a latent embedding to understand the underlying nature of data ...

L3DMC: Lifelong Learning using Distillation via Mixed-Curvature Space

The performance of a lifelong learning (L3) model degrades when it is tr...

Channel-Recurrent Variational Autoencoders

Variational Autoencoder (VAE) is an efficient framework in modeling natu...

Please sign up or login with your details

Forgot password? Click here to reset