Riemannian Flow Matching on General Geometries

02/07/2023
by   Ricky T. Q. Chen, et al.
0

We propose Riemannian Flow Matching (RFM), a simple yet powerful framework for training continuous normalizing flows on manifolds. Existing methods for generative modeling on manifolds either require expensive simulation, inherently cannot scale to high dimensions, or use approximations to limiting quantities that result in biased objectives. Riemannian Flow Matching bypasses these inconveniences and exhibits multiple benefits over prior approaches: It is completely simulation-free on simple geometries, it does not require divergence computation, and its target vector field is computed in closed form even on general geometries. The key ingredient behind RFM is the construction of a simple kernel function for defining per-sample vector fields, which subsumes existing Euclidean cases. Extending to general geometries, we rely on the use of spectral decompositions to efficiently compute kernel functions. Our method achieves state-of-the-art performance on real-world non-Euclidean datasets, and we showcase, for the first time, tractable training on general geometries, including on triangular meshes and maze-like manifolds with boundaries.

READ FULL TEXT

page 8

page 14

page 15

research
11/07/2016

Normalizing Flows on Riemannian Manifolds

We consider the problem of density estimation on Riemannian manifolds. D...
research
12/01/2021

Diffusion Mean Estimation on the Diagonal of Product Manifolds

Computing sample means on Riemannian manifolds is typically computationa...
research
08/16/2022

Riemannian Diffusion Models

Diffusion models are recent state-of-the-art methods for image generatio...
research
05/11/2020

Design and visualization of Riemannian metrics

Local and global illumination were recently defined in Riemannian manifo...
research
08/18/2021

Moser Flow: Divergence-based Generative Modeling on Manifolds

We are interested in learning generative models for complex geometries d...
research
03/01/2021

Interpretable Stein Goodness-of-fit Tests on Riemannian Manifolds

In many applications, we encounter data on Riemannian manifolds such as ...
research
05/26/2021

Simulation of Conditioned Semimartingales on Riemannian Manifolds

We present a scheme for simulating conditioned semimartingales taking va...

Please sign up or login with your details

Forgot password? Click here to reset