Error Bounds for Flow Matching Methods

05/26/2023
by   Joe Benton, et al.
0

Score-based generative models are a popular class of generative modelling techniques relying on stochastic differential equations (SDE). From their inception, it was realized that it was also possible to perform generation using ordinary differential equations (ODE) rather than SDE. This led to the introduction of the probability flow ODE approach and denoising diffusion implicit models. Flow matching methods have recently further extended these ODE-based approaches and approximate a flow between two arbitrary probability distributions. Previous work derived bounds on the approximation error of diffusion models under the stochastic sampling regime, given assumptions on the L^2 loss. We present error bounds for the flow matching procedure using fully deterministic sampling, assuming an L^2 bound on the approximation error and a certain regularity condition on the data distributions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2023

Score-based Generative Modeling Through Backward Stochastic Differential Equations: Inversion and Generation

The proposed BSDE-based diffusion model represents a novel approach to d...
research
06/03/2023

Exploring the Optimal Choice for Generative Processes in Diffusion Models: Ordinary vs Stochastic Differential Equations

The diffusion model has shown remarkable success in computer vision, but...
research
03/10/2023

Lower error bounds and optimality of approximation for jump-diffusion SDEs with discontinuous drift

In this note we prove sharp lower error bounds for numerical methods for...
research
01/30/2023

ERA-Solver: Error-Robust Adams Solver for Fast Sampling of Diffusion Probabilistic Models

Though denoising diffusion probabilistic models (DDPMs) have achieved re...
research
09/30/2022

Building Normalizing Flows with Stochastic Interpolants

A simple generative model based on a continuous-time normalizing flow be...
research
01/24/2023

Score Matching via Differentiable Physics

Diffusion models based on stochastic differential equations (SDEs) gradu...
research
05/31/2023

A Geometric Perspective on Diffusion Models

Recent years have witnessed significant progress in developing efficient...

Please sign up or login with your details

Forgot password? Click here to reset