Equivalence of several curves assessing the similarity between probability distributions

06/21/2020
by   Loïc Simon, et al.
0

The recent advent of powerful generative models has triggered the renewed development of quantitative measures to assess the proximity of two probability distributions. As the scalar Frechet inception distance remains popular, several methods have explored computing entire curves, which reveal the trade-off between the fidelity and variability of the first distribution with respect to the second one. Several of such variants have been proposed independently and while intuitively similar, their relationship has not yet been made explicit. In an effort to make the emerging picture of generative evaluation more clear, we propose a unification of four curves known respectively as: the precision-recall (PR) curve, the Lorenz curve, the receiver operating characteristic (ROC) curve and a special case of Rényi divergence frontiers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/16/2023

Precision and Recall Reject Curves for Classification

For some classification scenarios, it is desirable to use only those cla...
research
09/13/2018

Receiver Operating Characteristic (ROC) Curves

Receiver operating characteristic (ROC) curves are used ubiquitously to ...
research
01/11/2023

Fitting Bell Curves to Data Distributions using Visualization

Idealized probability distributions, such as normal or other curves, lie...
research
05/14/2019

Revisiting Precision and Recall Definition for Generative Model Evaluation

In this article we revisit the definition of Precision-Recall (PR) curve...
research
09/07/2018

FRESH: Fréchet Similarity with Hashing

Massive datasets of curves, such as time series and trajectories, are co...
research
12/08/2015

Similarity detection of rational space curves

We provide an algorithm to check whether two rational space curves are r...
research
09/21/2019

Using theoretical ROC curves for analysing machine learning binary classifiers

Most binary classifiers work by processing the input to produce a scalar...

Please sign up or login with your details

Forgot password? Click here to reset