Reliability of Solutions in Linear Ordering Problem: New Probabilistic Insight and Algorithms

08/08/2022
by   Leszek Szczecinski, et al.
0

In this work, our goal is to characterize the reliability of the solutions that can be obtained by the linear ordering problem (LOP) which is used to order M objects from their pairwise comparisons. We adopt a probabilistic perspective, where the results of pairwise comparisons are modeled as Bernoulli variables with a common parameter which we estimate from the observed data. Estimation by brute-force enumeration has a prohibitive complexity of O(M!) we thus reformulate the problem and introduce a concept of Slater's spectrum which generalizes Slater's index, and next, devising an efficient algorithm to find the spectrum, we lower the complexity to O(M^2 2^M) which is manageable for moderate-size LOPs. Furthermore, with a minor modification of the algorithm, we are able to find all solutions of the LOP. Numerical examples on synthetic and real-world data are shown and the Python-implemented algorithms are publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2022

Noisy Sorting Capacity

Sorting is the task of ordering n elements using pairwise comparisons. I...
research
08/27/2012

New results of ant algorithms for the Linear Ordering Problem

Ant-based algorithms are successful tools for solving complex problems. ...
research
11/14/2019

Refining Tournament Solutions via Margin of Victory

Tournament solutions are frequently used to select winners from a set of...
research
02/10/2022

Decreasing Annotation Burden of Pairwise Comparisons with Human-in-the-Loop Sorting: Application in Medical Image Artifact Rating

Ranking by pairwise comparisons has shown improved reliability over ordi...
research
06/18/2012

TrueLabel + Confusions: A Spectrum of Probabilistic Models in Analyzing Multiple Ratings

This paper revisits the problem of analyzing multiple ratings given by d...
research
05/19/2023

An Approach to Multiple Comparison Benchmark Evaluations that is Stable Under Manipulation of the Comparate Set

The measurement of progress using benchmarks evaluations is ubiquitous i...

Please sign up or login with your details

Forgot password? Click here to reset