Sublinear Time Low-Rank Approximation of Distance Matrices

by   Ainesh Bakshi, et al.

Let P={ p_1, p_2, ... p_n } and Q = { q_1, q_2 ... q_m } be two point sets in an arbitrary metric space. Let A represent the m× n pairwise distance matrix with A_i,j = d(p_i, q_j). Such distance matrices are commonly computed in software packages and have applications to learning image manifolds, handwriting recognition, and multi-dimensional unfolding, among other things. In an attempt to reduce their description size, we study low rank approximation of such matrices. Our main result is to show that for any underlying distance metric d, it is possible to achieve an additive error low-rank approximation in sublinear time. We note that it is provably impossible to achieve such a guarantee in sublinear time for arbitrary matrices A, and consequently our proof exploits special properties of distance matrices. We develop a recursive algorithm based on additive projection-cost preserving sampling. We then show that in general, relative error approximation in sublinear time is impossible for distance matrices, even if one allows for bicriteria solutions. Additionally, we show that if P = Q and d is the squared Euclidean distance, which is not a metric but rather the square of a metric, then a relative error bicriteria solution can be found in sublinear time.


page 1

page 2

page 3

page 4


Sample-Optimal Low-Rank Approximation of Distance Matrices

A distance matrix A ∈ R^n × m represents all pairwise distances, A_ij=d(...

Robust and Sample Optimal Algorithms for PSD Low-Rank Approximation

Recently, Musco and Woodruff (FOCS, 2017) showed that given an n × n pos...

Faster Linear Algebra for Distance Matrices

The distance matrix of a dataset X of n points with respect to a distanc...

Sparse Harmonic Transforms II: Best s-Term Approximation Guarantees for Bounded Orthonormal Product Bases in Sublinear-Time

In this paper, we develop a sublinear-time compressive sensing algorithm...

Toeplitz Low-Rank Approximation with Sublinear Query Complexity

We present a sublinear query algorithm for outputting a near-optimal low...

Recycling Randomness with Structure for Sublinear time Kernel Expansions

We propose a scheme for recycling Gaussian random vectors into structure...

Learning Determinantal Point Processes in Sublinear Time

We propose a new class of determinantal point processes (DPPs) which can...

Please sign up or login with your details

Forgot password? Click here to reset