A Gradient Sampling Algorithm for Stratified Maps with Applications to Topological Data Analysis

09/01/2021
by   Jacob Leygonie, et al.
0

We introduce a novel gradient descent algorithm extending the well-known Gradient Sampling methodology to the class of stratifiably smooth objective functions, which are defined as locally Lipschitz functions that are smooth on some regular pieces-called the strata-of the ambient Euclidean space. For this class of functions, our algorithm achieves a sub-linear convergence rate. We then apply our method to objective functions based on the (extended) persistent homology map computed over lower-star filters, which is a central tool of Topological Data Analysis. For this, we propose an efficient exploration of the corresponding stratification by using the Cayley graph of the permutation group. Finally, we provide benchmark and novel topological optimization problems, in order to demonstrate the utility and applicability of our framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/31/2021

Distributed Random Reshuffling over Networks

In this paper, we consider the distributed optimization problem where n ...
research
10/11/2019

Theoretical Limits of Pipeline Parallel Optimization and Application to Distributed Deep Learning

We investigate the theoretical limits of pipeline parallel learning of d...
research
10/02/2019

A Framework for Differential Calculus on Persistence Barcodes

We define notions of differentiability for maps from and to the space of...
research
07/14/2021

A Granular Sieving Algorithm for Deterministic Global Optimization

A gradient-free deterministic method is developed to solve global optimi...
research
02/06/2020

Achieving the fundamental convergence-communication tradeoff with Differentially Quantized Gradient Descent

The problem of reducing the communication cost in distributed training t...
research
06/14/2021

Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks

In this paper, we propose two communication-efficient algorithms for dec...
research
06/22/2019

TopoLines: Topological Smoothing for Line Charts

Line charts are commonly used to visualize a series of data samples. Whe...

Please sign up or login with your details

Forgot password? Click here to reset