On the Optimal Recovery of Graph Signals

04/02/2023
by   Simon Foucart, et al.
0

Learning a smooth graph signal from partially observed data is a well-studied task in graph-based machine learning. We consider this task from the perspective of optimal recovery, a mathematical framework for learning a function from observational data that adopts a worst-case perspective tied to model assumptions on the function to be learned. Earlier work in the optimal recovery literature has shown that minimizing a regularized objective produces optimal solutions for a general class of problems, but did not fully identify the regularization parameter. Our main contribution provides a way to compute regularization parameters that are optimal or near-optimal (depending on the setting), specifically for graph signal processing problems. Our results offer a new interpretation for classical optimization techniques in graph-based learning and also come with new insights for hyperparameter selection. We illustrate the potential of our methods in numerical experiments on several semi-synthetic graph signal processing datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/09/2018

On the Supermodularity of Active Graph-based Semi-supervised Learning with Stieltjes Matrix Regularization

Active graph-based semi-supervised learning (AG-SSL) aims to select a sm...
research
11/04/2021

Optimal Recovery from Inaccurate Data in Hilbert Spaces: Regularize, but what of the Parameter?

In Optimal Recovery, the task of learning a function from observational ...
research
03/12/2018

Extreme Learning Machine for Graph Signal Processing

In this article, we improve extreme learning machines for regression tas...
research
06/03/2018

Learning Graphs from Data: A Signal Representation Perspective

The construction of a meaningful graph topology plays a crucial role in ...
research
06/05/2020

Learning from Non-IID Data in Hilbert Spaces: An Optimal Recovery Perspective

The notion of generalization in classical Statistical Learning is often ...
research
06/02/2017

Bias-Variance Tradeoff of Graph Laplacian Regularizer

This paper presents a bias-variance tradeoff of graph Laplacian regulari...
research
05/02/2023

LogSpecT: Feasible Graph Learning Model from Stationary Signals with Recovery Guarantees

Graph learning from signals is a core task in Graph Signal Processing (G...

Please sign up or login with your details

Forgot password? Click here to reset