Feature Robust Optimal Transport for High-dimensional Data

05/25/2020
by   Mathis Petrovich, et al.
13

Optimal transport is a machine learning technique with applications including distribution comparison, feature selection, and generative adversarial networks. In this paper, we propose feature robust optimal transport (FROT) for high-dimensional data, which jointly solves feature selection and OT problems. Specifically, we aim to select important feature sets and use them to compute the transportation plan. The FROT problem can be formulated as a min–max optimization or a convex minimization problem. Then, we propose a Frank–Wolfe-based optimization algorithm, where the sub-problem can be accurately solved using the Sinkhorn algorithm. An advantage of FROT is that important features can be analytically determined. Furthermore, we propose using the FROT algorithm for feature selection and the layer selection problem in deep neural networks for semantic correspondence. By conducting synthetic and benchmark experiments, we demonstrate that the proposed method can determine important features. Additionally, we show that the FROT algorithm achieves a state-of-the-art performance in real-world semantic correspondence datasets.

READ FULL TEXT
research
02/23/2018

Computation of optimal transport and related hedging problems via penalization and neural networks

This paper presents a widely applicable approach to solving (multi-margi...
research
05/21/2023

Joint Feature and Differentiable k-NN Graph Learning using Dirichlet Energy

Feature selection (FS) plays an important role in machine learning, whic...
research
06/28/2018

Feature Selection for Unsupervised Domain Adaptation using Optimal Transport

In this paper, we propose a new feature selection method for unsupervise...
research
03/21/2021

Deep Distribution-preserving Incomplete Clustering with Optimal Transport

Clustering is a fundamental task in the computer vision and machine lear...
research
06/15/2022

Gaussian Blue Noise

Among the various approaches for producing point distributions with blue...
research
01/10/2021

Curvature-based Feature Selection with Application in Classifying Electronic Health Records

Electronic Health Records (EHRs) are widely applied in healthcare facili...
research
08/28/2021

Feature Selection in High-dimensional Space Using Graph-Based Methods

High-dimensional feature selection is a central problem in a variety of ...

Please sign up or login with your details

Forgot password? Click here to reset