Copula-based Kernel Dependency Measures

06/18/2012
by   Barnabas Poczos, et al.
0

The paper presents a new copula based method for measuring dependence between random variables. Our approach extends the Maximum Mean Discrepancy to the copula of the joint distribution. We prove that this approach has several advantageous properties. Similarly to Shannon mutual information, the proposed dependence measure is invariant to any strictly increasing transformation of the marginal variables. This is important in many applications, for example in feature selection. The estimator is consistent, robust to outliers, and uses rank statistics only. We derive upper bounds on the convergence rate and propose independence tests too. We illustrate the theoretical contributions through a series of experiments in feature selection and low-dimensional embedding of distributions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2019

Feature Selection for multi-labeled variables via Dependency Maximization

Feature selection and reducing the dimensionality of data is an essentia...
research
09/21/2016

Theoretical Evaluation of Feature Selection Methods based on Mutual Information

Feature selection methods are usually evaluated by wrapping specific cla...
research
03/19/2019

Some New Copula Based Distribution-free Tests of Independence among Several Random Variables

Over the last couple of decades, several copula based methods have been ...
research
11/11/2017

Feature Selection based on the Local Lift Dependence Scale

This paper uses a classical approach to feature selection: minimization ...
research
11/25/2017

Feature Selection Facilitates Learning Mixtures of Discrete Product Distributions

Feature selection can facilitate the learning of mixtures of discrete ra...
research
10/31/2019

Sobolev Independence Criterion

We propose the Sobolev Independence Criterion (SIC), an interpretable de...
research
03/30/2023

Coskewness under dependence uncertainty

We study the impact of dependence uncertainty on the expectation of the ...

Please sign up or login with your details

Forgot password? Click here to reset