DRCFS: Doubly Robust Causal Feature Selection

06/12/2023
by   Francesco Quinzan, et al.
0

Knowing the features of a complex system that are highly relevant to a particular target variable is of fundamental interest in many areas of science. Existing approaches are often limited to linear settings, sometimes lack guarantees, and in most cases, do not scale to the problem at hand, in particular to images. We propose DRCFS, a doubly robust feature selection method for identifying the causal features even in nonlinear and high dimensional settings. We provide theoretical guarantees, illustrate necessary conditions for our assumptions, and perform extensive experiments across a wide range of simulated and semi-synthetic datasets. DRCFS significantly outperforms existing state-of-the-art methods, selecting robust features even in challenging highly non-linear and high-dimensional problems.

READ FULL TEXT
research
02/16/2018

A Unified View of Causal and Non-causal Feature Selection

In this paper, we unify causal and non-causal feature feature selection ...
research
09/23/2016

Efficient Feature Selection With Large and High-dimensional Data

Driven by the advances in technology, large and high-dimensional data ha...
research
02/27/2022

Architectural Optimization and Feature Learning for High-Dimensional Time Series Datasets

As our ability to sense increases, we are experiencing a transition from...
research
01/27/2021

Inadequacy of Linear Methods for Minimal Sensor Placement and Feature Selection in Nonlinear Systems; a New Approach Using Secants

Sensor placement and feature selection are critical steps in engineering...
research
07/06/2020

Causal Feature Selection via Orthogonal Search

The problem of inferring the direct causal parents of a response variabl...
research
11/02/2021

Distributed Sparse Feature Selection in Communication-Restricted Networks

This paper aims to propose and theoretically analyze a new distributed s...
research
03/08/2023

Optimal Sparse Recovery with Decision Stumps

Decision trees are widely used for their low computational cost, good pr...

Please sign up or login with your details

Forgot password? Click here to reset