REPID: Regional Effect Plots with implicit Interaction Detection

by   Julia Herbinger, et al.

Machine learning models can automatically learn complex relationships, such as non-linear and interaction effects. Interpretable machine learning methods such as partial dependence plots visualize marginal feature effects but may lead to misleading interpretations when feature interactions are present. Hence, employing additional methods that can detect and measure the strength of interactions is paramount to better understand the inner workings of machine learning models. We demonstrate several drawbacks of existing global interaction detection approaches, characterize them theoretically, and evaluate them empirically. Furthermore, we introduce regional effect plots with implicit interaction detection, a novel framework to detect interactions between a feature of interest and other features. The framework also quantifies the strength of interactions and provides interpretable and distinct regions in which feature effects can be interpreted more reliably, as they are less confounded by interactions. We prove the theoretical eligibility of our method and show its applicability on various simulation and real-world examples.


page 1

page 2

page 3

page 4


Decomposing Global Feature Effects Based on Feature Interactions

Global feature effect methods, such as partial dependence plots, provide...

Using Non-Linear Causal Models to Study Aerosol-Cloud Interactions in the Southeast Pacific

Aerosol-cloud interactions include a myriad of effects that all begin wh...

Marginal Effects for Non-Linear Prediction Functions

Beta coefficients for linear regression models represent the ideal form ...

Conjecturing-Based Computational Discovery of Patterns in Data

Modern machine learning methods are designed to exploit complex patterns...

Recovering Pairwise Interactions Using Neural Networks

Recovering pairwise interactions, i.e. pairs of input features whose joi...

Ultra-marginal Feature Importance

Scientists frequently prioritize learning from data rather than training...

Please sign up or login with your details

Forgot password? Click here to reset