The role of causality in explainable artificial intelligence

09/18/2023
by   Gianluca Carloni, et al.
0

Causality and eXplainable Artificial Intelligence (XAI) have developed as separate fields in computer science, even though the underlying concepts of causation and explanation share common ancient roots. This is further enforced by the lack of review works jointly covering these two fields. In this paper, we investigate the literature to try to understand how and to what extent causality and XAI are intertwined. More precisely, we seek to uncover what kinds of relationships exist between the two concepts and how one can benefit from them, for instance, in building trust in AI systems. As a result, three main perspectives are identified. In the first one, the lack of causality is seen as one of the major limitations of current AI and XAI approaches, and the "optimal" form of explanations is investigated. The second is a pragmatic perspective and considers XAI as a tool to foster scientific exploration for causal inquiry, via the identification of pursue-worthy experimental manipulations. Finally, the third perspective supports the idea that causality is propaedeutic to XAI in three possible manners: exploiting concepts borrowed from causality to support or improve XAI, utilizing counterfactuals for explainability, and considering accessing a causal model as explaining itself. To complement our analysis, we also provide relevant software solutions used to automate causal tasks. We believe our work provides a unified view of the two fields of causality and XAI by highlighting potential domain bridges and uncovering possible limitations.

READ FULL TEXT

page 1

page 6

page 8

page 11

page 18

research
11/24/2019

Causality for Machine Learning

Graphical causal inference as pioneered by Judea Pearl arose from resear...
research
10/10/2017

Counterfactual Causality from First Principles?

In this position paper we discuss three main shortcomings of existing ap...
research
07/20/2020

Artificial Intelligence is stupid and causal reasoning won't fix it

Artificial Neural Networks have reached Grandmaster and even super-human...
research
12/23/2022

Pearl Causal Hierarchy on Image Data: Intricacies Challenges

Many researchers have voiced their support towards Pearl's counterfactua...
research
07/26/2022

XInsight: eXplainable Data Analysis Through The Lens of Causality

In light of the growing popularity of Exploratory Data Analysis (EDA), u...
research
02/01/2023

A Survey of Methods, Challenges and Perspectives in Causality

The Causality field aims to find systematic methods for uncovering cause...
research
08/19/2022

Application of Causal Inference to Analytical Customer Relationship Management in Banking and Insurance

Of late, in order to have better acceptability among various domain, res...

Please sign up or login with your details

Forgot password? Click here to reset