The Tractability of SHAP-scores over Deterministic and Decomposable Boolean Circuits

07/28/2020
βˆ™
by   Marcelo Arenas, et al.
βˆ™
0
βˆ™

Scores based on Shapley values are currently widely used for providing explanations to classification results over machine learning models. A prime example of this corresponds to the influential SHAP-score, a version of the Shapley value in which the contribution of a set S of features from a given entity 𝐞 over a model M is defined as the expected value in M of the set of entities 𝐞' that coincide with 𝐞 over all features in S. While in general computing Shapley values is a computationally intractable problem, it has recently been claimed that the SHAP-score can be computed in polynomial time over the class of decision trees. In this paper, we provide a proof of a stronger result over Boolean models: the SHAP-score can be computed in polynomial time over deterministic and decomposable Boolean circuits, also known as tractable probabilistic circuits. Such circuits encompass a wide range of Boolean circuits and binary decision diagrams classes, including binary decision trees and Ordered Binary Decision Diagrams (OBDDs). Moreover, we establish the computational limits of the notion of SHAP-score by showing that computing it over a class of Boolean models is always (polynomially) as hard as the model counting problem for this class (under some mild condition). This implies, for instance, that computing the SHAP-score for DNF propositional formulae is a #P-hard problem, and, thus, that determinism is essential for the circuits that we consider.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
βˆ™ 04/16/2021

On the Complexity of SHAP-Score-Based Explanations: Tractability via Knowledge Compilation and Non-Approximability Results

In Machine Learning, the 𝖲𝖧𝖠𝖯-score is a version of the Shapley value th...
research
βˆ™ 05/14/2023

A Unifying Formal Approach to Importance Values in Boolean Functions

Boolean functions and their representation through logics, circuits, mac...
research
βˆ™ 06/25/2023

From Shapley Value to Model Counting and Back

In this paper we investigate the problem of quantifying the contribution...
research
βˆ™ 09/26/2022

Lower Bound Proof for the Size of BDDs representing a Shifted Addition

Decision Diagrams(DDs) are one of the most popular representations for b...
research
βˆ™ 07/11/2012

Case-Factor Diagrams for Structured Probabilistic Modeling

We introduce a probabilistic formalism subsuming Markov random fields of...
research
βˆ™ 07/03/2020

On Symbolically Encoding the Behavior of Random Forests

Recent work has shown that the input-output behavior of some machine lea...
research
βˆ™ 06/17/2022

Rectifying Mono-Label Boolean Classifiers

We elaborate on the notion of rectification of a Boolean classifier Ξ£. G...

Please sign up or login with your details

Forgot password? Click here to reset