Creation of User Friendly Datasets: Insights from a Case Study concerning Explanations of Loan Denials

by   Ajay Chander, et al.

Most explainable AI (XAI) techniques are concerned with the design of algorithms to explain the AI's decision. However, the data that is used to train these algorithms may contain features that are often incomprehensible to an end-user even with the best XAI algorithms. Thus, the problem of explainability has to be addressed starting right from the data creation step. In this paper, we studied this problem considering the use-case of explaining loan denials to end-users as opposed to AI engineers or domain experts. Motivated by the lack of datasets that are representative of user-friendly explanations, we build the first-of-its-kind dataset that is representative of user-friendly explanations for loan denials. The paper shares some of the insights gained in curating the dataset. First, existing datasets seldom contain features that end users consider as acceptable in understanding a model's decision. Second, understanding of the explanation's context such as the human-in-the-loop seeking the explanation, and the purpose for which an explanation is sought, aids in the creation of user-friendly datasets. Thus, our dataset, which we call Xnet, also contains explanations that serve different purposes: those that educate the loan applicants, and help them take appropriate action towards a future approval. We hope this work will trigger the creation of new user friendly datasets, and serve as a guide for the curation of such datasets.


page 1

page 2

page 3

page 4


Generating User-friendly Explanations for Loan Denials using GANs

Financial decisions impact our lives, and thus everyone from the regulat...

Towards an Explanation Space to Align Humans and Explainable-AI Teamwork

Providing meaningful and actionable explanations to end-users is a funda...

Alterfactual Explanations – The Relevance of Irrelevance for Explaining AI Systems

Explanation mechanisms from the field of Counterfactual Thinking are a w...

The Case Against Explainability

As artificial intelligence (AI) becomes more prevalent there is a growin...

Impact Of Explainable AI On Cognitive Load: Insights From An Empirical Study

While the emerging research field of explainable artificial intelligence...

Why X rather than Y? Explaining Neural Model' Predictions by Generating Intervention Counterfactual Samples

Even though the topic of explainable AI/ML is very popular in text and c...

Explaining decisions made with AI: A workbook (Use case 1: AI-assisted recruitment tool)

Over the last two years, The Alan Turing Institute and the Information C...

Please sign up or login with your details

Forgot password? Click here to reset