"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction

10/02/2022
by   Sunnie S. Y. Kim, et al.
11

Despite the proliferation of explainable AI (XAI) methods, little is understood about end-users' explainability needs. This gap is critical, because end-users may have needs that XAI methods should but don't yet support. To address this gap and contribute to understanding how explainability can support human-AI interaction, we conducted a study of a real-world AI application via interviews with 20 end-users of Merlin, a bird-identification app. We found that people express a need for practically useful information that can improve their collaboration with the AI system, and intend to use XAI explanations for calibrating trust, improving their task skills, changing their behavior to supply better inputs to the AI system, and giving constructive feedback to developers. We also assessed end-users' perceptions of existing XAI approaches, finding that they prefer part-based explanations. Finally, we discuss implications of our findings and provide recommendations for future designs of XAI, specifically XAI for human-AI collaboration.

READ FULL TEXT

page 4

page 7

page 23

page 24

research
05/02/2022

Creative Uses of AI Systems and their Explanations: A Case Study from Insurance

Recent works have recognized the need for human-centered perspectives wh...
research
05/15/2023

Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Application

Trust is an important factor in people's interactions with AI systems. H...
research
02/16/2022

The Response Shift Paradigm to Quantify Human Trust in AI Recommendations

Explainability, interpretability and how much they affect human trust in...
research
01/25/2021

Predicting Workout Quality to Help Coaches Support Sportspeople

The support of a qualified coach is crucial to keep the motivation of sp...
research
07/28/2021

The Who in Explainable AI: How AI Background Shapes Perceptions of AI Explanations

Explainability of AI systems is critical for users to take informed acti...
research
09/26/2021

Explainability Pitfalls: Beyond Dark Patterns in Explainable AI

To make Explainable AI (XAI) systems trustworthy, understanding harmful ...
research
03/02/2020

A general framework for scientifically inspired explanations in AI

Explainability in AI is gaining attention in the computer science commun...

Please sign up or login with your details

Forgot password? Click here to reset