DeepAI AI Chat
Log In Sign Up

"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction

by   Sunnie S. Y. Kim, et al.

Despite the proliferation of explainable AI (XAI) methods, little is understood about end-users' explainability needs. This gap is critical, because end-users may have needs that XAI methods should but don't yet support. To address this gap and contribute to understanding how explainability can support human-AI interaction, we conducted a study of a real-world AI application via interviews with 20 end-users of Merlin, a bird-identification app. We found that people express a need for practically useful information that can improve their collaboration with the AI system, and intend to use XAI explanations for calibrating trust, improving their task skills, changing their behavior to supply better inputs to the AI system, and giving constructive feedback to developers. We also assessed end-users' perceptions of existing XAI approaches, finding that they prefer part-based explanations. Finally, we discuss implications of our findings and provide recommendations for future designs of XAI, specifically XAI for human-AI collaboration.


page 4

page 7

page 23

page 24


Creative Uses of AI Systems and their Explanations: A Case Study from Insurance

Recent works have recognized the need for human-centered perspectives wh...

Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Application

Trust is an important factor in people's interactions with AI systems. H...

The Response Shift Paradigm to Quantify Human Trust in AI Recommendations

Explainability, interpretability and how much they affect human trust in...

Predicting Workout Quality to Help Coaches Support Sportspeople

The support of a qualified coach is crucial to keep the motivation of sp...

The Who in Explainable AI: How AI Background Shapes Perceptions of AI Explanations

Explainability of AI systems is critical for users to take informed acti...

Explainability Pitfalls: Beyond Dark Patterns in Explainable AI

To make Explainable AI (XAI) systems trustworthy, understanding harmful ...

A general framework for scientifically inspired explanations in AI

Explainability in AI is gaining attention in the computer science commun...