Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Application

05/15/2023
by   Sunnie S. Y. Kim, et al.
0

Trust is an important factor in people's interactions with AI systems. However, there is a lack of empirical studies examining how real end-users trust or distrust the AI system they interact with. Most research investigates one aspect of trust in lab settings with hypothetical end-users. In this paper, we provide a holistic and nuanced understanding of trust in AI through a qualitative case study of a real-world computer vision application. We report findings from interviews with 20 end-users of a popular, AI-based bird identification app where we inquired about their trust in the app from many angles. We find participants perceived the app as trustworthy and trusted it, but selectively accepted app outputs after engaging in verification behaviors, and decided against app adoption in certain high-stakes scenarios. We also find domain knowledge and context are important factors for trust-related assessment and decision-making. We discuss the implications of our findings and provide recommendations for future research on trust in AI.

READ FULL TEXT
research
10/02/2022

"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction

Despite the proliferation of explainable AI (XAI) methods, little is und...
research
11/29/2022

Holding AI to Account: Challenges for the Delivery of Trustworthy AI in Healthcare

The need for AI systems to provide explanations for their behaviour is n...
research
05/15/2023

Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study

Auditing plays a pivotal role in the development of trustworthy AI. Howe...
research
01/16/2023

Stuck in the Permissions With You: Developer End-User Perspectives on App Permissions Their Privacy Ramifications

While the literature on permissions from the end-user perspective is ric...
research
05/29/2019

Food for thought: Ethical considerations of user trust in computer vision

In computer vision research, especially when novel applications of tools...
research
01/29/2021

Disparate Impact Diminishes Consumer Trust Even for Advantaged Users

Systems aiming to aid consumers in their decision-making (e.g., by imple...
research
05/16/2021

Computer-Mediated Consent to Sex: The Context of Tinder

This paper reports an interview study about how consent to sexual activi...

Please sign up or login with your details

Forgot password? Click here to reset