Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning

by   Krzysztof Z. Gajos, et al.

When people receive advice while making difficult decisions, they often make better decisions in the moment and also increase their knowledge in the process. However, such incidental learning can only occur when people cognitively engage with the information they receive and process this information thoughtfully. How do people process the information and advice they receive from AI, and do they engage with it deeply enough to enable learning? To answer these questions, we conducted three experiments in which individuals were asked to make nutritional decisions and received simulated AI recommendations and explanations. In the first experiment, we found that when people were presented with both a recommendation and an explanation before making their choice, they made better decisions than they did when they received no such help, but they did not learn. In the second experiment, participants first made their own choice, and only then saw a recommendation and an explanation from AI; this condition also resulted in improved decisions, but no learning. However, in our third experiment, participants were presented with just an AI explanation but no recommendation and had to arrive at their own decision. This condition led to both more accurate decisions and learning gains. We hypothesize that learning gains in this condition were due to deeper engagement with explanations needed to arrive at the decisions. This work provides some of the most direct evidence to date that it may not be sufficient to include explanations together with AI-generated recommendation to ensure that people engage carefully with the AI-provided information. This work also presents one technique that enables incidental learning and, by implication, can help people process AI recommendations and explanations more carefully.


page 4

page 7

page 8

page 9

page 10


Evidence-based explanation to promote fairness in AI systems

As Artificial Intelligence (AI) technology gets more intertwined with ev...

Why Change My Design: Explaining Poorly Constructed Visualization Designs with Explorable Explanations

Although visualization tools are widely available and accessible, not ev...

On the Relationship Between Explanations, Fairness Perceptions, and Decisions

It is known that recommendations of AI-based systems can be incorrect or...

Deceptive AI Systems That Give Explanations Are Just as Convincing as Honest AI Systems in Human-Machine Decision Making

The ability to discern between true and false information is essential t...

Explaining Explanations in AI

Recent work on interpretability in machine learning and AI has focused o...

Explaining decisions made with AI: A workbook (Use case 1: AI-assisted recruitment tool)

Over the last two years, The Alan Turing Institute and the Information C...

From Explanation to Recommendation: Ethical Standards for Algorithmic Recourse

People are increasingly subject to algorithmic decisions, and it is gene...

Please sign up or login with your details

Forgot password? Click here to reset