research
∙
07/05/2023
Evaluating AI systems under uncertain ground truth: a case study in dermatology
For safety, AI systems in health undergo thorough evaluations before dep...
share
research
∙
12/04/2021
In Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workers
We propose a novel three-stage FIND-RESOLVE-LABEL workflow for crowdsour...
research
∙
11/29/2021
Proceedings of the CSCW 2021 Workshop – Investigating and Mitigating Biases in Crowdsourced Data
This volume contains the position papers presented at CSCW 2021 Workshop...
research
∙
11/19/2021
Data Excellence for AI: Why Should You Care
The efficacy of machine learning (ML) models depends on both algorithms ...
research
∙
05/20/2021
The Challenge of Variable Effort Crowdsourcing and How Visible Gold Can Help
We consider a class of variable effort human annotation tasks in which t...
research
∙
12/21/2018