A Survey on Bias in Visual Datasets

by   Simone Fabbrizzi, et al.

Computer Vision (CV) has achieved remarkable results, outperforming humans in several tasks. Nonetheless, it may result in major discrimination if not dealt with proper care. CV systems highly depend on the data they are fed with and can learn and amplify biases within such data. Thus, both the problems of understanding and discovering biases are of utmost importance. Yet, to date there is no comprehensive survey on bias in visual datasets. To this end, this work aims to: i) describe the biases that can affect visual datasets; ii) review the literature on methods for bias discovery and quantification in visual datasets; iii) discuss existing attempts to collect bias-aware visual datasets. A key conclusion of our study is that the problem of bias discovery and quantification in visual datasets is still open and there is room for improvement in terms of both methods and the range of biases that can be addressed; moreover, there is no such thing as a bias-free dataset, so scientists and practitioners must become aware of the biases in their datasets and make them explicit. To this end, we propose a checklist that can be used to spot different types of bias during visual dataset collection.


page 3

page 5


Learning visual biases from human imagination

Although the human visual system can recognize many concepts under chall...

Proceedings of the KG-BIAS Workshop 2020 at AKBC 2020

The KG-BIAS 2020 workshop touches on biases and how they surface in know...

Bias in Conversational Search: The Double-Edged Sword of the Personalized Knowledge Graph

Conversational AI systems are being used in personal devices, providing ...

Implicit Biases in Refereeing: Lessons from NBA Referees

Implicit biases occur automatically and unintentionally and are particul...

Bias in Machine Learning What is it Good (and Bad) for?

In public media as well as in scientific publications, the term bias is ...

FairVis: Visual Analytics for Discovering Intersectional Bias in Machine Learning

The growing capability and accessibility of machine learning has led to ...

Racial Bias in the Beautyverse

This short paper proposes a preliminary and yet insightful investigation...

Please sign up or login with your details

Forgot password? Click here to reset