A Broader View on Bias in Automated Decision-Making: Reflecting on Epistemology and Dynamics

07/02/2018
by   Roel Dobbe, et al.
0

Machine learning (ML) is increasingly deployed in real world contexts, supplying actionable insights and forming the basis of automated decision-making systems. While issues resulting from biases pre-existing in training data have been at the center of the fairness debate, these systems are also affected by technical and emergent biases, which often arise as context-specific artifacts of implementation. This position paper interprets technical bias as an epistemological problem and emergent bias as a dynamical feedback phenomenon. In order to stimulate debate on how to change machine learning practice to effectively address these issues, we explore this broader view on bias, stress the need to reflect on epistemology, and point to value-sensitive design methodologies to revisit the design and implementation process of automated decision-making systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/10/2023

A Classification of Feedback Loops and Their Relation to Biases in Automated Decision-Making Systems

Prediction-based decision-making systems are becoming increasingly preva...
research
10/12/2020

Bridging Machine Learning and Mechanism Design towards Algorithmic Fairness

Decision-making systems increasingly orchestrate our world: how to inter...
research
11/19/2019

"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learning

Machine learning technologies are increasingly developed for use in heal...
research
05/13/2021

Addressing Fairness, Bias and Class Imbalance in Machine Learning: the FBI-loss

Resilience to class imbalance and confounding biases, together with the ...
research
11/06/2019

Designing Evaluations of Machine Learning Models for Subjective Inference: The Case of Sentence Toxicity

Machine Learning (ML) is increasingly applied in real-life scenarios, ra...
research
03/27/2013

Decision Making "Biases" and Support for Assumption-Based Higher-Order Reasoning

Unaided human decision making appears to systematically violate consiste...
research
03/06/2023

Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design

Machine learning practitioners often end up tunneling on low-level techn...

Please sign up or login with your details

Forgot password? Click here to reset