A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare

by   Devansh Saxena, et al.

Algorithms have permeated throughout civil government and society, where they are being used to make high-stakes decisions about human lives. In this paper, we first develop a cohesive framework of algorithmic decision-making adapted for the public sector (ADMAPS) that reflects the complex socio-technical interactions between human discretion, bureaucratic processes, and algorithmic decision-making by synthesizing disparate bodies of work in the fields of Human-Computer Interaction (HCI), Science and Technology Studies (STS), and Public Administration (PA). We then applied the ADMAPS framework to conduct a qualitative analysis of an in-depth, eight-month ethnographic case study of the algorithms in daily use within a child-welfare agency that serves approximately 900 families and 1300 children in the mid-western United States. Overall, we found there is a need to focus on strength-based algorithmic outcomes centered in social ecological frameworks. In addition, algorithmic systems need to support existing bureaucratic processes and augment human discretion, rather than replace it. Finally, collective buy-in in algorithmic systems requires trust in the target outcomes at both the practitioner and bureaucratic levels. As a result of our study, we propose guidelines for the design of high-stakes algorithmic decision-making tools in the child-welfare system, and more generally, in the public sector. We empirically validate the theoretically derived ADMAPS framework to demonstrate how it can be useful for systematically making pragmatic decisions about the design of algorithms for the public sector.


page 5

page 24


Algorithmic Harms in Child Welfare: Uncertainties in Practice, Organization, and Street-level Decision-Making

Algorithms in public services such as child welfare, criminal justice, a...

A Human-Centered Review of the Algorithms used within the U.S. Child Welfare System

The U.S. Child Welfare System (CWS) is charged with improving outcomes f...

Algorithmic risk assessments can alter human decision-making processes in high-stakes government contexts

Governments are increasingly turning to algorithmic risk assessments whe...

Governance and Communication of Algorithmic Decision Making: A Case Study on Public Sector

Algorithmic Decision Making (ADM) has permeated all aspects of society. ...

Algorithmic Monoculture and Social Welfare

As algorithms are increasingly applied to screen applicants for high-sta...

The Flaws of Policies Requiring Human Oversight of Government Algorithms

Policymakers around the world are increasingly considering how to preven...

A Conceptual Framework for Using Machine Learning to Support Child Welfare Decisions

Human services systems make key decisions that impact individuals in the...

Please sign up or login with your details

Forgot password? Click here to reset