Audits as Evidence: Experiments, Ensembles, and Enforcement

07/15/2019
by   Patrick Kline, et al.
0

We develop tools for utilizing correspondence experiments to detect illegal discrimination by individual employers. Employers violate US employment law if their propensity to contact applicants depends on protected characteristics such as race or sex. We establish identification of higher moments of the causal effects of protected characteristics on callback rates as a function of the number of fictitious applications sent to each job ad. These moments are used to bound the fraction of jobs that illegally discriminate. Applying our results to three experimental datasets, we find evidence of significant employer heterogeneity in discriminatory behavior, with the standard deviation of gaps in job-specific callback probabilities across protected groups averaging roughly twice the mean gap. In a recent experiment manipulating racially distinctive names, we estimate that at least 85 both of two white applications and neither of two black applications are engaged in illegal discrimination. To assess the tradeoff between type I and II errors presented by these patterns, we consider the performance of a series of decision rules for investigating suspicious callback behavior under a simple two-type model that rationalizes the experimental data. Though, in our preferred specification, only 17 the basis of race, we find that an experiment sending 10 applications to each job would enable accurate detection of 7-10 accusing fewer than 0.2 acknowledging partial identification of the joint distribution of callback rates yields higher error rates but more investigations than our baseline two-type model. Our results suggest illegal labor market discrimination can be reliably monitored with relatively small modifications to existing audit designs.

READ FULL TEXT

page 39

page 40

page 41

research
04/09/2021

Auditing for Discrimination in Algorithms Delivering Job Ads

Ad platforms such as Facebook, Google and LinkedIn promise value for adv...
research
06/13/2023

Discrimination through Image Selection by Job Advertisers on Facebook

Targeted advertising platforms are widely used by job advertisers to rea...
research
10/02/2015

Exposing the Probabilistic Causal Structure of Discrimination

Discrimination discovery from data is an important task aiming at identi...
research
06/22/2023

A Discrimination Report Card

We develop an Empirical Bayes grading scheme that balances the informati...
research
07/06/2022

A multi-task network approach for calculating discrimination-free insurance prices

In applications of predictive modeling, such as insurance pricing, indir...
research
09/10/2018

Automated Test Generation to Detect Individual Discrimination in AI Models

Dependability on AI models is of utmost importance to ensure full accept...
research
05/24/2021

De-identification of Privacy-related Entities in Job Postings

De-identification is the task of detecting privacy-related entities in t...

Please sign up or login with your details

Forgot password? Click here to reset