A Comprehensive Study on Face Recognition Biases Beyond Demographics

by   Philipp Terhörst, et al.

Face recognition (FR) systems have a growing effect on critical decision-making processes. Recent works have shown that FR solutions show strong performance differences based on the user's demographics. However, to enable a trustworthy FR technology, it is essential to know the influence of an extended range of facial attributes on FR beyond demographics. Therefore, in this work, we analyse FR bias over a wide range of attributes. We investigate the influence of 47 attributes on the verification performance of two popular FR models. The experiments were performed on the publicly available MAADFace attribute database with over 120M high-quality attribute annotations. To prevent misleading statements about biased performances, we introduced control group based validity values to decide if unbalanced test data causes the performance differences. The results demonstrate that also many non-demographic attributes strongly affect the recognition performance, such as accessories, hair-styles and colors, face shapes, or facial anomalies. The observations of this work show the strong need for further advances in making FR system more robust, explainable, and fair. Moreover, our findings might help to a better understanding of how FR networks work, to enhance the robustness of these networks, and to develop more generalized bias-mitigating face recognition solutions.


page 1

page 4

page 7

page 8

page 9

page 10

page 11


Can GAN-induced Attribute Manipulations Impact Face Recognition?

Impact due to demographic factors such as age, sex, race, etc., has been...

Beyond Identity: What Information Is Stored in Biometric Face Templates?

Deeply-learned face representations enable the success of current face r...

Measuring Hidden Bias within Face Recognition via Racial Phenotypes

Recent work reports disparate performance for intersectional racial grou...

A Comprehensive Analysis of AI Biases in DeepFake Detection With Massively Annotated Databases

In recent years, image and video manipulations with DeepFake have become...

MAAD-Face: A Massively Annotated Attribute Dataset for Face Images

Soft-biometrics play an important role in face biometrics and related fi...

Post-Comparison Mitigation of Demographic Bias in Face Recognition Using Fair Score Normalization

Current face recognition systems achieved high progress on several bench...

Explainable Model-Agnostic Similarity and Confidence in Face Verification

Recently, face recognition systems have demonstrated remarkable performa...

Please sign up or login with your details

Forgot password? Click here to reset