Focused LRP: Explainable AI for Face Morphing Attack Detection

by   Clemens Seibold, et al.

The task of detecting morphed face images has become highly relevant in recent years to ensure the security of automatic verification systems based on facial images, e.g. automated border control gates. Detection methods based on Deep Neural Networks (DNN) have been shown to be very suitable to this end. However, they do not provide transparency in the decision making and it is not clear how they distinguish between genuine and morphed face images. This is particularly relevant for systems intended to assist a human operator, who should be able to understand the reasoning. In this paper, we tackle this problem and present Focused Layer-wise Relevance Propagation (FLRP). This framework explains to a human inspector on a precise pixel level, which image regions are used by a Deep Neural Network to distinguish between a genuine and a morphed face image. Additionally, we propose another framework to objectively analyze the quality of our method and compare FLRP to other DNN interpretability methods. This evaluation framework is based on removing detected artifacts and analyzing the influence of these changes on the decision of the DNN. Especially, if the DNN is uncertain in its decision or even incorrect, FLRP performs much better in highlighting visible artifacts compared to other methods.


page 2

page 3

page 5

page 6

page 7

page 8


FSNet: An Identity-Aware Generative Model for Image-based Face Swapping

This paper presents FSNet, a deep generative model for image-based face ...

Style Your Face Morph and Improve Your Face Morphing Attack Detector

A morphed face image is a synthetically created image that looks so simi...

Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations

In recent years, increasing deployment of face recognition technology in...

Predicting and visualizing psychological attributions with a deep neural network

Judgments about personality based on facial appearance are strong effect...

Attention Aware Wavelet-based Detection of Morphed Face Images

Morphed images have exploited loopholes in the face recognition checkpoi...

Canonical Saliency Maps: Decoding Deep Face Models

As Deep Neural Network models for face processing tasks approach human-l...

Finding Facial Forgery Artifacts with Parts-Based Detectors

Manipulated videos, especially those where the identity of an individual...

Please sign up or login with your details

Forgot password? Click here to reset