Facial Anatomical Landmark Detection using Regularized Transfer Learning with Application to Fetal Alcohol Syndrome Recognition

by   Zeyu Fu, et al.

Fetal alcohol syndrome (FAS) caused by prenatal alcohol exposure can result in a series of cranio-facial anomalies, and behavioral and neurocognitive problems. Current diagnosis of FAS is typically done by identifying a set of facial characteristics, which are often obtained by manual examination. Anatomical landmark detection, which provides rich geometric information, is important to detect the presence of FAS associated facial anomalies. This imaging application is characterized by large variations in data appearance and limited availability of labeled data. Current deep learning-based heatmap regression methods designed for facial landmark detection in natural images assume availability of large datasets and are therefore not wellsuited for this application. To address this restriction, we develop a new regularized transfer learning approach that exploits the knowledge of a network learned on large facial recognition datasets. In contrast to standard transfer learning which focuses on adjusting the pre-trained weights, the proposed learning approach regularizes the model behavior. It explicitly reuses the rich visual semantics of a domain-similar source model on the target task data as an additional supervisory signal for regularizing landmark detection optimization. Specifically, we develop four regularization constraints for the proposed transfer learning, including constraining the feature outputs from classification and intermediate layers, as well as matching activation attention maps in both spatial and channel levels. Experimental evaluation on a collected clinical imaging dataset demonstrate that the proposed approach can effectively improve model generalizability under limited training samples, and is advantageous to other approaches in the literature.


page 1

page 2

page 4

page 7

page 8


Cross-Task Representation Learning for Anatomical Landmark Detection

Recently, there is an increasing demand for automatically detecting anat...

A Transfer Learning approach to Heatmap Regression for Action Unit intensity estimation

Action Units (AUs) are geometrically-based atomic facial muscle movement...

Robust Facial Landmark Detection by Cross-order Cross-semantic Deep Network

Recently, convolutional neural networks (CNNs)-based facial landmark det...

Zoo-Tuning: Adaptive Transfer from a Zoo of Models

With the development of deep networks on various large-scale datasets, a...

Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection

Facial landmark detection is an important but challenging task for real-...

Active Transfer Learning Network: A Unified Deep Joint Spectral-Spatial Feature Learning Model For Hyperspectral Image Classification

Deep learning has recently attracted significant attention in the field ...

A Fully Automated System for Sizing Nasal PAP Masks Using Facial Photographs

We present a fully automated system for sizing nasal Positive Airway Pre...

Please sign up or login with your details

Forgot password? Click here to reset