Supervised Mixed Norm Autoencoder for Kinship Verification in Unconstrained Videos

by   Naman Kohli, et al.

Identifying kinship relations has garnered interest due to several applications such as organizing and tagging the enormous amount of videos being uploaded on the Internet. Existing research in kinship verification primarily focuses on kinship prediction with image pairs. In this research, we propose a new deep learning framework for kinship verification in unconstrained videos using a novel Supervised Mixed Norm regularization Autoencoder (SMNAE). This new autoencoder formulation introduces class-specific sparsity in the weight matrix. The proposed three-stage SMNAE based kinship verification framework utilizes the learned spatio-temporal representation in the video frames for verifying kinship in a pair of videos. A new kinship video (KIVI) database of more than 500 individuals with variations due to illumination, pose, occlusion, ethnicity, and expression is collected for this research. It comprises a total of 355 true kin video pairs with over 250,000 still frames. The effectiveness of the proposed framework is demonstrated on the KIVI database and six existing kinship databases. On the KIVI database, SMNAE yields video-based kinship verification accuracy of 83.18 algorithms. The algorithm is also evaluated on six publicly available kinship databases and compared with best-reported results. It is observed that the proposed SMNAE consistently yields best results on all the databases


page 1

page 6

page 8

page 12


Spatio-Temporal Adversarial Learning for Detecting Unseen Falls

Fall detection is an important problem from both the health and machine ...

Person Re-identification in Videos by Analyzing Spatio-Temporal Tubes

Typical person re-identification frameworks search for k best matches in...

Audio-Visual Kinship Verification

Visual kinship verification entails confirming whether or not two indivi...

Kinship Verification from Videos using Spatio-Temporal Texture Features and Deep Learning

Automatic kinship verification using facial images is a relatively new a...

Heterogeneity Aware Deep Embedding for Mobile Periocular Recognition

Mobile biometric approaches provide the convenience of secure authentica...

Hierarchical Representation Learning for Kinship Verification

Kinship verification has a number of applications such as organizing lar...

Are you eligible? Predicting adulthood from face images via class specific mean autoencoder

Predicting if a person is an adult or a minor has several applications s...

Please sign up or login with your details

Forgot password? Click here to reset