Selfie Detection by Synergy-Constraint Based Convolutional Neural Network

by   Yashas Annadani, et al.

Categorisation of huge amount of data on the multimedia platform is a crucial task. In this work, we propose a novel approach to address the subtle problem of selfie detection for image database segregation on the web, given rapid rise in number of selfies clicked. A Convolutional Neural Network (CNN) is modeled to learn a synergy feature in the common subspace of head and shoulder orientation, derived from Local Binary Pattern (LBP) and Histogram of Oriented Gradients (HOG) features respectively. This synergy was captured by projecting the aforementioned features using Canonical Correlation Analysis (CCA). We show that the resulting network's convolutional activations in the neighbourhood of spatial keypoints captured by SIFT are discriminative for selfie-detection. In general, proposed approach aids in capturing intricacies present in the image data and has the potential for usage in other subtle image analysis scenarios apart from just selfie detection. We investigate and analyse the performance of popular CNN architectures (GoogleNet, AlexNet), used for other image classification tasks, when subjected to the task of detecting the selfies on the multimedia platform. The results of the proposed approach are compared with these popular architectures on a dataset of ninety thousand images comprising of roughly equal number of selfies and non-selfies. Experimental results on this dataset shows the effectiveness of the proposed approach.


page 1

page 2

page 4

page 6

page 7


Non-image Data Classification with Convolutional Neural Networks

Convolutional Neural Networks (CNNs) is one of the most popular algorith...

Convolutional Neural Network Steganalysis's Application to Steganography

This paper presents a novel approach to increase the performance bounds ...

High dynamic range image forensics using cnn

High dynamic range (HDR) imaging has recently drawn much attention in mu...

Micro-Facial Expression Recognition in Video Based on Optimal Convolutional Neural Network (MFEOCNN) Algorithm

Facial expression is a standout amongst the most imperative features of ...

Automatic Chronic Degenerative Diseases Identification Using Enteric Nervous System Images

Studies recently accomplished on the Enteric Nervous System have shown t...

SA-CNN: Dynamic Scene Classification using Convolutional Neural Networks

The task of classifying videos of natural dynamic scenes into appropriat...

Estimating Grape Yield on the Vine from Multiple Images

Estimating grape yield prior to harvest is important to commercial viney...

Please sign up or login with your details

Forgot password? Click here to reset