iQIYI-VID: A Large Dataset for Multi-modal Person Identification

by   Yuanliu Liu, et al.

Person identification in the wild is very challenging due to great variation in poses, face quality, clothes, makeup and so on. Traditional research, such as face recognition, person re-identification, and speaker recognition, often focuses on a single modal of information, which is inadequate to handle all the situations in practice. Multi-modal person identification is a more promising way that we can jointly utilize face, head, body, audio features, and so on. In this paper, we introduce iQIYI-VID, the largest video dataset for multi-modal person identification. It is composed of 600K video clips of 5,000 celebrities. These video clips are extracted from 400K hours of online videos of various types, ranging from movies, variety shows, TV series, to news broadcasting. All video clips pass through a careful human annotation process, and the error rate of labels is lower than 0.2 recognition, person re-identification, and speaker recognition on the iQIYI-VID dataset. Experimental results show that these models are still far from being perfect for task of person identification in the wild. We further demonstrate that a simple fusion of multi-modal features can improve person identification considerably. We have released the dataset online to promote multi-modal person identification research.


page 6

page 7


The Multi-Modal Video Reasoning and Analyzing Competition

In this paper, we introduce the Multi-Modal Video Reasoning and Analyzin...

iCartoonFace: A Benchmark of Cartoon Person Recognition

Cartoons receive increasingly attention and have a huge global market. C...

DaliID: Distortion-Adaptive Learned Invariance for Identification Models

In unconstrained scenarios, face recognition and person re-identificatio...

PURE: Passive mUlti-peRson idEntification via Deep Footstep Separation and Recognition

Recently, passive behavioral biometrics (e.g., gesture or footstep) have...

Recognizing Detailed Human Context In-the-Wild from Smartphones and Smartwatches

The ability to automatically recognize a person's behavioral context can...

Person Re-identification Attack on Wearable Sensing

Person re-identification is a critical privacy attack in publicly shared...

Hybrid Score- and Rank-level Fusion for Person Identification using Face and ECG Data

Uni-modal identification systems are vulnerable to errors in sensor data...

Please sign up or login with your details

Forgot password? Click here to reset