Cloning Outfits from Real-World Images to 3D Characters for Generalizable Person Re-Identification

by   Yanan Wang, et al.

Recently, large-scale synthetic datasets are shown to be very useful for generalizable person re-identification. However, synthesized persons in existing datasets are mostly cartoon-like and in random dress collocation, which limits their performance. To address this, in this work, an automatic approach is proposed to directly clone the whole outfits from real-world person images to virtual 3D characters, such that any virtual person thus created will appear very similar to its real-world counterpart. Specifically, based on UV texture mapping, two cloning methods are designed, namely registered clothes mapping and homogeneous cloth expansion. Given clothes keypoints detected on person images and labeled on regular UV maps with clear clothes structures, registered mapping applies perspective homography to warp real-world clothes to the counterparts on the UV map. As for invisible clothes parts and irregular UV maps, homogeneous expansion segments a homogeneous area on clothes as a realistic cloth pattern or cell, and expand the cell to fill the UV map. Furthermore, a similarity-diversity expansion strategy is proposed, by clustering person images, sampling images per cluster, and cloning outfits for 3D character generation. This way, virtual persons can be scaled up densely in visual similarity to challenge model learning, and diversely in population to enrich sample distribution. Finally, by rendering the cloned characters in Unity3D scenes, a more realistic virtual dataset called ClonedPerson is created, with 5,621 identities and 887,766 images. Experimental results show that the model trained on ClonedPerson has a better generalization performance, superior to that trained on other popular real-world and synthetic person re-identification datasets. The ClonedPerson project is available at


page 5

page 13

page 14

page 15

page 16

page 18

page 19

page 20


Surpassing Real-World Source Training Data: Random 3D Characters for Generalizable Person Re-Identification

Person re-identification has seen significant advancement in recent year...

Retrieve Anyone: A General-purpose Person Re-identification Task with Instructions

Human intelligence can retrieve any person according to both visual and ...

DomainMix: Learning Generalizable Person Re-Identification Without Human Annotations

Existing person re-identification methods often have low generalization ...

TAGPerson: A Target-Aware Generation Pipeline for Person Re-identification

Nowadays, real data in person re-identification (ReID) task is facing pr...

Is Synthetic Dataset Reliable for Benchmarking Generalizable Person Re-Identification?

Recent studies show that models trained on synthetic datasets are able t...

Towards better Validity: Dispersion based Clustering for Unsupervised Person Re-identification

Person re-identification aims to establish the correct identity correspo...

Collaborative Neural Rendering using Anime Character Sheets

Drawing images of characters at desired poses is an essential but labori...

Please sign up or login with your details

Forgot password? Click here to reset