Toward Accurate and Realistic Virtual Try-on Through Shape Matching and Multiple Warps

by   Kedan Li, et al.

A virtual try-on method takes a product image and an image of a model and produces an image of the model wearing the product. Most methods essentially compute warps from the product image to the model image and combine using image generation methods. However, obtaining a realistic image is challenging because the kinematics of garments is complex and because outline, texture, and shading cues in the image reveal errors to human viewers. The garment must have appropriate drapes; texture must be warped to be consistent with the shape of a draped garment; small details (buttons, collars, lapels, pockets, etc.) must be placed appropriately on the garment, and so on. Evaluation is particularly difficult and is usually qualitative. This paper uses quantitative evaluation on a challenging, novel dataset to demonstrate that (a) for any warping method, one can choose target models automatically to improve results, and (b) learning multiple coordinated specialized warpers offers further improvements on results. Target models are chosen by a learned embedding procedure that predicts a representation of the products the model is wearing. This prediction is used to match products to models. Specialized warpers are trained by a method that encourages a second warper to perform well in locations where the first works poorly. The warps are then combined using a U-Net. Qualitative evaluation confirms that these improvements are wholesale over outline, texture shading, and garment details.


page 12

page 13


Toward Accurate and Realistic Outfits Visualization with Attention to Details

Virtual try-on methods aim to generate images of fashion models wearing ...

SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On

Image-based virtual try-on for fashion has gained considerable attention...

ClothFit: Cloth-Human-Attribute Guided Virtual Try-On Network Using 3D Simulated Dataset

Online clothing shopping has become increasingly popular, but the high r...

An Efficient Style Virtual Try on Network for Clothing Business Industry

With the increasing development of garment manufacturing industry, the m...

Learning to Transfer Texture from Clothing Images to 3D Humans

In this paper, we present a simple yet effective method to automatically...

Texturing and Deforming Meshes with Casual Images

Using (casual) images to texture 3D models is a common way to create rea...

Please sign up or login with your details

Forgot password? Click here to reset