TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates

04/07/2022
by   You Xie, et al.
0

We propose a novel approach to generate temporally coherent UV coordinates for loose clothing. Our method is not constrained by human body outlines and can capture loose garments and hair. We implemented a differentiable pipeline to learn UV mapping between a sequence of RGB inputs and textures via UV coordinates. Instead of treating the UV coordinates of each frame separately, our data generation approach connects all UV coordinates via feature matching for temporal stability. Subsequently, a generative model is trained to balance the spatial quality and temporal stability. It is driven by supervised and unsupervised losses in both UV and image spaces. Our experiments show that the trained models output high-quality UV coordinates and generalize to new poses. Once a sequence of UV coordinates has been inferred by our model, it can be used to flexibly synthesize new looks and modified visual styles. Compared to existing methods, our approach reduces the computational workload to animate new outfits by several orders of magnitude.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 8

page 12

page 15

page 16

research
12/07/2020

Pose-Guided Human Animation from a Single Image in the Wild

We present a new pose transfer method for synthesizing a human animation...
research
12/02/2022

ClipFace: Text-guided Editing of Textured 3D Morphable Models

We propose ClipFace, a novel self-supervised approach for text-guided ed...
research
12/02/2019

Spatially and Temporally Coherent Visual Summaries

When exploring large time-varying data sets, visual summaries are a usef...
research
01/13/2020

On Demand Solid Texture Synthesis Using Deep 3D Networks

This paper describes a novel approach for on demand volumetric texture s...
research
08/17/2023

Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Prediction

Exploring spatial-temporal dependencies from observed motions is one of ...
research
01/29/2018

tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow

We propose a temporally coherent generative model addressing the super-r...

Please sign up or login with your details

Forgot password? Click here to reset