Clustering of the Blendshape Facial Model

10/05/2021
by   Stevo Rackovic, et al.
0

Digital human animation relies on high-quality 3D models of the human face – rigs. A face rig must be accurate and, at the same time, fast to compute. One of the most common rigging models is the blendshape model. We present a novel approach for learning the inverse rig parameters at increased accuracy and decreased computational cost at the same time. It is based on a two-fold clustering of the blendshape face model. Our method focuses exclusively on the underlying space of deformation and produces clusters in both the mesh space and the controller space – something that was not investigated in previous literature. This segmentation finds intuitive and meaningful connections between groups of vertices on the face and deformation controls, and further these segments can be observed independently. A separate model for solving the inverse rig problem is then learned for each segment. Our method is completely unsupervised and highly parallelizable.

READ FULL TEXT
research
09/17/2021

Accurate, Interpretable, and Fast Animation: An Iterative, Sparse, and Nonconvex Approach

Digital human animation relies on high-quality 3D models of the human fa...
research
06/02/2020

Accurate Face Rig Approximation with Deep Differential Subspace Reconstruction

To be suitable for film-quality animation, rigs for character deformatio...
research
05/31/2021

Learning Free-Form Deformation for 3D Face Reconstruction from In-The-Wild Images

The 3D Morphable Model (3DMM), which is a Principal Component Analysis (...
research
03/15/2021

3DCaricShop: A Dataset and A Baseline Method for Single-view 3D Caricature Face Reconstruction

Caricature is an artistic representation that deliberately exaggerates t...
research
09/06/2020

DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation

We present a novel approach to the garment animation problem through dee...
research
03/19/2018

Alive Caricature from 2D to 3D

Caricature is an art form that expresses subjects in abstract, simple an...
research
02/09/2023

Accurate and Interpretable Solution of the Inverse Rig for Realistic Blendshape Models with Quadratic Corrective Terms

We propose a new model-based algorithm solving the inverse rig problem i...

Please sign up or login with your details

Forgot password? Click here to reset