Learning a Neural 3D Texture Space from 2D Exemplars

12/09/2019
by   Philipp Henzler, et al.
13

We propose a generative model of 2D and 3D natural textures with diversity, visual fidelity and at high computational efficiency. This is enabled by a family of methods that extend ideas from classic stochastic procedural texturing (Perlin noise) to learned, deep, non-linearities. The key idea is a hard-coded, tunable and differentiable step that feeds multiple transformed random 2D or 3D fields into an MLP that can be sampled over infinite domains. Our model encodes all exemplars from a diverse set of textures without a need to be re-trained for each exemplar. Applications include texture interpolation, and learning 3D textures from 2D exemplars.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 9

research
10/16/2018

A Generative Model of Textures Using Hierarchical Probabilistic Principal Component Analysis

Modeling of textures in natural images is an important task to make a mi...
research
07/09/2015

Deep filter banks for texture recognition, description, and segmentation

Visual textures have played a key role in image understanding because th...
research
10/08/2015

Texture Modelling with Nested High-order Markov-Gibbs Random Fields

Currently, Markov-Gibbs random field (MGRF) image models which include h...
research
11/18/2019

Learning to Synthesize Fashion Textures

Existing unconditional generative models mainly focus on modeling genera...
research
05/26/2023

Random-Access Neural Compression of Material Textures

The continuous advancement of photorealism in rendering is accompanied b...
research
11/02/2016

Bayesian Modeling of Motion Perception using Dynamical Stochastic Textures

A common practice to account for psychophysical biases in vision is to f...
research
09/06/2023

Data Embroidery with Black-and-White Textures

We investigated data embroidery with black-and-white textures, identifyi...

Please sign up or login with your details

Forgot password? Click here to reset