DeepAI AI Chat
Log In Sign Up

On Demand Solid Texture Synthesis Using Deep 3D Networks

by   Jorge Gutierrez, et al.

This paper describes a novel approach for on demand volumetric texture synthesis based on a deep learning framework that allows for the generation of high quality 3D data at interactive rates. Based on a few example images of textures, a generative network is trained to synthesize coherent portions of solid textures of arbitrary sizes that reproduce the visual characteristics of the examples along some directions. To cope with memory limitations and computation complexity that are inherent to both high resolution and 3D processing on the GPU, only 2D textures referred to as "slices" are generated during the training stage. These synthetic textures are compared to exemplar images via a perceptual loss function based on a pre-trained deep network. The proposed network is very light (less than 100k parameters), therefore it only requires sustainable training (i.e. few hours) and is capable of very fast generation (around a second for 256^3 voxels) on a single GPU. Integrated with a spatially seeded PRNG the proposed generator network directly returns an RGB value given a set of 3D coordinates. The synthesized volumes have good visual results that are at least equivalent to the state-of-the-art patch based approaches. They are naturally seamlessly tileable and can be fully generated in parallel.


page 9

page 10

page 11

page 13

page 15

page 16

page 17

page 18


Perception Driven Texture Generation

This paper investigates a novel task of generating texture images from p...

TextureGAN: Controlling Deep Image Synthesis with Texture Patches

In this paper, we investigate deep image synthesis guided by sketch, col...

Deep Tiling: Texture Tile Synthesis Using a Deep Learning Approach

Texturing is a fundamental process in computer graphics. Texture is leve...

Non-Stationary Texture Synthesis by Adversarial Expansion

The real world exhibits an abundance of non-stationary textures. Example...

TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates

We propose a novel approach to generate temporally coherent UV coordinat...

SeamlessGAN: Self-Supervised Synthesis of Tileable Texture Maps

We present SeamlessGAN, a method capable of automatically generating til...

Creating Simplified 3D Models with High Quality Textures

This paper presents an extension to the KinectFusion algorithm which all...