Deep Generative Framework for Interactive 3D Terrain Authoring and Manipulation

01/07/2022
by   Shanthika Naik, et al.
6

Automated generation and (user) authoring of the realistic virtual terrain is most sought for by the multimedia applications like VR models and gaming. The most common representation adopted for terrain is Digital Elevation Model (DEM). Existing terrain authoring and modeling techniques have addressed some of these and can be broadly categorized as: procedural modeling, simulation method, and example-based methods. In this paper, we propose a novel realistic terrain authoring framework powered by a combination of VAE and generative conditional GAN model. Our framework is an example-based method that attempts to overcome the limitations of existing methods by learning a latent space from a real-world terrain dataset. This latent space allows us to generate multiple variants of terrain from a single input as well as interpolate between terrains while keeping the generated terrains close to real-world data distribution. We also developed an interactive tool, that lets the user generate diverse terrains with minimalist inputs. We perform thorough qualitative and quantitative analysis and provide comparisons with other SOTA methods. We intend to release our code/tool to the academic community.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

page 8

research
07/28/2022

Rewriting Geometric Rules of a GAN

Deep generative models make visual content creation more accessible to n...
research
10/12/2022

ControlVAE: Model-Based Learning of Generative Controllers for Physics-Based Characters

In this paper, we introduce ControlVAE, a novel model-based framework fo...
research
05/24/2023

A Deep Generative Model for Interactive Data Annotation through Direct Manipulation in Latent Space

The impact of machine learning (ML) in many fields of application is con...
research
11/15/2017

Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models

Deep generative neural networks have proven effective at both conditiona...
research
07/02/2021

RMQFMU: Bridging the Real World with Co-simulation Technical Report

In this paper we present an experience report for the RMQFMU, a plug and...
research
08/02/2018

Generation Meets Recommendation: Proposing Novel Items for Groups of Users

Consider a movie studio aiming to produce a set of new movies for summer...
research
06/24/2019

Interactive Subspace Exploration on Generative Image Modelling

Generative image modeling techniques such as GAN demonstrate highly conv...

Please sign up or login with your details

Forgot password? Click here to reset