Automatic Measures for Evaluating Generative Design Methods for Architects

03/20/2023
by   Eric Yeh, et al.
0

The recent explosion of high-quality image-to-image methods has prompted interest in applying image-to-image methods towards artistic and design tasks. Of interest for architects is to use these methods to generate design proposals from conceptual sketches, usually hand-drawn sketches that are quickly developed and can embody a design intent. More specifically, instantiating a sketch into a visual that can be used to elicit client feedback is typically a time consuming task, and being able to speed up this iteration time is important. While the body of work in generative methods has been impressive, there has been a mismatch between the quality measures used to evaluate the outputs of these systems and the actual expectations of architects. In particular, most recent image-based works place an emphasis on realism of generated images. While important, this is one of several criteria architects look for. In this work, we describe the expectations architects have for design proposals from conceptual sketches, and identify corresponding automated metrics from the literature. We then evaluate several image-to-image generative methods that may address these criteria and examine their performance across these metrics. From these results, we identify certain challenges with hand-drawn conceptual sketches and describe possible future avenues of investigation to address them.

READ FULL TEXT

page 1

page 3

page 4

research
01/15/2020

CDGAN: Cyclic Discriminative Generative Adversarial Networks for Image-to-Image Transformation

Image-to-image transformation is a kind of problem, where the input imag...
research
03/22/2023

Evaluation of Sketch-Based and Semantic-Based Modalities for Mockup Generation

Design mockups are essential instruments for visualizing and testing des...
research
10/26/2022

Towards the Detection of Diffusion Model Deepfakes

Diffusion models (DMs) have recently emerged as a promising method in im...
research
04/18/2019

Generative Model for Zero-Shot Sketch-Based Image Retrieval

We present a probabilistic model for Sketch-Based Image Retrieval (SBIR)...
research
11/28/2022

What's Behind the Mask: Estimating Uncertainty in Image-to-Image Problems

Estimating uncertainty in image-to-image networks is an important task, ...

Please sign up or login with your details

Forgot password? Click here to reset