Compact Scene Graphs for Layout Composition and Patch Retrieval

by   Subarna Tripathi, et al.

Structured representations such as scene graphs serve as an efficient and compact representation that can be used for downstream rendering or retrieval tasks. However, existing efforts to generate realistic images from scene graphs perform poorly on scene composition for cluttered or complex scenes. We propose two contributions to improve the scene composition. First, we enhance the scene graph representation with heuristic-based relations, which add minimal storage overhead. Second, we use extreme points representation to supervise the learning of the scene composition network. These methods achieve significantly higher performance over existing work (69.0 metric). We additionally demonstrate how scene graphs can be used to retrieve pose-constrained image patches that are semantically similar to the source query. Improving structured scene graph representations for rendering or retrieval is an important step towards realistic image generation.


page 4

page 6

page 7


Unconditional Scene Graph Generation

Despite recent advancements in single-domain or single-object image gene...

Learning Canonical Representations for Scene Graph to Image Generation

Generating realistic images of complex visual scenes becomes very challe...

Using Scene Graph Context to Improve Image Generation

Generating realistic images from scene graphs asks neural networks to be...

Triplet-Aware Scene Graph Embeddings

Scene graphs have become an important form of structured knowledge for t...

Modeling Photographic Composition via Triangles

The capacity of automatically modeling photographic composition is valua...

Searching Scenes by Abstracting Things

In this paper we propose to represent a scene as an abstraction of 'thin...

Efficient Scene Compression for Visual-based Localization

Estimating the pose of a camera with respect to a 3D reconstruction or s...

Please sign up or login with your details

Forgot password? Click here to reset