Using Soft Constraints To Learn Semantic Models Of Descriptions Of Shapes

05/28/2010
by   Sergio Guadarrama, et al.
0

The contribution of this paper is to provide a semantic model (using soft constraints) of the words used by web-users to describe objects in a language game; a game in which one user describes a selected object of those composing the scene, and another user has to guess which object has been described. The given description needs to be non ambiguous and accurate enough to allow other users to guess the described shape correctly. To build these semantic models the descriptions need to be analyzed to extract the syntax and words' classes used. We have modeled the meaning of these descriptions using soft constraints as a way for grounding the meaning. The descriptions generated by the system took into account the context of the object to avoid ambiguous descriptions, and allowed users to guess the described object correctly 72

READ FULL TEXT

page 1

page 5

page 6

page 7

research
08/16/2018

Sememe Prediction: Learning Semantic Knowledge from Unstructured Textual Wiki Descriptions

Huge numbers of new words emerge every day, leading to a great need for ...
research
11/09/2022

Understanding Cross-modal Interactions in V L Models that Generate Scene Descriptions

Image captioning models tend to describe images in an object-centric way...
research
09/15/2021

What Vision-Language Models `See' when they See Scenes

Images can be described in terms of the objects they contain, or in term...
research
01/06/2022

Incremental Object Grounding Using Scene Graphs

Object grounding tasks aim to locate the target object in an image throu...
research
07/24/2023

Exposing the Troublemakers in Described Object Detection

Detecting objects based on language descriptions is a popular task that ...
research
07/12/2021

Leveraging Explainability for Comprehending Referring Expressions in the Real World

For effective human-robot collaboration, it is crucial for robots to und...
research
09/09/2019

General Fragment Model for Information Artifacts

The use of semantic descriptions in data intensive domains require a sys...

Please sign up or login with your details

Forgot password? Click here to reset