Generating Simulations of Motion Events from Verbal Descriptions

10/06/2016
by   James Pustejovsky, et al.
0

In this paper, we describe a computational model for motion events in natural language that maps from linguistic expressions, through a dynamic event interpretation, into three-dimensional temporal simulations in a model. Starting with the model from (Pustejovsky and Moszkowicz, 2011), we analyze motion events using temporally-traced Labelled Transition Systems. We model the distinction between path- and manner-motion in an operational semantics, and further distinguish different types of manner-of-motion verbs in terms of the mereo-topological relations that hold throughout the process of movement. From these representations, we generate minimal models, which are realized as three-dimensional simulations in software developed with the game engine, Unity. The generated simulations act as a conceptual "debugger" for the semantics of different motion verbs: that is, by testing for consistency and informativeness in the model, simulations expose the presuppositions associated with linguistic expressions and their compositions. Because the model generation component is still incomplete, this paper focuses on an implementation which maps directly from linguistic interpretations into the Unity code snippets that create the simulations.

READ FULL TEXT

page 7

page 8

research
10/03/2016

Multimodal Semantic Simulations of Linguistically Underspecified Motion Events

In this paper, we describe a system for generating three-dimensional vis...
research
06/01/2011

Grounding the Lexical Semantics of Verbs in Visual Perception using Force Dynamics and Event Logic

This paper presents an implemented system for recognizing the occurrence...
research
07/15/2023

Three-way Decisions with Evaluative Linguistic Expressions

We propose a linguistic interpretation of three-way decisions, where the...
research
01/31/2020

Modeling Events and Events of Events in Software Engineering

A model is a simplified representation of portion of reality that hides ...
research
07/07/2023

ConStaBL – A Fresh Look at Software Engineering with State Machines

Statechart is a visual modelling language for systems. In this paper, we...
research
07/27/2016

Synthetic Language Generation and Model Validation in BEAST2

Generating synthetic languages aids in the testing and validation of fut...

Please sign up or login with your details

Forgot password? Click here to reset