What A Situated Language-Using Agent Must be Able to Do: A Top-Down Analysis

02/16/2023
by   David Schlangen, et al.
0

Even in our increasingly text-intensive times, the primary site of language use is situated, co-present interaction. It is primary ontogenetically and phylogenetically, and it is arguably also still primary in negotiating everyday social situations. Situated interaction is also the final frontier of Natural Language Processing, where, compared to the area of text processing, very little progress has been made in the past decade, and where a myriad of practical applications is waiting to be unlocked. While the usual approach in the field is to reach, bottom-up, for the ever next "adjacent possible", in this paper I attempt a top-down analysis of what the demands are that unrestricted situated interaction makes on the participating agent, and suggest ways in which this analysis can structure computational models and research on them. Specifically, I discuss representational demands (the building up and application of world model, language model, situation model, discourse model, and agent model) and what I call anchoring processes (incremental processing, incremental learning, conversational grounding, multimodal grounding) that bind the agent to the here, now, and us.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/17/2018

Multimodal Grounding for Language Processing

This survey discusses how recent developments in multimodal processing f...
research
09/29/2017

Symbol, Conversational, and Societal Grounding with a Toy Robot

Essential to meaningful interaction is grounding at the symbolic, conver...
research
03/25/2021

Visual Grounding Strategies for Text-Only Natural Language Processing

Visual grounding is a promising path toward more robust and accurate Nat...
research
04/21/2020

Experience Grounds Language

Successful linguistic communication relies on a shared experience of the...
research
07/11/2019

MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment

Building computer systems that can converse about their visual environme...
research
12/05/2020

Neurosymbolic AI for Situated Language Understanding

In recent years, data-intensive AI, particularly the domain of natural l...
research
06/01/2021

PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World

We propose PIGLeT: a model that learns physical commonsense knowledge th...

Please sign up or login with your details

Forgot password? Click here to reset