Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7

06/01/2018
by   Huda Alamri, et al.
0

Scene-aware dialog systems will be able to have conversations with users about the objects and events around them. Progress on such systems can be made by integrating state-of-the-art technologies from multiple research areas including end-to-end dialog systems visual dialog, and video description. We introduce the Audio Visual Scene Aware Dialog (AVSD) challenge and dataset. In this challenge, which is one track of the 7th Dialog System Technology Challenges (DSTC7) workshop1, the task is to build a system that generates responses in a dialog about an input video

READ FULL TEXT

page 1

page 2

research
06/21/2018

End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features

Dialog systems need to understand dynamic visual scenes in order to have...
research
01/25/2019

Audio-Visual Scene-Aware Dialog

We introduce the task of scene-aware dialog. Given a follow-up question ...
research
04/11/2019

A Simple Baseline for Audio-Visual Scene-Aware Dialog

The recently proposed audio-visual scene-aware dialog task paves the way...
research
01/15/2020

Ensemble based discriminative models for Visual Dialog Challenge 2018

This manuscript describes our approach for the Visual Dialog Challenge 2...
research
12/04/2017

Examining Cooperation in Visual Dialog Models

In this work we propose a blackbox intervention method for visual dialog...
research
09/14/2021

Automatically Exposing Problems with Neural Dialog Models

Neural dialog models are known to suffer from problems such as generatin...
research
01/11/2019

Dialog System Technology Challenge 7

This paper introduces the Seventh Dialog System Technology Challenges (D...

Please sign up or login with your details

Forgot password? Click here to reset