research
∙
06/17/2022
Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Tasks
We propose Unified-IO, a model that performs a large variety of AI tasks...
share
research
∙
02/14/2022
ASC me to Do Anything: Multi-task Training for Embodied AI
Embodied AI has seen steady progress across a diverse set of independent...
research
∙
11/29/2021
A Simple Long-Tailed Recognition Baseline via Vision-Language Model
The visual world naturally exhibits a long-tailed distribution of open c...
research
∙
06/02/2021
Container: Context Aggregation Network
Convolutional neural networks (CNNs) are ubiquitous in computer vision, ...
research
∙
03/23/2021
Multi-Modal Answer Validation for Knowledge-Based VQA
The problem of knowledge-based visual question answering involves answer...
research
∙
09/23/2020
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers
Mirroring the success of masked language models, vision-and-language cou...
research
∙
07/24/2020
Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data
Can we develop visually grounded dialog agents that can efficiently adap...
research
∙
07/23/2020
Spatially Aware Multimodal Transformers for TextVQA
Textual cues are essential for everyday tasks like buying groceries and ...
research
∙
12/05/2019
12-in-1: Multi-Task Vision and Language Representation Learning
Much of vision-and-language research focuses on a small but diverse set ...
research
∙
08/06/2019
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
We present ViLBERT (short for Vision-and-Language BERT), a model for lea...
research
∙
04/19/2019
Emergence of Compositional Language with Deep Generational Transmission
Consider a collaborative task that requires communication. Two agents ar...
research
∙
01/10/2019
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation
The Vision-and-Language Navigation (VLN) task entails an agent following...
research
∙
10/01/2018
Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition
In an open-world setting, it is inevitable that an intelligent agent (e....
research
∙
08/01/2018
Graph R-CNN for Scene Graph Generation
We propose a novel scene graph generation model called Graph R-CNN, that...
research
∙
03/27/2018
Neural Baby Talk
We introduce a novel framework for image captioning that can produce nat...
research
∙
06/05/2017
Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model
We present a novel training framework for neural sequence models, partic...
research
∙
05/18/2017
ParlAI: A Dialog Research Software Platform
We introduce ParlAI (pronounced "par-lay"), an open-source software plat...
research
∙
12/06/2016
Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning
Attention-based neural encoder-decoder frameworks have been widely adopt...
research
∙
05/31/2016
Hierarchical Question-Image Co-Attention for Visual Question Answering
A number of recent works have proposed attention models for Visual Quest...
research
∙
05/03/2015