research
∙
06/20/2023
Dense Video Object Captioning from Disjoint Supervision
We propose a new task and model for dense video object captioning – dete...
share
research
∙
06/12/2023
Waffling around for Performance: Visual Classification with Random Words and Broad Concepts
The visual classification performance of vision-language models such as ...
research
∙
04/24/2023
End-to-End Spatio-Temporal Action Localisation with Video Transformers
The most performant spatio-temporal action localisation models use exter...
research
∙
02/27/2023
Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning
In this work, we introduce Vid2Seq, a multi-modal single-stage dense eve...
research
∙
12/20/2022
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation
One of the major challenges of machine translation (MT) is ambiguity, wh...
research
∙
11/16/2022
Learning Reward Functions for Robotic Manipulation by Observing Humans
Observing a human demonstrator manipulate objects provides a rich, scala...
research
∙
03/30/2022
TubeDETR: Spatio-Temporal Video Grounding with Transformers
We consider the problem of localizing a spatio-temporal tube in a video ...
research
∙
06/30/2021
Attention Bottlenecks for Multimodal Fusion
Humans perceive the world by concurrently processing and fusing high-dim...
research
∙
06/15/2021
Residual Reinforcement Learning from Demonstrations
Residual reinforcement learning (RL) has been proposed as a way to solve...
research
∙
05/12/2021
Segmenter: Transformer for Semantic Segmentation
Image segmentation is often ambiguous at the level of individual image p...
research
∙
03/29/2021
ViViT: A Video Vision Transformer
We present pure-transformer based models for video classification, drawi...
research
∙
05/20/2020
What makes for good views for contrastive learning
Contrastive learning between multiple views of the data has recently ach...
research
∙
10/25/2019
Learning to Track Any Object
Object tracking can be formulated as "finding the right object in a vide...
research
∙
06/13/2019
Contrastive Bidirectional Transformer for Temporal Representation Learning
This paper aims at learning representations for long sequences of contin...
research
∙
04/03/2019
VideoBERT: A Joint Model for Video and Language Representation Learning
Self-supervised learning has become increasingly important to leverage t...
research
∙
03/18/2019
Learning to Augment Synthetic Images for Sim2Real Policy Transfer
Vision and learning have made significant progress that could improve ro...
research
∙
01/05/2019
AVA-ActiveSpeaker: An Audio-Visual Dataset for Active Speaker Detection
Active speaker detection is an important component in video analysis alg...
research
∙
04/25/2018
Charades-Ego: A Large-Scale Dataset of Paired Third and First Person Videos
In Actor and Observer we introduced a dataset linking the first and thir...
research
∙
04/13/2018
BodyNet: Volumetric Inference of 3D Human Body Shapes
Human shape estimation is an important task for video editing, animation...
research
∙
07/13/2017
Leveraging the Path Signature for Skeleton-based Human Action Recognition
Human action recognition in videos is one of the most challenging tasks ...
research
∙
12/03/2016
