research
∙
02/23/2023
Teaching CLIP to Count to Ten
Large vision-language models (VLMs), such as CLIP, learn rich joint imag...
share
research
∙
04/13/2020
SpeedNet: Learning the Speediness in Videos
We wish to automatically predict the "speediness" of moving objects in v...
research
∙
11/30/2018
Neural separation of observed and unobserved distributions
Separating mixed distributions is a long standing challenge for machine ...
research
∙
08/19/2018
Dynamic Temporal Alignment of Speech to Lips
Many speech segments in movies are re-recorded in a studio during postpr...
research
∙
04/10/2018
Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separation
We present a joint audio-visual model for isolating a single speech sign...
research
∙
08/22/2017
Seeing Through Noise: Visually Driven Speaker Separation and Enhancement
Isolating the voice of a specific person while filtering out other voice...
research
∙
08/01/2017
Improved Speech Reconstruction from Silent Video
Speechreading is the task of inferring phonetic information from visuall...
research
∙
01/02/2017
Vid2speech: Speech Reconstruction from Silent Video
Speechreading is a notoriously difficult task for humans to perform. In ...
research
∙
04/28/2015