b'Irfan Essa'

research

∙ 09/03/2023

Multimodal Contrastive Learning with Hard Negative Sampling for Human Activity Recognition

Human Activity Recognition (HAR) systems have been extensively studied b...

0 Hyeongju Choi, et al. ∙

research

∙ 06/01/2023

Towards Learning Discrete Representations via Self-Supervision for Wearables-Based Human Activity Recognition

Human activity recognition (HAR) in wearable computing is typically base...

0 Harish Haresamudram, et al. ∙

research

∙ 06/01/2023

StyleDrop: Text-to-Image Generation in Any Style

Pre-trained large text-to-image models synthesize impressive images with...

1 Kihyuk Sohn, et al. ∙

research

∙ 06/01/2023

Learning Disentangled Prompts for Compositional Image Synthesis

We study domain-adaptive image synthesis, the problem of teaching pretra...

0 Kihyuk Sohn, et al. ∙

research

∙ 05/25/2023

Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Models

Text-to-image (T2I) research has grown explosively in the past year, owi...

0 Xingqian Xu, et al. ∙

research

∙ 03/29/2023

Tackling Hate Speech in Low-resource Languages with Context Experts

Given Myanmars historical and socio-political context, hate speech sprea...

0 Daniel Nkemelu, et al. ∙

research

∙ 02/10/2023

MaskSketch: Unpaired Structure-guided Masked Image Generation

Recent conditional image generation methods produce images of remarkable...

0 Dina Bashkirova, et al. ∙

research

∙ 01/30/2023

Emergence of Maps in the Memories of Blind Navigation Agents

Animal navigation research posits that organisms build and maintain inte...

0 Erik Wijmans, et al. ∙

research

∙ 12/17/2022

Cascaded Compositional Residual Learning for Complex Interactive Behaviors

Real-world autonomous missions often require rich interaction with nearb...

0 K. Niranjan Kumar, et al. ∙

research

∙ 11/11/2022

Investigating Enhancements to Contrastive Predictive Coding for Human Activity Recognition

The dichotomy between the challenging nature of obtaining annotations fo...

0 Harish Haresamudram, et al. ∙

research

∙ 11/08/2022

Multi-Stage Based Feature Fusion of Multi-Modal Data for Human Activity Recognition

To properly assist humans in their needs, human activity recognition (HA...

0 Hyeongju Choi, et al. ∙

research

∙ 10/26/2022

End-to-End Multimodal Representation Learning for Video Dialog

Video-based dialog task is a challenging multimodal learning task that h...

0 Huda Alamri, et al. ∙

research

∙ 10/24/2022

Video based Object 6D Pose Estimation using Transformers

We introduce a Transformer based 6D Object Pose Estimation framework Vid...

0 Apoorva Beedu, et al. ∙

research

∙ 10/13/2022

Finding Islands of Predictability in Action Forecasting

We address dense action forecasting: the problem of predicting future ac...

0 Daniel Scarafoni, et al. ∙

research

∙ 10/11/2022

VER: Scaling On-Policy RL Leads to the Emergence of Navigation in Embodied Rearrangement

We present Variable Experience Rollout (VER), a technique for efficientl...

23 Erik Wijmans, et al. ∙

research

∙ 10/03/2022

Visual Prompt Tuning for Generative Transfer Learning

Transferring knowledge from an image synthesis model trained on a large ...

0 Kihyuk Sohn, et al. ∙

research

∙ 09/09/2022

Improved Masked Image Generation with Token-Critic

Non-autoregressive generative transformers recently demonstrated impress...

2 José Lezama, et al. ∙

research

∙ 02/11/2022

Learning Temporal Rules from Noisy Timeseries Data

Events across a timeline are a common data representation, seen in diffe...

7 Karan Samel, et al. ∙

research

∙ 12/09/2021

BLT: Bidirectional Layout Transformer for Controllable Layout Generation

Creating visual layouts is an important step in graphic design. Automati...

15 Xiang Kong, et al. ∙

research

∙ 11/20/2021

Discrete Representations Strengthen Vision Transformer Robustness

Vision Transformer (ViT) is emerging as the state-of-the-art architectur...

10 Chengzhi Mao, et al. ∙

research

∙ 09/21/2021

Graph-based Cluttered Scene Generation and Interactive Exploration using Deep Reinforcement Learning

We introduce a novel method to teach a robotic agent to interactively ex...

0 K. Niranjan Kumar, et al. ∙

research

∙ 06/28/2021

Unsupervised Discovery of Actions in Instructional Videos

In this paper we address the problem of automatically discovering atomic...

10 AJ Piergiovanni, et al. ∙

research

∙ 06/07/2021

Unsupervised Action Segmentation for Instructional Videos

In this paper we address the problem of automatically discovering atomic...

0 AJ Piergiovanni, et al. ∙

research

∙ 05/14/2021

Automatic Non-Linear Video Editing Transfer

We propose an automatic approach that extracts editing styles in a sourc...

3 Nathan Frey, et al. ∙

research

∙ 03/29/2021

PLAN-B: Predicting Likely Alternative Next Best Sequences for Action Prediction

Action prediction focuses on anticipating actions before they happen. Re...

15 Dan Scarafoni, et al. ∙

research

∙ 12/11/2020

How to Train PointGoal Navigation Agents on a (Sample and Compute) Budget

PointGoal navigation has seen significant recent interest and progress, ...

14 Erik Wijmans, et al. ∙

research

∙ 12/09/2020

Contrastive Predictive Coding for Human Activity Recognition

Feature extraction is crucial for human activity recognition (HAR) using...

8 Harish Haresamudram, et al. ∙

research

∙ 10/02/2020

Semantic MapNet: Building Allocentric SemanticMaps and Representations from Egocentric Views

We study the task of semantic mapping - specifically, an embodied agent ...

1 Vincent Cartillier, et al. ∙

research

∙ 08/11/2020

Text as Neural Operator: Image Manipulation by Text Instruction

In this paper, we study a new task that allows users to edit an input im...

8 Tianhao Zhang, et al. ∙

research

∙ 03/12/2020

Analyzing Visual Representations in Embodied Navigation Tasks

Recent advances in deep reinforcement learning require a large amount of...

7 Erik Wijmans, et al. ∙

research

∙ 12/19/2019

Neural Design Network: Graphic Layout Generation with Constraints

Graphic design is essential for visual communication with layouts being ...

32 Hsin-Ying Lee, et al. ∙

research

∙ 11/01/2019

Decentralized Distributed PPO: Solving PointGoal Navigation

We present Decentralized Distributed Proximal Policy Optimization (DD-PP...

45 Erik Wijmans, et al. ∙

research

∙ 07/09/2019

Estimating Mass Distribution of Articulated Objects through Physical Interaction

We explore the problem of estimating the mass distribution of an articul...

0 Niranjan Kumar Kannabiran, et al. ∙

research

∙ 07/03/2019

Novel evaluation of surgical activity recognition models using task-based efficiency metrics

Purpose: Surgical task-based metrics (rather than entire procedure metri...

1 Aneeq Zia, et al. ∙

research

∙ 06/16/2019

Floors are Flat: Leveraging Semantics for Real-Time Surface Normal Prediction

We propose 4 insights that help to significantly improve the performance...

4 Steven Hickson, et al. ∙

research

∙ 04/06/2019

Embodied Question Answering in Photorealistic Environments with Point Cloud Perception

To help bridge the gap between internet vision-style problems and the go...

12 Erik Wijmans, et al. ∙

research

∙ 01/25/2019

Audio-Visual Scene-Aware Dialog

We introduce the task of scene-aware dialog. Given a follow-up question ...

48 Huda Alamri, et al. ∙

research

∙ 09/11/2018

Unbiasing Semantic Segmentation For Robot Perception using Synthetic Data Feature Transfer

Robot perception systems need to perform reliable image segmentation in ...

0 Jonathan C Balloch, et al. ∙

research

∙ 08/22/2018

Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognition

We propose a self-supervised learning method to jointly reason about spa...

0 Unaiza Ahsan, et al. ∙

research

∙ 06/21/2018

End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features

Dialog systems need to understand dynamic visual scenes in order to have...

0 Chiori Hori, et al. ∙

research

∙ 06/01/2018

Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7

Scene-aware dialog systems will be able to have conversations with users...

0 Huda Alamri, et al. ∙

research

∙ 06/01/2018

Surgical Activity Recognition in Robot-Assisted Radical Prostatectomy using Deep Learning

Adverse surgical outcomes are costly to patients and hospitals. Approach...

0 Aneeq Zia, et al. ∙

research

∙ 01/26/2018

Object category learning and retrieval with weak supervision

We consider the problem of retrieving objects from image data and learni...

0 Steven Hickson, et al. ∙

research

∙ 01/26/2018

Efficient Hierarchical Graph-Based Segmentation of RGBD Videos

We present an efficient and scalable algorithm for segmenting 3D RGBD po...

0 Steven Hickson, et al. ∙

research

∙ 01/23/2018

Let's Dance: Learning From Online Dance Videos

In recent years, deep neural network approaches have naturally extended ...

0 Daniel Castro, et al. ∙

research

∙ 01/22/2018

DiscrimNet: Semi-Supervised Action Recognition from Videos using Generative Adversarial Networks

We propose an action recognition framework using Gen- erative Adversaria...

0 Unaiza Ahsan, et al. ∙

research

∙ 12/22/2017

Automated Surgical Skill Assessment in RMIS Training

Purpose: Manual feedback in basic RMIS training can consume a significan...

0 Aneeq Zia, et al. ∙

research

∙ 09/11/2017

One-Shot Learning for Semantic Segmentation

Low-shot learning methods for image classification support learning from...

0 Amirreza Shaban, et al. ∙

research

∙ 08/02/2017

Semantic Instance Labeling Leveraging Hierarchical Segmentation

Most of the approaches for indoor RGBD semantic la- beling focus on usin...

0 Steven Hickson, et al. ∙

research

∙ 07/22/2017

Eyemotion: Classifying facial expressions in VR using eye-tracking cameras

One of the main challenges of social interaction in virtual reality sett...

0 Steven Hickson, et al. ∙

Irfan Essa

Featured Co-authors