research
∙
09/14/2023
OmnimatteRF: Robust Omnimatte with 3D Background Modeling
Video matting has broad applications, from adding interesting effects to...
share
research
∙
09/08/2023
Dynamic Mesh-Aware Radiance Fields
Embedding polygonal mesh assets within photorealistic Neural Radience Fi...
research
∙
08/07/2023
3D Motion Magnification: Visualizing Subtle Motions with Time Varying Radiance Fields
Motion magnification helps us visualize subtle, imperceptible motion. Ho...
research
∙
06/15/2023
UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Video
We show how to build a model that allows realistic, free-viewpoint rende...
research
∙
06/15/2023
Seeing the World through Your Eyes
The reflective nature of the human eye is an underappreciated source of ...
research
∙
06/08/2023
Grounded Text-to-Image Synthesis with Attention Refocusing
Driven by scalable diffusion models trained on large-scale paired text-i...
research
∙
04/13/2023
Expressive Text-to-Image Generation with Rich Text
Plain text has become a prevalent interface for text-to-image synthesis....
research
∙
04/06/2023
DC^2: Dual-Camera Defocus Control by Learning to Refocus
Smartphone cameras today are increasingly approaching the versatility an...
research
∙
03/30/2023
Consistent View Synthesis with Pose-Guided Diffusion Models
Novel view synthesis from a single image has been a cornerstone problem ...
research
∙
03/24/2023
Progressively Optimized Local Radiance Fields for Robust View Synthesis
We present an algorithm for reconstructing the radiance field of a large...
research
∙
02/23/2023
DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANs
Close-up facial images captured at close distances often suffer from per...
research
∙
02/16/2023
Text-driven Visual Synthesis with Latent Diffusion Prior
There has been tremendous progress in large-scale text-to-image synthesi...
research
∙
02/09/2023
In-N-Out: Face Video Inversion and Editing with Volumetric Decomposition
3D-aware GANs offer new capabilities for creative content editing, such ...
research
∙
01/30/2023
Shape-aware Text-driven Layered Video Editing
Temporal consistency is essential for video editing applications. Existi...
research
∙
01/05/2023
Robust Dynamic Radiance Fields
Dynamic radiance field reconstruction methods aim to model the time-vary...
research
∙
01/05/2023
HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling
Volumetric scene representations enable photorealistic view synthesis fo...
research
∙
10/11/2022
AMICO: Amodal Instance Composition
Image composition aims to blend multiple objects to form a harmonized im...
research
∙
06/21/2022
Temporally Consistent Semantic Video Editing
Generative adversarial networks (GANs) have demonstrated impressive imag...
research
∙
04/22/2022
Learning Dynamic View Synthesis With Few RGBD Cameras
There have been significant advancements in dynamic novel view synthesis...
research
∙
04/07/2022
Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer
Videos are created to express emotion, exchange information, and share e...
research
∙
04/03/2022
Neural Global Shutter: Learn to Restore Video from a Rolling Shutter Camera with Global Reset Feature
Most computer vision systems assume distortion-free images as inputs. Th...
research
∙
03/30/2022
Learning Instance-Specific Adaptation for Cross-Domain Segmentation
We propose a test-time adaptation method for cross-domain image segmenta...
research
∙
12/20/2021
Towards Computational Awareness in Autonomous Robots: An Empirical Study of Computational Kernels
The potential impact of autonomous robots on everyday life is evident in...
research
∙
12/02/2021
Learning Neural Light Fields with Ray-Space Embedding Networks
Neural radiance fields (NeRFs) produce state-of-the-art view synthesis r...
research
∙
09/13/2021
Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN
We present an algorithm for re-rendering a person from a single image un...
research
∙
05/13/2021
Dynamic View Synthesis from Dynamic Monocular Video
We present an algorithm for generating novel views at arbitrary viewpoin...
research
∙
04/13/2021
DropLoss for Long-Tail Instance Segmentation
Long-tailed class distributions are prevalent among the practical applic...
research
∙
03/30/2021
Learning Representational Invariances for Data-Efficient Action Recognition
Data augmentation is a ubiquitous technique for improving image classifi...
research
∙
12/10/2020
Robust Consistent Video Depth Estimation
We present an algorithm for estimating consistent dense depth maps and c...
research
∙
11/25/2020
Space-time Neural Irradiance Fields for Free-Viewpoint Video
We present a method that learns a spatiotemporal neural irradiance field...
research
∙
10/22/2020
Few-Shot Adaptation of Generative Adversarial Networks
Generative Adversarial Networks (GANs) have shown remarkable performance...
research
∙
10/19/2020
PseudoSeg: Designing Pseudo Labels for Semantic Segmentation
Recent advances in semi-supervised learning (SSL) demonstrate that a com...
research
∙
09/03/2020
Flow-edge Guided Video Completion
We present a new flow-based video completion algorithm. Previous flow co...
research
∙
08/26/2020
DRG: Dual Relation Graph for Human-Object Interaction Detection
We tackle the challenging problem of human-object interaction (HOI) dete...
research
∙
08/26/2020
NAS-DIP: Learning Deep Image Prior with Neural Architecture Search
Recent work has shown that the structure of deep convolutional neural ne...
research
∙
08/24/2020
Semantic View Synthesis
We tackle a new problem of semantic view synthesis – generating free-vie...
research
∙
07/21/2020
Learning Monocular Visual Odometry via Self-Supervised Long-Term Modeling
Monocular visual odometry (VO) suffers severely from error accumulation ...
research
∙
07/16/2020
FeatMatch: Feature-Based Augmentation for Semi-Supervised Learning
Recent state-of-the-art semi-supervised learning (SSL) methods use a com...
research
∙
05/21/2020
Instance-aware Image Colorization
Image colorization is inherently an ill-posed problem with multi-modal u...
research
∙
04/30/2020
Consistent Video Depth Estimation
We present an algorithm for reconstructing dense, geometrically consiste...
research
∙
04/09/2020
3D Photography using Context-aware Layered Depth Inpainting
We propose a method for converting a single RGB-D input image into a 3D ...
research
∙
04/02/2020
Learning to See Through Obstructions
We present a learning-based approach for removing unwanted obstructions,...
research
∙
04/02/2020
Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline
Recovering a high dynamic range (HDR) image from a single low dynamic ra...
research
∙
03/31/2020
Deep Semantic Matching with Foreground Detection and Cycle-Consistency
Establishing dense semantic correspondences between object instances rem...
research
∙
01/23/2020
Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation
Few-shot classification aims to recognize novel categories with only few...
research
∙
01/09/2020
CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency
Unsupervised domain adaptation algorithms aim to transfer the knowledge ...
research
∙
12/11/2019
Why Can't I Dance in the Mall? Learning to Mitigate Scene Bias in Action Recognition
Human activities often occur in specific scene contexts, e.g., playing b...
research
∙
10/24/2019
Guided Image-to-Image Translation with Bi-Directional Feature Transformation
We address the problem of guided image-to-image translation where we tra...
research
∙
06/13/2019
Show, Match and Segment: Joint Learning of Semantic Matching and Object Co-segmentation
We present an approach for jointly matching and segmenting object instan...
research
∙
06/12/2019
