research
∙
07/04/2023
FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformation
This technical report summarizes the winning solution for the 3D Occupan...
share
research
∙
06/14/2023
Generalizable One-shot Neural Head Avatar
We present a method that reconstructs and animates a 3D head avatar from...
research
∙
06/14/2023
Heterogeneous Continual Learning
We propose a novel framework and a solution to tackle the continual lear...
research
∙
06/09/2023
FasterViT: Fast Vision Transformers with Hierarchical Attention
We design a new family of hybrid CNN-ViT neural networks, named FasterVi...
research
∙
05/23/2023
The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attacks
Many defenses against adversarial attacks (robust classifiers, randomiza...
research
∙
05/07/2023
A Variational Perspective on Solving Inverse Problems with Diffusion Models
Diffusion models have emerged as a key pillar of foundation models in vi...
research
∙
05/04/2023
Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization
There is a growing demand for the accessible creation of high-quality 3D...
research
∙
04/02/2023
Recurrence without Recurrence: Stable Video Landmark Detection with Deep Equilibrium Models
Cascaded computation, whereby predictions are recurrently refined over s...
research
∙
03/24/2023
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects
We present a near real-time method for 6-DoF tracking of an unknown obje...
research
∙
02/14/2023
Score-based Diffusion Models in Function Space
Diffusion models have recently emerged as a powerful framework for gener...
research
∙
12/06/2022
RANA: Relightable Articulated Neural Avatars
We propose RANA, a relightable and articulated neural avatar for the pho...
research
∙
09/21/2022
Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation
Given a portrait image of a person and an environment map of the target ...
research
∙
08/19/2022
Neural Light Field Estimation for Street Scenes with Differentiable Virtual Object Insertion
We consider the challenging problem of outdoor lighting estimation for t...
research
∙
06/20/2022
Global Context Vision Transformers
We propose global context vision transformer (GC ViT), a novel architect...
research
∙
05/14/2022
RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesis
We present a large-scale synthetic dataset for novel view synthesis cons...
research
∙
03/29/2022
DRaCoN – Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars
Acquisition and creation of digital human avatars is an important proble...
research
∙
03/22/2022
GradViT: Gradient Inversion of Vision Transformers
In this work we demonstrate the vulnerability of vision transformers (Vi...
research
∙
02/24/2022
Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations
Physics-informed neural networks allow models to be trained by physical ...
research
∙
02/24/2022
FreeSOLO: Learning to Segment Objects without Annotations
Instance segmentation is a fundamental vision task that aims to recogniz...
research
∙
02/14/2022
Do Gradient Inversion Attacks Make Federated Learning Unsafe?
Federated learning (FL) allows the collaborative training of AI models w...
research
∙
01/20/2022
Federated Learning with Heterogeneous Architectures using Graph HyperNetworks
Standard Federated Learning (FL) techniques are limited to clients with ...
research
∙
12/14/2021
AdaViT: Adaptive Tokens for Efficient Vision Transformer
We introduce AdaViT, a method that adaptively adjusts the inference cost...
research
∙
10/19/2021
Self-Supervised Object Detection via Generative Image Synthesis
We present SSOD, the first end-to-end analysis-by synthesis framework wi...
research
∙
10/10/2021
NViT: Vision Transformer Compression and Parameter Redistribution
Transformers yield state-of-the-art results across many tasks. However, ...
research
∙
09/13/2021
Learning Indoor Inverse Rendering with 3D Spatially-Varying Lighting
In this work, we address the problem of jointly estimating albedo, norma...
research
∙
07/13/2021
Deep Neural Networks are Surprisingly Reversible: A Baseline for Zero-Shot Inversion
Understanding the behavior and vulnerability of pre-trained deep neural ...
research
∙
06/10/2021
Adversarial Motion Modelling helps Semi-supervised Hand Pose Estimation
Hand pose estimation is difficult due to different environmental conditi...
research
∙
06/10/2021
Score-based Generative Modeling in Latent Space
Score-based generative models (SGMs) have recently demonstrated impressi...
research
∙
05/20/2021
Weakly-Supervised Physically Unconstrained Gaze Estimation
A major challenge for physically unconstrained gaze estimation is acquir...
research
∙
04/27/2021
KAMA: 3D Keypoint Aware Body Mesh Articulation
We present KAMA, a 3D Keypoint Aware Mesh Articulation approach that all...
research
∙
04/15/2021
See through Gradients: Image Batch Recovery via GradInversion
Training deep neural networks requires gradient estimation from data bat...
research
∙
04/09/2021
DexYCB: A Benchmark for Capturing Hand Grasping of Objects
We introduce DexYCB, a new dataset for capturing hand grasping of object...
research
∙
04/01/2021
Learning to Track Instances without Video Annotations
Tracking segmentation masks of multiple instances has been intensively s...
research
∙
01/29/2021
Neural 3D Clothes Retargeting from a Single Image
In this paper, we present a method of clothes retargeting; generating th...
research
∙
01/12/2021
Binary TTC: A Temporal Geofence for Autonomous Navigation
Time-to-contact (TTC), the time for an object to collide with the observ...
research
∙
12/08/2020
Parameter Efficient Multimodal Transformers for Video Representation Learning
The recent success of Transformers in the language domain has motivated ...
research
∙
12/01/2020
Displacement-Invariant Cost Computation for Efficient Stereo Matching
Although deep learning-based methods have dominated stereo matching lead...
research
∙
10/21/2020
UFO^2: A Unified Framework towards Omni-supervised Object Detection
Existing work on object detection often relies on a single form of annot...
research
∙
10/06/2020
NCP-VAE: Variational Autoencoders with Noise Contrastive Priors
Variational autoencoders (VAEs) are one of the powerful likelihood-based...
research
∙
10/01/2020
VAEBM: A Symbiosis between Variational Autoencoders and Energy-based Models
Energy-based models (EBMs) have recently been successful in representing...
research
∙
09/15/2020
Optical Gaze Tracking with Spatially-Sparse Single-Pixel Detectors
Gaze tracking is an essential component of next generation displays for ...
research
∙
08/25/2020
Improving Deep Stereo Network Generalization with Geometric Priors
End-to-end deep learning methods have advanced stereo vision in recent y...
research
∙
08/20/2020
DeepGMR: Learning Latent Gaussian Mixture Models for Registration
Point cloud registration is a fundamental problem in 3D computer vision,...
research
∙
07/20/2020
Hierarchical Contrastive Motion Learning for Video Action Recognition
One central question for video action recognition is how to model motion...
research
∙
07/20/2020
Joint Disentangling and Adaptation for Cross-Domain Person Re-Identification
Although a significant progress has been witnessed in supervised person ...
research
∙
07/08/2020
NVAE: A Deep Hierarchical Variational Autoencoder
Normalizing flows, autoregressive models, variational autoencoders (VAEs...
research
∙
06/17/2020
Contrastive Learning for Weakly Supervised Phrase Grounding
Phrase grounding, the problem of associating image regions to caption wo...
research
∙
05/14/2020
How to Close Sim-Real Gap? Transfer with Segmentation!
One fundamental difficulty in robotic learning is the sim-real gap probl...
research
∙
05/14/2020
Bi3D: Stereo Depth Estimation via Binary Classifications
Stereo-based depth estimation is a cornerstone of computer vision, with ...
research
∙
04/09/2020