b'Jan Kautz'

research

∙ 07/04/2023

FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformation

This technical report summarizes the winning solution for the 3D Occupan...

0 Zhiqi Li, et al. ∙

research

∙ 06/14/2023

Generalizable One-shot Neural Head Avatar

We present a method that reconstructs and animates a 3D head avatar from...

0 Xueting Li, et al. ∙

research

∙ 06/14/2023

Heterogeneous Continual Learning

We propose a novel framework and a solution to tackle the continual lear...

0 Divyam Madaan, et al. ∙

research

∙ 06/09/2023

FasterViT: Fast Vision Transformers with Hierarchical Attention

We design a new family of hybrid CNN-ViT neural networks, named FasterVi...

0 Ali Hatamizadeh, et al. ∙

research

∙ 05/23/2023

The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attacks

Many defenses against adversarial attacks (robust classifiers, randomiza...

0 Iuri Frosio, et al. ∙

research

∙ 05/07/2023

A Variational Perspective on Solving Inverse Problems with Diffusion Models

Diffusion models have emerged as a key pillar of foundation models in vi...

0 Morteza Mardani, et al. ∙

research

∙ 05/04/2023

Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization

There is a growing demand for the accessible creation of high-quality 3D...

3 Connor Z. Lin, et al. ∙

research

∙ 04/02/2023

Recurrence without Recurrence: Stable Video Landmark Detection with Deep Equilibrium Models

Cascaded computation, whereby predictions are recurrently refined over s...

0 Paul Micaelli, et al. ∙

research

∙ 03/24/2023

BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects

We present a near real-time method for 6-DoF tracking of an unknown obje...

3 Bowen Wen, et al. ∙

research

∙ 02/14/2023

Score-based Diffusion Models in Function Space

Diffusion models have recently emerged as a powerful framework for gener...

0 Jae Hyun Lim, et al. ∙

research

∙ 12/06/2022

RANA: Relightable Articulated Neural Avatars

We propose RANA, a relightable and articulated neural avatar for the pho...

2 Umar Iqbal, et al. ∙

research

∙ 09/21/2022

Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation

Given a portrait image of a person and an environment map of the target ...

10 Yu-Ying Yeh, et al. ∙

research

∙ 08/19/2022

Neural Light Field Estimation for Street Scenes with Differentiable Virtual Object Insertion

We consider the challenging problem of outdoor lighting estimation for t...

17 Zian Wang, et al. ∙

research

∙ 06/20/2022

Global Context Vision Transformers

We propose global context vision transformer (GC ViT), a novel architect...

0 Ali Hatamizadeh, et al. ∙

research

∙ 05/14/2022

RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesis

We present a large-scale synthetic dataset for novel view synthesis cons...

13 Jonathan Tremblay, et al. ∙

research

∙ 03/29/2022

DRaCoN – Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars

Acquisition and creation of digital human avatars is an important proble...

11 Amit Raj, et al. ∙

research

∙ 03/22/2022

GradViT: Gradient Inversion of Vision Transformers

In this work we demonstrate the vulnerability of vision transformers (Vi...

0 Ali Hatamizadeh, et al. ∙

research

∙ 02/24/2022

Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations

Physics-informed neural networks allow models to be trained by physical ...

9 Benjamin Wu, et al. ∙

research

∙ 02/24/2022

FreeSOLO: Learning to Segment Objects without Annotations

Instance segmentation is a fundamental vision task that aims to recogniz...

59 Xinlong Wang, et al. ∙

research

∙ 02/14/2022

Do Gradient Inversion Attacks Make Federated Learning Unsafe?

Federated learning (FL) allows the collaborative training of AI models w...

0 Ali Hatamizadeh, et al. ∙

research

∙ 01/20/2022

Federated Learning with Heterogeneous Architectures using Graph HyperNetworks

Standard Federated Learning (FL) techniques are limited to clients with ...

14 Or Litany, et al. ∙

research

∙ 12/14/2021

AdaViT: Adaptive Tokens for Efficient Vision Transformer

We introduce AdaViT, a method that adaptively adjusts the inference cost...

0 Hongxu Yin, et al. ∙

research

∙ 10/19/2021

Self-Supervised Object Detection via Generative Image Synthesis

We present SSOD, the first end-to-end analysis-by synthesis framework wi...

20 Siva Karthik Mustikovela, et al. ∙

research

∙ 10/10/2021

NViT: Vision Transformer Compression and Parameter Redistribution

Transformers yield state-of-the-art results across many tasks. However, ...

0 Huanrui Yang, et al. ∙

research

∙ 09/13/2021

Learning Indoor Inverse Rendering with 3D Spatially-Varying Lighting

In this work, we address the problem of jointly estimating albedo, norma...

13 Zian Wang, et al. ∙

research

∙ 07/13/2021

Deep Neural Networks are Surprisingly Reversible: A Baseline for Zero-Shot Inversion

Understanding the behavior and vulnerability of pre-trained deep neural ...

8 Xin Dong, et al. ∙

research

∙ 06/10/2021

Adversarial Motion Modelling helps Semi-supervised Hand Pose Estimation

Hand pose estimation is difficult due to different environmental conditi...

0 Adrian Spurr, et al. ∙

research

∙ 06/10/2021

Score-based Generative Modeling in Latent Space

Score-based generative models (SGMs) have recently demonstrated impressi...

0 Arash Vahdat, et al. ∙

research

∙ 05/20/2021

Weakly-Supervised Physically Unconstrained Gaze Estimation

A major challenge for physically unconstrained gaze estimation is acquir...

18 Rakshit Kothari, et al. ∙

research

∙ 04/27/2021

KAMA: 3D Keypoint Aware Body Mesh Articulation

We present KAMA, a 3D Keypoint Aware Mesh Articulation approach that all...

14 Umar Iqbal, et al. ∙

research

∙ 04/15/2021

See through Gradients: Image Batch Recovery via GradInversion

Training deep neural networks requires gradient estimation from data bat...

0 Hongxu Yin, et al. ∙

research

∙ 04/09/2021

DexYCB: A Benchmark for Capturing Hand Grasping of Objects

We introduce DexYCB, a new dataset for capturing hand grasping of object...

5 Yu-Wei Chao, et al. ∙

research

∙ 04/01/2021

Learning to Track Instances without Video Annotations

Tracking segmentation masks of multiple instances has been intensively s...

0 Yang Fu, et al. ∙

research

∙ 01/29/2021

Neural 3D Clothes Retargeting from a Single Image

In this paper, we present a method of clothes retargeting; generating th...

33 Jae Shin Yoon, et al. ∙

research

∙ 01/12/2021

Binary TTC: A Temporal Geofence for Autonomous Navigation

Time-to-contact (TTC), the time for an object to collide with the observ...

6 Abhishek Badki, et al. ∙

research

∙ 12/08/2020

Parameter Efficient Multimodal Transformers for Video Representation Learning

The recent success of Transformers in the language domain has motivated ...

0 Sangho Lee, et al. ∙

research

∙ 12/01/2020

Displacement-Invariant Cost Computation for Efficient Stereo Matching

Although deep learning-based methods have dominated stereo matching lead...

9 Yiran Zhong, et al. ∙

research

∙ 10/21/2020

UFO^2: A Unified Framework towards Omni-supervised Object Detection

Existing work on object detection often relies on a single form of annot...

0 Zhongzheng Ren, et al. ∙

research

∙ 10/06/2020

NCP-VAE: Variational Autoencoders with Noise Contrastive Priors

Variational autoencoders (VAEs) are one of the powerful likelihood-based...

29 Jyoti Aneja, et al. ∙

research

∙ 10/01/2020

VAEBM: A Symbiosis between Variational Autoencoders and Energy-based Models

Energy-based models (EBMs) have recently been successful in representing...

23 Zhisheng Xiao, et al. ∙

research

∙ 09/15/2020

Optical Gaze Tracking with Spatially-Sparse Single-Pixel Detectors

Gaze tracking is an essential component of next generation displays for ...

0 Richard Li, et al. ∙

research

∙ 08/25/2020

Improving Deep Stereo Network Generalization with Geometric Priors

End-to-end deep learning methods have advanced stereo vision in recent y...

8 Jialiang Wang, et al. ∙

research

∙ 08/20/2020

DeepGMR: Learning Latent Gaussian Mixture Models for Registration

Point cloud registration is a fundamental problem in 3D computer vision,...

49 Wentao Yuan, et al. ∙

research

∙ 07/20/2020

Hierarchical Contrastive Motion Learning for Video Action Recognition

One central question for video action recognition is how to model motion...

4 Xitong Yang, et al. ∙

research

∙ 07/20/2020

Joint Disentangling and Adaptation for Cross-Domain Person Re-Identification

Although a significant progress has been witnessed in supervised person ...

11 Yang Zou, et al. ∙

research

∙ 07/08/2020

NVAE: A Deep Hierarchical Variational Autoencoder

Normalizing flows, autoregressive models, variational autoencoders (VAEs...

22 Arash Vahdat, et al. ∙

research

∙ 06/17/2020

Contrastive Learning for Weakly Supervised Phrase Grounding

Phrase grounding, the problem of associating image regions to caption wo...

4 Tanmay Gupta, et al. ∙

research

∙ 05/14/2020

How to Close Sim-Real Gap? Transfer with Segmentation!

One fundamental difficulty in robotic learning is the sim-real gap probl...

0 Mengyuan Yan, et al. ∙

research

∙ 05/14/2020

Bi3D: Stereo Depth Estimation via Binary Classifications

Stereo-based depth estimation is a cornerstone of computer vision, with ...

0 Abhishek Badki, et al. ∙

research

∙ 04/09/2020

Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detection

Weakly supervised learning has emerged as a compelling tool for object d...

2 Zhongzheng Ren, et al. ∙

Jan Kautz

Featured Co-authors