research
∙
05/08/2022
Unsupervised Discovery and Composition of Object Light Fields
Neural scene representations, both continuous and discrete, have recentl...
share
research
∙
05/05/2022
RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networks
Modeling and manipulating elasto-plastic objects are essential capabilit...
research
∙
05/04/2022
Video Extrapolation in Space and Time
Novel view synthesis (NVS) and video prediction (VP) are typically consi...
research
∙
04/28/2022
Rotationally Equivariant 3D Object Detection
Rotation equivariance has recently become a strongly desired property in...
research
∙
04/05/2022
ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer
Objects play a crucial role in our everyday activities. Though multisens...
research
∙
03/15/2022
Vision-Based Manipulators Need to Also See from Their Hands
We study how the choice of visual perspective affects learning and gener...
research
∙
02/17/2022
Grammar-Based Grounded Lexicon Learning
We present Grammar-Based Grounded Lexicon Learning (G2L2), a lexicalist ...
research
∙
09/16/2021
ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations
Multisensory object-centric perception, reasoning, and interaction have ...
research
∙
08/28/2021
DASH: Modularized Human Manipulation Simulation with Vision and Language for Embodied AI
Creating virtual humans with embodied, human-like perceptual and actuati...
research
∙
08/06/2021
BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments
We introduce BEHAVIOR, a benchmark for embodied AI with 100 activities i...
research
∙
08/06/2021
iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks
Recent research in embodied AI has been boosted by the use of simulation...
research
∙
07/16/2021
Unsupervised Discovery of Object Radiance Fields
We study the problem of inferring an object-centric scene representation...
research
∙
06/10/2021
Temporal and Object Quantification Networks
We present Temporal and Object Quantification Networks (TOQ-Nets), a new...
research
∙
04/22/2021
KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control
We introduce KeypointDeformer, a novel unsupervised method for shape con...
research
∙
04/22/2021
Hierarchical Motion Understanding via Motion Programs
Current approaches to video analysis of human motion focus on raw pixels...
research
∙
04/08/2021
De-rendering the World's Revolutionary Artefacts
Recent works have shown exciting results in unsupervised image de-render...
research
∙
04/08/2021
3D Shape Generation and Completion through Point-Voxel Diffusion
We propose a novel approach for probabilistic generative modeling of 3D ...
research
∙
03/30/2021
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning
We study the problem of dynamic visual reasoning on raw videos. This is ...
research
∙
03/30/2021
Repopulating Street Scenes
We present a framework for automatically reconfiguring images of street ...
research
∙
01/07/2021
Learning Temporal Dynamics from Cycles in Narrated Video
Learning to model how the world changes as time elapses has proven a cha...
research
∙
12/31/2020
Language-Mediated, Object-Centric Representation Learning
We present Language-mediated, Object-centric Representation Learning (LO...
research
∙
12/23/2020
Augmenting Policy Learning with Routines Discovered from a Single Demonstration
Humans can abstract prior knowledge from very little data and use it to ...
research
∙
12/21/2020
Object-Centric Diagnosis of Visual Reasoning
When answering questions about an image, it not only needs knowing what ...
research
∙
12/17/2020
Neural Radiance Flow for 4D View Synthesis and Video Processing
We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatia...
research
∙
12/15/2020
Object-Centric Neural Scene Rendering
We present a method for composing photorealistic scenes from captured im...
research
∙
12/02/2020
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis
We have witnessed rapid progress on 3D-aware image synthesis, leveraging...
research
∙
11/19/2020
Multi-Plane Program Induction with 3D Box Priors
We consider two important aspects in understanding and editing images: m...
research
∙
11/03/2020
Learning 3D Dynamic Scene Representations for Robot Manipulation
3D scene representation for robot manipulation should capture three key ...
research
∙
09/24/2020
Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection
A common dilemma in 3D object detection for autonomous driving is that h...
research
∙
07/24/2020
Unsupervised Discovery of 3D Physical Objects from Video
We study the problem of unsupervised physical object discovery. Unlike e...
research
∙
07/23/2020
End-to-End Optimization of Scene Layout
We propose an end-to-end variational generative model for scene layout s...
research
∙
06/25/2020
Perspective Plane Program Induction from a Single Image
We study the inverse graphics problem of inferring a holistic representa...
research
∙
06/22/2020
Learning Physical Graph Representations from Visual Scenes
Convolutional Neural Networks (CNNs) have proved exceptional at learning...
research
∙
06/10/2020
When is Particle Filtering Efficient for POMDP Sequential Planning?
Particle filtering is a popular method for inferring latent states in st...
research
∙
05/18/2020
Data Represention for Deep Learning with Priori Knowledge of Symmetric Wireless Tasks
Deep neural networks (DNNs) have been applied to address various wireles...
research
∙
04/28/2020
Visual Grounding of Learned Physical Models
Humans intuitively recognize objects' physical properties and predict th...
research
∙
02/04/2020
Visual Concept-Metaconcept Learning
Humans reason with concepts and metaconcepts: we recognize red and green...
research
∙
12/25/2019
Look, Listen, and Act: Towards Audio-Visual Embodied Navigation
A crucial aspect of mobile intelligent agents is their ability to integr...
research
∙
11/08/2019
Accurate Vision-based Manipulation through Contact Reasoning
Planning contact interactions is one of the core challenges of many robo...
research
∙
10/29/2019
Proactive Optimization with Unsupervised Learning
Proactive resource allocation, say proactive caching at wireless edge, h...
research
∙
10/28/2019
Entity Abstraction in Visual Model-Based Reinforcement Learning
This paper tests the hypothesis that modeling a scene in terms of entiti...
research
∙
10/18/2019
Learning Compositional Koopman Operators for Model-Based Control
Finding an embedding space for a linear approximation of a nonlinear dyn...
research
∙
10/03/2019
CLEVRER: CoLlision Events for Video REpresentation and Reasoning
The ability to reason about temporal and causal events from videos lies ...
research
∙
09/28/2019
Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs
We present the DualSMC network that solves continuous POMDPs by learning...
research
∙
09/04/2019
Program-Guided Image Manipulators
Humans are capable of building holistic representations for images at va...
research
∙
06/17/2019
Neurally-Guided Structure Inference
Most structure inference methods either rely on exhaustive search or are...
research
∙
06/10/2019
DensePhysNet: Learning Dense Physical Object Representations via Multi-step Dynamic Interactions
We study the problem of learning physical object representations for rob...
research
∙
04/26/2019
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision
We propose the Neuro-Symbolic Concept Learner (NS-CL), a model that lear...
research
∙
04/13/2019
Combining Physical Simulators and Object-Based Networks for Control
Physics engines play an important role in robot planning and control; ho...
research
∙
03/12/2019