research
∙
09/19/2023
Guide Your Agent with Adaptive Multimodal Rewards
Developing an agent capable of adapting to unseen environments remains a...
share
research
∙
07/28/2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
We study how vision-language models trained on Internet-scale data can b...
research
∙
07/07/2023
Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulation
What makes generalization hard for imitation learning in visual robotic ...
research
∙
05/24/2023
Barkour: Benchmarking Animal-level Agility with Quadruped Robots
Animals have evolved various agile locomotion strategies, such as sprint...
research
∙
10/24/2022
FCM: Forgetful Causal Masking Makes Causal Language Models Better Zero-Shot Learners
Large language models (LLM) trained using the next-token-prediction obje...
research
∙
10/24/2022
Instruction-Following Agents with Jointly Pre-Trained Vision-Language Models
Humans are excellent at understanding language and vision to accomplish ...
research
∙
08/19/2022
Spectral Decomposition Representation for Reinforcement Learning
Representation learning often plays a critical role in reinforcement lea...
research
∙
05/30/2022
Multi-Game Decision Transformers
A longstanding goal of the field of AI is a strategy for compiling diver...
research
∙
05/27/2022
Multimodal Masked Autoencoders Learn Transferable Representations
Building scalable models to learn from diverse, multimodal data remains ...
research
∙
11/09/2020
f-IRL: Inverse Reinforcement Learning via State Marginal Matching
Imitation learning is well-suited for robotic tasks where it is difficul...
research
∙
04/06/2020
Weakly-Supervised Reinforcement Learning for Controllable Behavior
Reinforcement learning (RL) is a powerful framework for learning to take...
research
∙
06/12/2019
Efficient Exploration via State Marginal Matching
To solve tasks with sparse rewards, reinforcement learning algorithms mu...
research
∙
02/04/2019
Embodied Multimodal Multitask Learning
Recent efforts on training visual navigation agents conditioned on langu...
research
∙
11/16/2018
On the Complexity of Exploration in Goal-Driven Navigation
Building agents that can explore their environments intelligently is a c...
research
∙
06/17/2018
Gated Path Planning Networks
Value Iteration Networks (VINs) are effective differentiable path planni...
research
∙
09/08/2017
Combining LSTM and Latent Topic Modeling for Mortality Prediction
There is a great need for technologies that can predict the mortality of...
research
∙
08/01/2017
Dual Motion GAN for Future-Flow Embedded Video Prediction
Future frame prediction in videos is a promising avenue for unsupervised...
research
∙
03/08/2017
Deep Variation-structured Reinforcement Learning for Visual Relationship and Attribute Detection
Despite progress in visual perception tasks such as image classification...
research
∙
11/29/2015