Seeing Differently, Acting Similarly: Imitation Learning with Heterogeneous Observations

by   Xin-Qiang Cai, et al.

In many real-world imitation learning tasks, the demonstrator and the learner have to act in different but full observation spaces. This situation generates significant obstacles for existing imitation learning approaches to work, even when they are combined with traditional space adaptation techniques. The main challenge lies in bridging expert's occupancy measures to learner's dynamically changing occupancy measures under the different observation spaces. In this work, we model the above learning problem as Heterogeneous Observations Imitation Learning (HOIL). We propose the Importance Weighting with REjection (IWRE) algorithm based on the techniques of importance-weighting, learning with rejection, and active querying to solve the key challenge of occupancy measure matching. Experimental results show that IWRE can successfully solve HOIL tasks, including the challenging task of transforming the vision-based demonstrations to random access memory (RAM)-based policies under the Atari domain.


HILONet: Hierarchical Imitation Learning from Non-Aligned Observations

It is challenging learning from demonstrated observation-only trajectori...

VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigation

While imitation learning for vision based autonomous mobile robot naviga...

Optimism is All You Need: Model-Based Imitation Learning From Observation Alone

This paper studies Imitation Learning from Observations alone (ILFO) whe...

Global overview of Imitation Learning

Imitation Learning is a sequential task where the learner tries to mimic...

Regression via Kirszbraun Extension with Applications to Imitation Learning

Learning by demonstration is a versatile and rapid mechanism for transfe...

Learning and Extrapolation of Robotic Skills using Task-Parameterized Equation Learner Networks

Imitation learning approaches achieve good generalization within the ran...

Action Assembly: Sparse Imitation Learning for Text Based Games with Combinatorial Action Spaces

We propose a computationally efficient algorithm that combines compresse...

Please sign up or login with your details

Forgot password? Click here to reset