Deep IMU Bias Inference for Robust Visual-Inertial Odometry with Factor Graphs

by   Russell Buchanan, et al.

Visual Inertial Odometry (VIO) is one of the most established state estimation methods for mobile platforms. However, when visual tracking fails, VIO algorithms quickly diverge due to rapid error accumulation during inertial data integration. This error is typically modeled as a combination of additive Gaussian noise and a slowly changing bias which evolves as a random walk. In this work, we propose to train a neural network to learn the true bias evolution. We implement and compare two common sequential deep learning architectures: LSTMs and Transformers. Our approach follows from recent learning-based inertial estimators, but, instead of learning a motion model, we target IMU bias explicitly, which allows us to generalize to locomotion patterns unseen in training. We show that our proposed method improves state estimation in visually challenging situations across a wide range of motions by quadrupedal robots, walking humans, and drones. Our experiments show an average 15 vision failure. Importantly, we also demonstrate that models trained with one locomotion pattern (human walking) can be applied to another (quadruped robot trotting) without retraining.


page 1

page 5

page 6


Learning Inertial Odometry for Dynamic Legged Robot State Estimation

This paper introduces a novel proprioceptive state estimator for legged ...

WALK-VIO: Walking-motion-Adaptive Leg Kinematic Constraint Visual-Inertial Odometry for Quadruped Robots

In this paper, WALK-VIO, a novel visual-inertial odometry (VIO) with wal...

VILENS: Visual, Inertial, Lidar, and Leg Odometry for All-Terrain Legged Robots

We present VILENS (Visual Inertial Lidar Legged Navigation System), an o...

Deep Learning-based Inertial Odometry for Pedestrian Tracking using Attention Mechanism and Res2Net Module

Pedestrian dead reckoning is a challenging task due to the low-cost iner...

RIOT: Recursive Inertial Odometry Transformer for Localisation from Low-Cost IMU Measurements

Inertial localisation is an important technique as it enables ego-motion...

IONet: Learning to Cure the Curse of Drift in Inertial Odometry

Inertial sensors play a pivotal role in indoor localization, which in tu...

Knee Motion Generation Method for Transfemoral Prosthesis based on Kinematic Synergy and Inertial Motion

Previous research has shown that the effective use of inertial motion (i...

Please sign up or login with your details

Forgot password? Click here to reset