Learning Low-Frequency Motion Control for Robust and Dynamic Robot Locomotion

09/29/2022
by   Siddhant Gangapurwala, et al.
16

Robotic locomotion is often approached with the goal of maximizing robustness and reactivity by increasing motion control frequency. We challenge this intuitive notion by demonstrating robust and dynamic locomotion with a learned motion controller executing at as low as 8 Hz on a real ANYmal C quadruped. The robot is able to robustly and repeatably achieve a high heading velocity of 1.5 m/s, traverse uneven terrain, and resist unexpected external perturbations. We further present a comparative analysis of deep reinforcement learning (RL) based motion control policies trained and executed at frequencies ranging from 5 Hz to 200 Hz. We show that low-frequency policies are less sensitive to actuation latencies and variations in system dynamics. This is to the extent that a successful sim-to-real transfer can be performed even without any dynamics randomization or actuation modeling. We support this claim through a set of rigorous empirical evaluations. Moreover, to assist reproducibility, we provide the training and deployment code along with an extended analysis at https://ori-drs.github.io/lfmc/.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
12/05/2020

RLOC: Terrain-Aware Legged Locomotion using Reinforcement Learning and Optimal Control

We present a unified model-based and data-driven approach for quadrupeda...
research
09/26/2022

Learning and Deploying Robust Locomotion Policies with Minimal Dynamics Randomization

Training deep reinforcement learning (DRL) locomotion policies often req...
research
04/09/2022

Sim-to-Real Learning for Bipedal Locomotion Under Unsensed Dynamic Loads

Recent work on sim-to-real learning for bipedal locomotion has demonstra...
research
11/04/2020

Dynamics Randomization Revisited:A Case Study for Quadrupedal Locomotion

Understanding the gap between simulation andreality is critical for rein...
research
05/26/2021

Learning Bipedal Robot Locomotion from Human Movement

Teaching an anthropomorphic robot from human example offers the opportun...
research
06/03/2020

Inertial Inchworm Crawling

Inchworm crawling allows for both quasistatic and dynamic gaits at a wid...
research
03/06/2019

Training in Task Space to Speed Up and Guide Reinforcement Learning

Recent breakthroughs in the reinforcement learning (RL) community have m...

Please sign up or login with your details

Forgot password? Click here to reset