Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learning

  • 2024-08-26 18:59:03
  • Xinyang Gu, Yen-Jen Wang, Xiang Zhu, Chengming Shi, Yanjiang Guo, Yichen Liu, Jianyu Chen
  • 0

Abstract

Humanoid robots, with their human-like skeletal structure, are especiallysuited for tasks in human-centric environments. However, this structure isaccompanied by additional challenges in locomotion controller design,especially in complex real-world environments. As a result, existing humanoidrobots are limited to relatively simple terrains, either with model-basedcontrol or model-free reinforcement learning. In this work, we introduceDenoising World Model Learning (DWL), an end-to-end reinforcement learningframework for humanoid locomotion control, which demonstrates the world's firsthumanoid robot to master real-world challenging terrains such as snowy andinclined land in the wild, up and down stairs, and extremely uneven terrains.All scenarios run the same learned neural network with zero-shot sim-to-realtransfer, indicating the superior robustness and generalization capability ofthe proposed method.

 

Quick Read (beta)

loading the full paper ...