TWIST Teleoperated Whole-Body Imitation System for Humanoids

Teleoperated robots are nothing new. We have covered plenty of them in the past. Most of them are limited to basic manipulation tasks. TWIST is a teleoperated whole body imitation system that enables robots to perform more complex movement. The idea here is to use reference motion clips by retargeting human motion capture data to the robot and then use a reinforcement learning and behavior cloning approach for a responsive whole body controller.

TWIST enables robots to open doors, move boxes, reach down, move things with its feet, dance, and crouch & side step across obstacles.

[HT]