VideoMimic Real-to-Sim-to-Real Approach for Training Robots

One way to teach robots how to sit on chairs and do things humans do is by showing them. VideoMimic is just the approach for this. It is a real-to-sim-to-real pipeline that mines every day videos, reconstructs the humans and the environment, and generates whole body control policies for humanoid robots. With this approach, it is easy to train robots to go up and down the stairs, go from sitting to standing from chairs and benches. More importantly, this can be used to train robots for real-time environments.

[HT]