HumanX: Robots Learning Skills by Watching Human Videos

Teaching new skills to robots is getting a lot easier. Researchers are constantly coming up with new ideas to make the process more straightforward. HumanX developed in collaboration between HKUST and the Shanghai Artificial Intelligence Laboratory is a framework that enables robots to learn skills from human videos. It turns human videos into skills for humanoids without task-specific rewards.

This framework combines XMimic, which is an imitation learning framework and XGen, which is a data generation pipeline from human videos.

[HT: Yinhuai Wang, Qihan Zhao, Yuen Fui Lau, Runyi Yu1, Hok Wai Tsui, Qifeng Chen, Jingbo Wang, Jiangmiao Pang, Ping Tan]