Here is a dynamic human-robot interaction system with high-speed vision and a robot hand that can adapt to random human motion at high speed with low latency. It uses machine vision to measure the position and orientation of what is being manipulated by the human and robot.
This system can follow the yaw and roll angles by the human motion. As the above video shows, the researchers managed to achieve a collaborative peg-in-hole with high accuracy.
[Source]