Getting robots to understand natural language is nothing new. We have seen a couple of projects covering just that in the past. This video introduces a framework for robots to understand natural language, generate complex plans, and monitor execution.
The idea was tested on the ARMAR-III humanoid robot. It can plan based on its environment and find alternatives to missing objects in the kitchen.
[HT]