He used simultaneous localization and mapping code from OpenSLAM.org, some visualization packets from the Mobile Robot Programming Toolkit, and his own interaction, human detection, and gesture code.

To program a mobile robot to close a door, for example, the user will maneuver the robot's arm to the door and push it closed. The software generates a 3D virtual simulation of the demonstration, ...