VIDEO: Disney Uses Kinect to Create Interactive Juggling Robot

Disney Research Pittsburgh has just released the video below which demonstrates one of its latest projects: an audio animatronic robot that can interact with people by playing catch with them. The system uses an off-the-shelf Microsoft Kinect (according to the video’s narration) along with an external camera system (ASUS Xtion PRO LIVE) to locate balls and a Kalman ?lter to predict ball destination and timing. So not only is the robot able to track a human’s position and size by the location of their head, but it can attempt to move its hand to catch the ball. If the robot misses the catch, it’s fully aware and even responds with one of several different humorous animations to elicit a response from the person interacting with it.

Enjoyed this post? Share it!