Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video

Tuesday, July 5, 2011

Kinect & iPad Hacked To Create Awesome Augmented Reality 3D Video

By IphoneHacks

We’ve seen the iPad hacked to turn it into an iPhone so that one can make calls and send SMS, but this has to be one of the coolest iPad hacks that we’ve seen so far.
Kinect + iPad hack
Folks at Laan Labs – developer of iOS apps such as AR Soccer has figured out a way to record 3D data using XBox Kinect and play it back in augmented reality on the iPad 2.
They have explained how they managed to do it on their blog:
Libfreenect from http://openkinect.org/ project was used for recording the data coming from the Kinect. A textured mesh was created from the calibrated depth+rgb data for each frame and played back in real-time. A simple depth cutoff allowed us isolate the person in the video from the walls and other objects.
Using the String SDK, we projected it back onto a printed image marker in the real world. We also experimented with actively removing the image marker from the scene using camera data from the areas surrounding the image marker.
You have to checkout the video to believe it:
Laan Labs has developed iOS apps like AR Soccer (iTunes link), which aims to bring augmented reality soccer to the iPhone.
Let us know what you think about the Kinect and iPad hack in the comments below.