We used the Intel RealSense SDK In conjunction with the R200 Camera to bring about the fun, interactive and tactile gameplay featured at GDC16. Using Intel® RealSense™ we were able to create a unique gameplay experience with every play through, as the players themselves sculpted the terrain the game used out of sand which was monitored by the camera and our code effectively translated the profile of the sand into a terrain. In this talk we’ll use one of the realsense samples to step through and gain an insight into how that depth data is translated into a usable game object in Unity3d. In this talk, Jon described: 1. Features we used in the Magic and Magnums Tower Defense game 2. Using the Blob Sensing and tracking actions provided in the Unity Toolkit for Realsense 3. Using the Realsense Depth feed to manipulate meshes

1. Realsense R200 & Unity3d
INTRODUCTION TO USING THE R200 CAMERA
AND THE REALSENSE SDK IN UNITY3D
Jon Collins, Kaio Interactive
@TweetBadger
jon.tut@ki-games.com

2. Magic & Magnums TD
Taking the Magic & Magnums
Orbital shooter from tablet format
to a tactile large scale table
experience.
Taking the Codemonkeys original IP
& building an interactive tower
defense game.
Every game world is different as the
player reshapes the world using a
3d depth scan of a sand pit.

3. Key RS200 features used for Magic & Magnums
Dynamic Terrain generation during early stage of the game
Realsense Blob detection and tracking

4. Blob detection and tracking in Unity3d.
The why, the when and the how

5. Why Blob detection and not Hand tracking ?

6. Hand Vs Blob Tracking
Realsense F200 user facing camera Realsense R200 world Facing camera

7. When did we use blob detection in the game.

8. Placement of towers

9. How did we implement it.

10. Time for some code

11. Terrain Generation and Using depth data

12. Generating a world

13. Interpreting depth data.
and the RS SDK Samples.

14. Time for some code

15. Jon Collins, Kaio Interactive
@TweetBadger
jon.tut@ki-games.com
Thank you