1. Cap Area .NET June 23, 2009 Poor Man’s Project Natal Frank La Vigne Lead Designer Applied Information Sciences http://www.franksworld.com @Tableteer

2. What is Project Natal?

3. Video Demo You have to see this in action to believe it.

4. The Future?

5. Why Should We Care?

6. Going Beyond GUI NUI

7. Commercial Successes

8. Multi Touch Opportunities on the Horizon Surface

9. Steven Spielberg Has a Budget

10. We Don’t

12. Their Hardware

13. Our Hardware

14. Deconstructing Project Natal Facial Recognition Speech Recognition Motion Recognition Image Scanning

15. Let’s Get Experimenting

16. WPF Speech Recognition Speech Synthesis Touchless SDK Motion Capture Gesturing Replicating Project Natal in .NET

17. Open Source Free Developed by MSFT employee in his “spare time” Uses any web cam* Does not any share code withProject Natal http://www.codeplex.com/touchless Touchless SDK * Web cam must support DirectX

18. Computing a “FacePrint” Distance between the eyes Width of the nose Depth of the eye sockets The shape of the cheekbones The length of the jaw line Facial Recognition As of today, there is no SDK for facial recognition in .NET, But there’s plenty of academic research, white papers and inspiration, so have a go hero. ;)

19. Johnny Lee’s Wii Remote Projects

20. Touchless SDK Demo Exploring the Touchless SDK

21. Speech Demo Interacting just with your voice

22. The desktop metaphor is a relic. You don’t need expensive hardware to get started. You don’t have to wait for Project Natal to get your feet wet. Getting this to work in all environments may be the biggest challenge for Project Natal’s engineers. Take Aways

23. Coming this December Project NeoNatal