Developing for Windows 7 Multitouch

1. The Windows® 7 Developer Experience (mt) Microsoft® Corporation

2. Windows 7 Multi-Touch the future is Here!

3. The past drives the future.

4. Input Devices How many people here use a mouse? When was it invented? 1963 !!! by Douglas Englebart When was it first (widely) used? Mid 90’sWhile Xerox put out a computer with a mouse in 1982 and others slowly followed, it was not until the MID 90’s that mice were widely used on the computer (30 YEARS!!!)

5. Input Devices How many people here use a touch screen? When was it invented? 1972 !!! The PLATO IV (Research Scientists At University of Illinois)

6. Multi-touch through the years 1985: Sensor Frame (Carnegie Mellon University) 1992: Flip Keyboard 1995/97: Active Desk

7. Multi-touch through the years 1999: Portfolio Wall 2005: PlayAnywhere 2007: Microsoft Surface Computing

8. Gestures 1983: Video Place / Video Desk (Myron Krueger) Essentially “wrote the book” in terms of unencumbered (i.e., no gloves, mice, styli, etc.) rich gestural interaction.

9. Touch History About the same time the mac came out

10. Touch Phones 2006: Synaptics & Pilotfish (San Jose) http://www.synaptics.com 2007: Apple iPhone 1992: Simon (IBM & Bell South) The first touch phone

11. “So how can I play with this now??”

12. 3 things to know…. the screens the hardware the software

13. The Screens

14. How to touch ResistiveThink Push Down and drag

15. How to touch CapacitiveThink Electric Impulse

16. How to touch InfraredThink laser pointer(s)

17. The Hardware

18. Hardware Capacitive HP Touchsmart tx2N-trig (2-10) Capacitive Dell LatitudeXT2N-Trig (2-10) Infrared HP Touchsmart IQ816 NewWindow(2)

19. The Software

20. Multi-Touch Development TiersGood – Better – Best Windows application can target one of three levels of touch integration Good: No specific touch APIs are used but the application UI is appropriately sized and works well with the built-in gestures Better: The gesture APIs are supported to give smooth natural interactions Best: Deep touch-focused experiences designed to take advantage of multi-touch features

21. WM_Touch – WM_Gesture

22. Windows7.Multitouch Easy to Write code now PC’s, Form Factors, Technology Windows7.Multitouch.WPF WM_Touch

23. Massive Multi-touch, Multi-user Easier to Write code soon PC’s, Form Factors, Technology

24. The API protected event EventHandler<WMTouchEventArgs> Touchdown; // touch down event handler protected event EventHandler<WMTouchEventArgs> Touchup; // touch up event handler protected event EventHandler<WMTouchEventArgs> TouchMove; // touch move event handler // Private data members private int x; // touch x client coordinate in pixels private int y; // touch y client coordinate in pixels private int id; // contact ID private int mask; // mask which fields in the structure are valid private int flags; // flags private int time; // touch event time private intcontactX; // x size of the contact area in pixels private intcontactY; // y size of the contact area in pixels

25. Working with MultiTouch demo

26. More Information Multi-Touch Systems that I Have Known and Loved http://www.billbuxton.com/multitouchOverview.html Mike Taulty’s Blog http://bit.ly/NKVTN Example Photo App http://bit.ly/d4eE9

27. Multi-touch is not new 1972: PLATO IV Touch Screen Terminal Windows 7 Multi-touch Touchable Hologram Present Future (http://bit.ly/akq7V) Past

28. The End(or a new beginning)

30. Lightning Rod Franklin Stove Odometer

31. Leonardo Da Vinci Helecopter Eight Barrel Machine Gun Parachute

32. Thomas Edison Phonograph Film Projector Light Bulb

33. George Jetson

34. Jet packs

35. Big Flatscreen TV's

36. Robot Housekeepers

39. Guestures and Movement What can I do?

40. Predefined Gestures – Translate Place two fingers in the application window and drag in the direction you want

41. Zoom and Rotate Rotate Touch the image with two fingers and turn fingers in a circle Zoom Touch the image with two fingers and move them closer or further apart

42. Two Finger Tapand Finger Roll Two Finger Tap Tap once with both fingers Finger Roll Place one finger on the screen, place second finger on the screen, lift the second finger, and then lift the first finger

43. Manipulations Manipulations are a great foundation for touch-optimized experiences. They are: 2D affine transformations (translate, scale, rotate) Superset of supported gestures Supports multiple concurrent manipulations Need a source of raw data: WM_TOUCH Similar to Surface APIs Interfaces: IManipulationProcessor IManipulationEvents

44. Inertia Provides basic physics Works hand in hand with manipulations Interfaces: IInertiaProcessor IManipulationEvents – Same event interface as manipulations