Wide ranging talk on visually interactive things for mobile given at Over The Air 2009. The related video clips are linked from: http://blog.geoffballinger.co.uk/2009/09/visual-interactivity-at-over-air-2009.html

1. Mobile … or mobile interactive services for normal people Geoff Ballinger http://www.mobileacuity.com http://blog.geoffballinger.co.uk

2. Overview what is the problem? some real world motivation some fun examples where does AR fit in? visual search ... how do developers engage?

3. Survey … how many people here: use a mobile phone for voice calls? have sent a message from their phone? have a camera on their phone? have used the camera on their phone? have visited a website from their phone? have downloaded an app or a game? what do you think the answers would be for the typical “normob” on the street? x x x x x x x

4. Brand Marketing mobile becoming a serious option often combined with traditional media needs to be inclusive mustn’t be off-putting actually all of this can be said in general about good mobile services … x

5. The Camera … has now arrived:

6. Some dull stats in 2008, 166.6m handsets (Western Europe) are registered as MMS-enabled. That is a 95% penetration! over 90% of all handsets currently being sold have a cameraphone. in the 11-19 demographic 53% regularly use picture messaging, with 85% having used it at least once.* in the 16-34 demographic 78% have used picture messaging with 48% using it regularly. * Source TGI Youth Q2 2008 x x x x

7. 2D bar codes Patent No. 6,999,573 31st Jan 2006 x x

8. Recognition the simplest form of interactivity replaces SMS and keywords etc. but have to ask why bother … … large number of media which can’t necessarily be adapted? x x x x x

9. Who’s who PixTo

10. Image Zoning activation of Vodafone’s Champions League sponsorship take penalties by taking a picture of where you want to aim the ball send in by MMS to see whether you score or not true user interaction

11. Aim with your camera phone See the outcome in your web browser x

12. Colour Nike PhotoiD by AKQA is a great example

13. Videos Shoot and Score Darts Nike PhotoID

14. Blue-screen run as part of the Vodafone Live! Music Awards think blackpool beach – users stick their heads through the display picture sent in by MMS, heads cut out, and incorporated into a music video

15. Snap your mates on a camera phone See them in a personalised video x

16. Facefinder think bluescreen without the screen automatic detection and extraction of the faces in any image much more suitable for viral apps currently all face-likefeatures: in future will distinguishbetween these and real faces x

17. Videos You Rockstar! Facefinder

18. AR What actually is Augmented Reality? Extra digital information overlaid on the real world. AR Toolkit – 3D shapes triggered by 2D codes in the environment. Recently GPS and compass based apps such as , Wikitude, and Bionic Eye.

19. AR Mobile Gaming Also “magic monstervision” game mentioned by Paul Coulton earlier!

20. Layar

21. Visual AR Specific and accurate placement of digital info into the video stream.

22. Videos Arf video snap2Win Live

23. Visual Search General Visual Search? Recognise “all” images? Make the world clickable? Science Fiction? Product Search is happening now!

24. Product Search Snaptell Explorer for Amazon Barnes and Noble store app Mobile Acuity Visual Shopper

25. Visual Shopper

26. Web Services How does the developer get involved with this? Some related code out there – Haar classifiers and AR Toolkit etc Web service API prototypes from Kooaba and Mobile Acuity. Build into your apps.

27. Summary