Invited speaker for special session at the 1st International IEEE Consumer Electronics Society's Games Innovations Conference 2009 (ICE-GIC 09)

1. Space Invading:
An approch to sensing ...
Hornsby Adrian
Tampere University of Technology
IEEE CE Games Innovation Conference
London 25-28th August 2009

2. About the speaker

3. Mission statement
Research on systems, services and
applications for advanced digital media
integration and convergence in
heterogeneous environment.

4. From data to knowledge
→ Data are often viewed as a
lowest level of abstraction from
which information and knowledge
are derived.
→ Data comes from sensors

5. The notion of sensing

6. Raw sensing ...

7. Sensors and small devices in the
future
Internet of Things = 1012
Fringe Internet = 109
Core Internet
= 106

8. Accessing this mine of information
Information
Thought-like
world
Available Developers
Web-like Service world
Middle-ware Platform World
Low-Level
Device world

9. eXtensible Message and Presence
Protocol - XMPP
open technologies for instant messaging, presence, multi-party chat, voice and video
calls, collaboration, lightweight middleware, content syndication, and generalized routing
of XML data and much more ...
XMPP offers several key advantages over such services:
* Open
* Standard
* Proven
* Decentralized Jabber Jabber
Server Server
* Secure Domain Internet Domain
(tut.jabber.a) (nokia.jabber.com)
* Extensible
* Flexible
* Diverse
Client Client
A B
Adrian@tut.jabber.fi Rod@nokia.jabber.com

10. XMPP <stream>
<stream>
<presence>
<show/> sensors available
</presence>
<message to='tom'>
→ information
Stanza <body/>
....Push
</message> mechanism
<iq to='tom'>
<query/> → ← whats the temperature ?
</iq>
[ ... ]
</stream>

11. XMPP' secret weapon
•
Presence
•
PubSub
•
Discovery

12. The case of XMPP

13. µXMPP for low power devices

14. µXMPP for low power sensors

15. Are the toilets free ?
Internet
The closest free toilet
uXMPP sensors

16. Application area

17. But also … Real-time augmented
reality

18. What about games ??
• Games of tag using wireless sensors?
• Interactive role-playing games with sensors?
• Game Design and Real-Time User satisfaction
Help this kid brush
his teeth !!!
mybrush.sensor.com

19. Some thoughts related to content,
experience and games ...

20. Learn from people
Kolb (1984) model inspired by the work of Kurt Lewin.
Concrete Reflective
Experience Observation
Learning = Fun
Active Abstract
Experimentation Conceptualisation

21. The notion of sensing

22. Multimedia sensing
• Audio and visual features extraction (TUT-Muvis)

23. Even more than that ...

SMS

Emails

Call logging Life Logging + Raw Sensing

Phonebook
Pattern

Blogs Extraction

Forums

Social Website Behavior, Social and Context knowledge

Galleries --EXPERIENCE--

Games

...
New INPUT to my system

24. You were In ISCE 2009 in Tokyo
The system noticed you enjoyed Karaoke with CE members
You are now in ICE-Game 2009 conference
Do you want the list of karaoke places next to Imperial ??

25. Cycle of experience ...

26. Reflective interaction ...

27. The future ...
• Low Power Multimedia streaming “Jingle”
• The real and the virtual tightly connected
– By sensor networks, location, wireless networks, ...
• Connecting users and giving more control over:
– The choices
– The path
– The content
– The social
• Natural navigational paths to information,
experiences, relationships and communication

28. The current barriers ...
REAL-TIME

29. Make it happen !!
“Alone we can do so little; together we can do so
much.”
Helen Keller
1880-1968
Helen Adams Keller was an American author, activist and lecturer. She was the first deaf-blind person to
graduate from college.

30. “And that's just the beginning ...”