SlideShare uma empresa Scribd logo
1 de 43
Designing Interaction for the Internet of Things
Fahim Kawsar
Bell Labs
“This talk is about Consumer IoT”
1 2
3
Users Connected Objects
Web Services Data Management Platforms
Focus of the Talk
Consumer IoT
“A computationally instrumented tangible object with an established purpose that augments human
perception and is aware of its operational situations and capable of providing supplementary
services without compromising its original appearance and interaction metaphor significantly.”
(Kawsar, 2007)
Mediacup
Beigl 1999
Intelligent Spoon
Ishii 1997
Ambient Device
2004
Aware Mirror
Fujinami 2004
Smart Furniture
Tokuda 2004
Intelligent Spoon
Selker 2004
Smart Objects
Perceptual Augmentation
Connectivity
Situational
Awareness
Supplementary Services
Smart Objects are the Building Blocks of
Consumer IoT
Form factor and interaction consistency need to be maintained.
Ubicomp 2005, Soc-EUSAI 2005, IE 2007, MUM 2007, SIGAPP SAC 2006
Pervasive 2005
ACM UIST 2007
ACM MobileHCI 2010
Some Serious Applications
Prevention of Knuckle Syndrome by Situated Feedback
Some Serious Applications
Prevention of Adverse Drug Events
Interaction and User Interface
Discovery
Control
Feedback
Graphical
UI
Static
(Desktop)
Natural
UI
Voice
GestureEye
Mobile
Spatial
(Projected)
Augmented Reality
Tangible
UI
Direct
Manipulation
Embodiment
Metaphoric
Virtual
Reality
Brain
Consumer IoT - Interaction Space
For managing
smart objects
and profiles
For managing
applications
For administrating
smart objects
and applications
GUI Interaction
Hard to Understand
Conflicting Mental Model
Missing Tangibility
Mobile UI Interaction
Introduces Situational Disability
TUI Interaction
Introduces Spatial Distribution
Mobile Augmented Reality UI Interaction
Decomposition of the Interaction Space
90
Spatial UI Interaction with Mobile Projector
Implications
Introduces Fragmentation of Attention
Needs Better Hand Eye Co-ordination
90
Spatial UI Interaction with Wearable Projector
Implications
Introduces Fragmentation of Attention
What happened in the mean time…
There is an app for this..
Current IoT Interactions
App Driven
Object Centric
Spatially Fixed
Temporally Constrained
Human’s Interactions
Activity Centric
Spatially Distributed
Temporally Dispersed
Direct Background
Device
Swarm
One App One Service

Reactive Model
One App Few Identical Devices
Reactive Model
One App One Device

Proactive Model
One Experience Many Devices

Intelligible Model
• Why Partial:
• No or little Understanding of Human Activity
• A Lot of False Positives due to One Directional Sensing
Scott Jenson’s UX Grid for IoT
Reflective
UX
Spontaneous
Personalised
Opportunistic
Activity Aware
Relevant
Reflective
UX
Discovery
Control
Feedback
DisappearIn-Situ
Reflective UX for IoT
Design with Purposeful Data
• Understand User Intention
• Offer Ranked Services
• Put User at Control
Design with Activity Awareness
• Offer Situated Guidance
• Just In Time Information
Design for Opportunistic UI
• Use Environment
• Short Lived
• Spontaneous
Design for Ambient Attention
• Glanceable Display
• Proxemic Interaction
• Use in-situ Feedback
Design for Personalisation
Design for Story Telling
• Sense Making to Story Telling
• Make it Social
Future : Intention Driven Reflective UX
Mobile Sensing
Trace
Participatory Sensing
Trace
Spontaneous
Personalised
Adaptive
Opportunistic
Activity Aware
Relevant
Wearable Sensing
Trace
Environment
Sensing Trace
Behaviour
Models
1 2
Reflective
UX
Web Services
Connected Objects
Internet of Things Research @ Bell Labs
Behaviour Modeling
Smart Object Modeling
Mobile Sensing
Participatory Sensing
Evolutionary Graph
Real World SearchIndoor Localisation
HCI Studies
Pervasive Display
Pervasive Privacy
EF5
EF5
EF5
Novel Services For Retail Community
Novel Services For Enterprise Community
Novel Services For Urban Community
Thank You
Fahim Kawsar
@raswak
eMail: fahim.kawsar@bell-labs.com

Mais conteúdo relacionado

Mais procurados

The rise of digital humanitarianism
The rise of digital humanitarianismThe rise of digital humanitarianism
The rise of digital humanitarianism
frog
 
SNAIL Project for IoT Connectivity
SNAIL Project for IoT ConnectivitySNAIL Project for IoT Connectivity
SNAIL Project for IoT Connectivity
Daeyoung Kim
 
Magnetic door lock system for security
Magnetic door lock system for securityMagnetic door lock system for security
Magnetic door lock system for security
Ecway Technologies
 

Mais procurados (20)

Earables for Personal-scale Behaviour Analytics
Earables for Personal-scale Behaviour AnalyticsEarables for Personal-scale Behaviour Analytics
Earables for Personal-scale Behaviour Analytics
 
The rise of digital humanitarianism
The rise of digital humanitarianismThe rise of digital humanitarianism
The rise of digital humanitarianism
 
Future of Technology in Social Media
Future of Technology in Social MediaFuture of Technology in Social Media
Future of Technology in Social Media
 
IRJET- Gesture Recognition using Sixth Sense Technology
IRJET-  	  Gesture Recognition using Sixth Sense TechnologyIRJET-  	  Gesture Recognition using Sixth Sense Technology
IRJET- Gesture Recognition using Sixth Sense Technology
 
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew TuckerCloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
 
Now & Next - Mediacom
Now & Next - MediacomNow & Next - Mediacom
Now & Next - Mediacom
 
ACC-2012, Bangalore, India, 28 July, 2012
ACC-2012, Bangalore, India, 28 July, 2012ACC-2012, Bangalore, India, 28 July, 2012
ACC-2012, Bangalore, India, 28 July, 2012
 
9/23 Top 5 Deep Learning
9/23 Top 5 Deep Learning9/23 Top 5 Deep Learning
9/23 Top 5 Deep Learning
 
IoT Methodology Co-creation Workshop with Kraak de Krook and Smart City Ghent...
IoT Methodology Co-creation Workshop with Kraak de Krook and Smart City Ghent...IoT Methodology Co-creation Workshop with Kraak de Krook and Smart City Ghent...
IoT Methodology Co-creation Workshop with Kraak de Krook and Smart City Ghent...
 
The Internet of Things: Designing for a new dimension in user experience
The Internet of Things: Designing for a new dimension in user experienceThe Internet of Things: Designing for a new dimension in user experience
The Internet of Things: Designing for a new dimension in user experience
 
The Ubhave Framework
The Ubhave FrameworkThe Ubhave Framework
The Ubhave Framework
 
Anticipating GDPR in Smart Homes Through Fictional Conversational Objects
Anticipating GDPR in Smart Homes Through Fictional Conversational ObjectsAnticipating GDPR in Smart Homes Through Fictional Conversational Objects
Anticipating GDPR in Smart Homes Through Fictional Conversational Objects
 
ThingsConAMS - Stakeholders in a new world - Rob van Kranenburg
ThingsConAMS - Stakeholders in a new world - Rob van KranenburgThingsConAMS - Stakeholders in a new world - Rob van Kranenburg
ThingsConAMS - Stakeholders in a new world - Rob van Kranenburg
 
Rob van Kranenburg @ Thingscon Amsterdam
Rob van Kranenburg @ Thingscon AmsterdamRob van Kranenburg @ Thingscon Amsterdam
Rob van Kranenburg @ Thingscon Amsterdam
 
SNAIL Project for IoT Connectivity
SNAIL Project for IoT ConnectivitySNAIL Project for IoT Connectivity
SNAIL Project for IoT Connectivity
 
Emergingtreands class11 cs
Emergingtreands class11 csEmergingtreands class11 cs
Emergingtreands class11 cs
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
 
Magnetic door lock system for security
Magnetic door lock system for securityMagnetic door lock system for security
Magnetic door lock system for security
 
Er vi alle vindere når ny teknologi, -arbejdsformer og innovation udfordrer d...
Er vi alle vindere når ny teknologi, -arbejdsformer og innovation udfordrer d...Er vi alle vindere når ny teknologi, -arbejdsformer og innovation udfordrer d...
Er vi alle vindere når ny teknologi, -arbejdsformer og innovation udfordrer d...
 
Cognitive computing ppt.
Cognitive computing ppt.Cognitive computing ppt.
Cognitive computing ppt.
 

Destaque

Internet of Things: the next frontier for UX?
Internet of Things: the next frontier for UX?Internet of Things: the next frontier for UX?
Internet of Things: the next frontier for UX?
The Marketing Distillery
 
Creative Media Days 2012 Talk on Opportunistic Activity Modeling
Creative Media Days 2012 Talk on Opportunistic Activity ModelingCreative Media Days 2012 Talk on Opportunistic Activity Modeling
Creative Media Days 2012 Talk on Opportunistic Activity Modeling
Fahim Kawsar
 
The Weird Is Yet To Come - What do we want from a connected world?
The Weird Is Yet To Come - What do we want from a connected world?The Weird Is Yet To Come - What do we want from a connected world?
The Weird Is Yet To Come - What do we want from a connected world?
Martin Spindler
 

Destaque (19)

SXSW 2014: Re-orientating UX Design for the Internet of Things
SXSW 2014: Re-orientating UX Design for the Internet of ThingsSXSW 2014: Re-orientating UX Design for the Internet of Things
SXSW 2014: Re-orientating UX Design for the Internet of Things
 
The Story of Happy Brussels
The Story of Happy Brussels The Story of Happy Brussels
The Story of Happy Brussels
 
Internet of Things: the next frontier for UX?
Internet of Things: the next frontier for UX?Internet of Things: the next frontier for UX?
Internet of Things: the next frontier for UX?
 
UX for the internet of things: ThingsCon 150505
UX for the internet of things: ThingsCon 150505UX for the internet of things: ThingsCon 150505
UX for the internet of things: ThingsCon 150505
 
UX in Industrial Internet Solutions - May 2016 UI/UX Meetup Shanghai
UX in Industrial Internet Solutions - May 2016 UI/UX Meetup ShanghaiUX in Industrial Internet Solutions - May 2016 UI/UX Meetup Shanghai
UX in Industrial Internet Solutions - May 2016 UI/UX Meetup Shanghai
 
UX for Internet of Things
UX for Internet of ThingsUX for Internet of Things
UX for Internet of Things
 
Beyond Screen - User Experience for the Internet of things.
Beyond Screen - User Experience for the Internet of things.Beyond Screen - User Experience for the Internet of things.
Beyond Screen - User Experience for the Internet of things.
 
Pervasive 2011 Talk on Situated Glyphs
Pervasive 2011 Talk on Situated GlyphsPervasive 2011 Talk on Situated Glyphs
Pervasive 2011 Talk on Situated Glyphs
 
Creative Media Days 2012 Talk on Opportunistic Activity Modeling
Creative Media Days 2012 Talk on Opportunistic Activity ModelingCreative Media Days 2012 Talk on Opportunistic Activity Modeling
Creative Media Days 2012 Talk on Opportunistic Activity Modeling
 
The network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshopThe network as a design material: Interaction 16 workshop
The network as a design material: Interaction 16 workshop
 
Interusability: Designing a Coherent System UX
Interusability: Designing a Coherent System UXInterusability: Designing a Coherent System UX
Interusability: Designing a Coherent System UX
 
MobileHCI 2010 Talk on Smart Object Interaction
MobileHCI 2010 Talk on Smart Object Interaction MobileHCI 2010 Talk on Smart Object Interaction
MobileHCI 2010 Talk on Smart Object Interaction
 
UX Design And The Mind (UX Design + Persuasion)
UX  Design And The  Mind (UX Design + Persuasion)UX  Design And The  Mind (UX Design + Persuasion)
UX Design And The Mind (UX Design + Persuasion)
 
The Weird Is Yet To Come - What do we want from a connected world?
The Weird Is Yet To Come - What do we want from a connected world?The Weird Is Yet To Come - What do we want from a connected world?
The Weird Is Yet To Come - What do we want from a connected world?
 
Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010
 
Magical UX and the Internet of Things
Magical UX and the Internet of ThingsMagical UX and the Internet of Things
Magical UX and the Internet of Things
 
Making UX Matter to Your Company
Making UX Matter to Your CompanyMaking UX Matter to Your Company
Making UX Matter to Your Company
 
Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI
 
Why UX #FAILS (with notes)
Why UX #FAILS (with notes)Why UX #FAILS (with notes)
Why UX #FAILS (with notes)
 

Semelhante a Designing UX for the Internet of Things

Next generation User interfaces
Next generation User interfacesNext generation User interfaces
Next generation User interfaces
Harshad Kt
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
shailendra106
 

Semelhante a Designing UX for the Internet of Things (20)

Building Usable AR Interfaces
Building Usable AR InterfacesBuilding Usable AR Interfaces
Building Usable AR Interfaces
 
2013 Lecture 6: AR User Interface Design Guidelines
2013 Lecture 6: AR User Interface Design Guidelines2013 Lecture 6: AR User Interface Design Guidelines
2013 Lecture 6: AR User Interface Design Guidelines
 
Mobile AR lecture 9 - Mobile AR Interface Design
Mobile AR lecture 9 - Mobile AR Interface DesignMobile AR lecture 9 - Mobile AR Interface Design
Mobile AR lecture 9 - Mobile AR Interface Design
 
Comp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research DirectionsComp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research Directions
 
Research Directions in Transitional Interfaces
Research Directions in Transitional InterfacesResearch Directions in Transitional Interfaces
Research Directions in Transitional Interfaces
 
Future Research Directions for Augmented Reality
Future Research Directions for Augmented RealityFuture Research Directions for Augmented Reality
Future Research Directions for Augmented Reality
 
Next generation User interfaces
Next generation User interfacesNext generation User interfaces
Next generation User interfaces
 
2016 AR Summer School - Lecture 5
2016 AR Summer School - Lecture 52016 AR Summer School - Lecture 5
2016 AR Summer School - Lecture 5
 
Intelligent Conversational Agents for Ambient Computing SIGIR 2022 Ruhi Sarik...
Intelligent Conversational Agents for Ambient Computing SIGIR 2022 Ruhi Sarik...Intelligent Conversational Agents for Ambient Computing SIGIR 2022 Ruhi Sarik...
Intelligent Conversational Agents for Ambient Computing SIGIR 2022 Ruhi Sarik...
 
Context-Aware Computing
Context-Aware ComputingContext-Aware Computing
Context-Aware Computing
 
Sixth sense technology(Pranav Mistry)
Sixth sense technology(Pranav Mistry) Sixth sense technology(Pranav Mistry)
Sixth sense technology(Pranav Mistry)
 
Comp4010 Lecture8 Introduction to VR
Comp4010 Lecture8 Introduction to VRComp4010 Lecture8 Introduction to VR
Comp4010 Lecture8 Introduction to VR
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
 
Mobile user experience conference 2009 - The rise of the mobile context
Mobile user experience conference 2009 - The rise of the mobile contextMobile user experience conference 2009 - The rise of the mobile context
Mobile user experience conference 2009 - The rise of the mobile context
 
Integrating IoT Services and Solutions with Metaverse
Integrating IoT Services and Solutions with MetaverseIntegrating IoT Services and Solutions with Metaverse
Integrating IoT Services and Solutions with Metaverse
 
ICS 2208 Lecture 8 Slides AI and VR_.pdf
ICS 2208 Lecture 8 Slides AI and VR_.pdfICS 2208 Lecture 8 Slides AI and VR_.pdf
ICS 2208 Lecture 8 Slides AI and VR_.pdf
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
Sixthsensetechnology
Sixthsensetechnology Sixthsensetechnology
Sixthsensetechnology
 
Ubiquitious Computing: UX When There is No UI
Ubiquitious Computing: UX When There is No UIUbiquitious Computing: UX When There is No UI
Ubiquitious Computing: UX When There is No UI
 
User Experience for Mobile
User Experience for MobileUser Experience for Mobile
User Experience for Mobile
 

Último

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Último (20)

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 

Designing UX for the Internet of Things