SlideShare uma empresa Scribd logo
1 de 34
No IM Please, We’re Testing Richard Boardman CHI 2006, Montreal, April 24th 2006
Instant Messaging in Usability Studies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Usability Lab Setup Interview Room Observation Room  1-way mirror
Usability Lab Setup Interview Room Observation Room Moderator User  1-way mirror
Usability Lab Setup Interview Room Observation Room Moderator User  1-way mirror Eng PM UI
Usability Lab Setup  + Instant Messaging Eng PM Moderator User UI  1-way mirror Interview Room Observation Room
Personal Experiences with IM in Usability
The Usability Nightmare - **BUGS** UI Eng PM Moderator User ??? Oh no - I broke their  computer. I hope  they still pay me sorry, I just rebooted the server
Complex Multi-step Coordination UI Eng PM move on yet? keep her talking, We’re updating the database This is boring,  I want my $$$ Moderator User
Questions from Team UI Eng PM Moderator User Any more questions on this page? does she like the colours? What should I spend my $$$ on?
The Chatterbox PM UI Eng PM Moderator User pls turn off the pm’s laptop VIA TESTED IM:   Baseball … blah blah … VIA TESTED IM: Nice to meet another Giants fan … blah blah …
Survey
What do others think of this technique? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Negative Feedback - IM as a distraction
“ It distracts the moderator” UI Eng PM Moderator User Blah blah blah blah … Uh oh, what did the user do just then? **Amazing revelation**
“ It distracts the observers” UI Eng PM Moderator User What does “http” mean? 101101 … **Amazing revelation** Wow - I hope they fix that ! <html> …
Moderators: “Danger of back seat drivers …” UI Eng PM Moderator User Yeah right … I’m in charge here! Move onto page2. Prompt them to do Y. Ask if they love  the tool
Moderators: “It distracts the user” UI Eng PM Moderator User Is he doing his email? blah … <html> …
Moderators: “Observers may not turn up” Moderator User This team really buys into Usability! Its great to have lots of observers its sooooo sunny in santa cruz. hows the test goin?
Positive Feedback - IM as a Tool
“ Handy for when the UI goes belly up” UI Eng PM Moderator User Sorry, I just rebooted the server Grrr … Grrrr … Grrr … I’m sorry, Did I break Your computer?
“ Handy for extra questions” UI Eng PM Moderator User any more q’s b4 we  wrap up? Aggh, when is this going to finish??
Moderators: “Useful for training” Backup moderator Eng PM Moderator User Try saying this …  << smooth diplomatic phrase>> Help!!! Rant! Rave! Gibber! $%&*! This makes me SO ANGRY!!!! Someone better call security
Observers: “So I can call in from the pool” Moderator User Its nice of UI to check in from the NY office … how’s it going? NY is  really  cold
Guidelines
Guideline: 1-way IM only UI Eng PM Moderator User Why won’t he reply??
Guideline: One to one IM UI Eng PM Moderator User pls ask about  feature foo ask others for extra questions
Create a special, secure IM account UI Eng PM Moderator User **Hello Richard This is your mother** Why is he blushing?
End of Session only UI Eng PM Moderator User Oops, we used the old version, can we start again? any more q’s b4 we  wrap up?
Don’t distract user UI Eng PM Moderator User That’s a nice chat alert! I wonder if I can get it as a ringtone for my phone?
Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
CHI 2006, Montreal, April 24th 2006 No IM Please, We’re Testing Rick Boardman [email_address] PS: We’re recruiting Thank you to survey respondents!
Go back
Go back (really)

Mais conteúdo relacionado

Semelhante a No IM Please, Were Testing

A quick introduction to User Experience
A quick introduction to User ExperienceA quick introduction to User Experience
A quick introduction to User Experience
Pierre Sauvignon
 
User Research on a Shoestring
User Research on a ShoestringUser Research on a Shoestring
User Research on a Shoestring
teaguese
 
Educate with articulate
Educate with articulateEducate with articulate
Educate with articulate
James O'Neill
 
You Can UX Too: Avoiding the Programmer's User Interface @ NEPHP 2013
You Can UX Too: Avoiding the Programmer's User Interface @ NEPHP 2013You Can UX Too: Avoiding the Programmer's User Interface @ NEPHP 2013
You Can UX Too: Avoiding the Programmer's User Interface @ NEPHP 2013
Eryn O'Neil
 

Semelhante a No IM Please, Were Testing (20)

Pecha kucha a3
Pecha kucha a3Pecha kucha a3
Pecha kucha a3
 
Pair Programming - Be the best pair you can be.
Pair Programming - Be the best pair you can be.Pair Programming - Be the best pair you can be.
Pair Programming - Be the best pair you can be.
 
Start with the problem, not with the solution!
Start with the problem, not with the solution!Start with the problem, not with the solution!
Start with the problem, not with the solution!
 
ISTA 2017: Practical Chatbots - Technology Overview with Real-Life Stories
ISTA 2017: Practical Chatbots - Technology Overview with Real-Life StoriesISTA 2017: Practical Chatbots - Technology Overview with Real-Life Stories
ISTA 2017: Practical Chatbots - Technology Overview with Real-Life Stories
 
UI is not the same as UX and why you should care about that (Be-Delphi 2.0)
UI is not the same as UX and why you should care about that (Be-Delphi 2.0)UI is not the same as UX and why you should care about that (Be-Delphi 2.0)
UI is not the same as UX and why you should care about that (Be-Delphi 2.0)
 
Usability Testing is Easy!
Usability Testing is Easy!Usability Testing is Easy!
Usability Testing is Easy!
 
ISA15 Fast and cheap user research that you will actually want to do - Guille...
ISA15 Fast and cheap user research that you will actually want to do - Guille...ISA15 Fast and cheap user research that you will actually want to do - Guille...
ISA15 Fast and cheap user research that you will actually want to do - Guille...
 
Web valley talk - usability, visualization and mobile app development
Web valley talk - usability, visualization and mobile app developmentWeb valley talk - usability, visualization and mobile app development
Web valley talk - usability, visualization and mobile app development
 
Reform Symposium Elluminate Presenter Training
Reform Symposium Elluminate Presenter TrainingReform Symposium Elluminate Presenter Training
Reform Symposium Elluminate Presenter Training
 
Automating mobile usability heuristics
Automating mobile usability heuristicsAutomating mobile usability heuristics
Automating mobile usability heuristics
 
Low Code Development: Workflow
Low Code Development: WorkflowLow Code Development: Workflow
Low Code Development: Workflow
 
Craft conference — uncomfortable ux 25apr14
Craft conference — uncomfortable ux 25apr14Craft conference — uncomfortable ux 25apr14
Craft conference — uncomfortable ux 25apr14
 
A quick introduction to User Experience
A quick introduction to User ExperienceA quick introduction to User Experience
A quick introduction to User Experience
 
User Research on a Shoestring
User Research on a ShoestringUser Research on a Shoestring
User Research on a Shoestring
 
Educate with articulate
Educate with articulateEducate with articulate
Educate with articulate
 
Сергей Поплавский "DeepDive в Bot платформу Microsoft. Технические аспекты ра...
Сергей Поплавский "DeepDive в Bot платформу Microsoft. Технические аспекты ра...Сергей Поплавский "DeepDive в Bot платформу Microsoft. Технические аспекты ра...
Сергей Поплавский "DeepDive в Bot платформу Microsoft. Технические аспекты ра...
 
Webinar on Webinars
Webinar on WebinarsWebinar on Webinars
Webinar on Webinars
 
You Can UX Too: Avoiding the Programmer's User Interface @ NEPHP 2013
You Can UX Too: Avoiding the Programmer's User Interface @ NEPHP 2013You Can UX Too: Avoiding the Programmer's User Interface @ NEPHP 2013
You Can UX Too: Avoiding the Programmer's User Interface @ NEPHP 2013
 
Ray Jimenez - How to Create No-Lecture Webinars - Presented by Training Magaz...
Ray Jimenez - How to Create No-Lecture Webinars - Presented by Training Magaz...Ray Jimenez - How to Create No-Lecture Webinars - Presented by Training Magaz...
Ray Jimenez - How to Create No-Lecture Webinars - Presented by Training Magaz...
 
HeartCheck_third_deadline
HeartCheck_third_deadlineHeartCheck_third_deadline
HeartCheck_third_deadline
 

Mais de Rick Boardman

Gaining Empathy with your Users - the RTFM of User Experience
Gaining Empathy with your Users - the RTFM of User ExperienceGaining Empathy with your Users - the RTFM of User Experience
Gaining Empathy with your Users - the RTFM of User Experience
Rick Boardman
 
Checklistux interaction flowandusability
Checklistux interaction flowandusabilityChecklistux interaction flowandusability
Checklistux interaction flowandusability
Rick Boardman
 
The RTFM of Usability at LUXR June 2011
The RTFM of Usability at LUXR June 2011The RTFM of Usability at LUXR June 2011
The RTFM of Usability at LUXR June 2011
Rick Boardman
 
Lean UX Bootcamp @ 500 Startups - Intro to Usability
Lean UX Bootcamp @ 500 Startups - Intro to UsabilityLean UX Bootcamp @ 500 Startups - Intro to Usability
Lean UX Bootcamp @ 500 Startups - Intro to Usability
Rick Boardman
 
Hyperscope UX analysis
Hyperscope UX analysisHyperscope UX analysis
Hyperscope UX analysis
Rick Boardman
 
PhD Defense: Improving tool support for personal information management
PhD Defense: Improving tool support for personal information managementPhD Defense: Improving tool support for personal information management
PhD Defense: Improving tool support for personal information management
Rick Boardman
 

Mais de Rick Boardman (10)

Gaining Empathy with your Users - the RTFM of User Experience
Gaining Empathy with your Users - the RTFM of User ExperienceGaining Empathy with your Users - the RTFM of User Experience
Gaining Empathy with your Users - the RTFM of User Experience
 
Checklistux interaction flowandusability
Checklistux interaction flowandusabilityChecklistux interaction flowandusability
Checklistux interaction flowandusability
 
Balsamiq interviews
Balsamiq interviewsBalsamiq interviews
Balsamiq interviews
 
02 analysis
02 analysis02 analysis
02 analysis
 
The RTFM of Usability at LUXR June 2011
The RTFM of Usability at LUXR June 2011The RTFM of Usability at LUXR June 2011
The RTFM of Usability at LUXR June 2011
 
500 Startups UX Bootcamp - Talk to your Effin Users
500 Startups UX Bootcamp - Talk to your Effin Users500 Startups UX Bootcamp - Talk to your Effin Users
500 Startups UX Bootcamp - Talk to your Effin Users
 
Lean UX Bootcamp @ 500 Startups - Intro to Usability
Lean UX Bootcamp @ 500 Startups - Intro to UsabilityLean UX Bootcamp @ 500 Startups - Intro to Usability
Lean UX Bootcamp @ 500 Startups - Intro to Usability
 
Talk to your Fantastic Users @Angelpadorg
Talk to your Fantastic Users @AngelpadorgTalk to your Fantastic Users @Angelpadorg
Talk to your Fantastic Users @Angelpadorg
 
Hyperscope UX analysis
Hyperscope UX analysisHyperscope UX analysis
Hyperscope UX analysis
 
PhD Defense: Improving tool support for personal information management
PhD Defense: Improving tool support for personal information managementPhD Defense: Improving tool support for personal information management
PhD Defense: Improving tool support for personal information management
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Último (20)

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 

No IM Please, Were Testing

  • 1. No IM Please, We’re Testing Richard Boardman CHI 2006, Montreal, April 24th 2006
  • 2.
  • 3. Usability Lab Setup Interview Room Observation Room  1-way mirror
  • 4. Usability Lab Setup Interview Room Observation Room Moderator User  1-way mirror
  • 5. Usability Lab Setup Interview Room Observation Room Moderator User  1-way mirror Eng PM UI
  • 6. Usability Lab Setup + Instant Messaging Eng PM Moderator User UI  1-way mirror Interview Room Observation Room
  • 7. Personal Experiences with IM in Usability
  • 8. The Usability Nightmare - **BUGS** UI Eng PM Moderator User ??? Oh no - I broke their computer. I hope they still pay me sorry, I just rebooted the server
  • 9. Complex Multi-step Coordination UI Eng PM move on yet? keep her talking, We’re updating the database This is boring, I want my $$$ Moderator User
  • 10. Questions from Team UI Eng PM Moderator User Any more questions on this page? does she like the colours? What should I spend my $$$ on?
  • 11. The Chatterbox PM UI Eng PM Moderator User pls turn off the pm’s laptop VIA TESTED IM: Baseball … blah blah … VIA TESTED IM: Nice to meet another Giants fan … blah blah …
  • 13.
  • 14. Negative Feedback - IM as a distraction
  • 15. “ It distracts the moderator” UI Eng PM Moderator User Blah blah blah blah … Uh oh, what did the user do just then? **Amazing revelation**
  • 16. “ It distracts the observers” UI Eng PM Moderator User What does “http” mean? 101101 … **Amazing revelation** Wow - I hope they fix that ! <html> …
  • 17. Moderators: “Danger of back seat drivers …” UI Eng PM Moderator User Yeah right … I’m in charge here! Move onto page2. Prompt them to do Y. Ask if they love the tool
  • 18. Moderators: “It distracts the user” UI Eng PM Moderator User Is he doing his email? blah … <html> …
  • 19. Moderators: “Observers may not turn up” Moderator User This team really buys into Usability! Its great to have lots of observers its sooooo sunny in santa cruz. hows the test goin?
  • 20. Positive Feedback - IM as a Tool
  • 21. “ Handy for when the UI goes belly up” UI Eng PM Moderator User Sorry, I just rebooted the server Grrr … Grrrr … Grrr … I’m sorry, Did I break Your computer?
  • 22. “ Handy for extra questions” UI Eng PM Moderator User any more q’s b4 we wrap up? Aggh, when is this going to finish??
  • 23. Moderators: “Useful for training” Backup moderator Eng PM Moderator User Try saying this … << smooth diplomatic phrase>> Help!!! Rant! Rave! Gibber! $%&*! This makes me SO ANGRY!!!! Someone better call security
  • 24. Observers: “So I can call in from the pool” Moderator User Its nice of UI to check in from the NY office … how’s it going? NY is really cold
  • 26. Guideline: 1-way IM only UI Eng PM Moderator User Why won’t he reply??
  • 27. Guideline: One to one IM UI Eng PM Moderator User pls ask about feature foo ask others for extra questions
  • 28. Create a special, secure IM account UI Eng PM Moderator User **Hello Richard This is your mother** Why is he blushing?
  • 29. End of Session only UI Eng PM Moderator User Oops, we used the old version, can we start again? any more q’s b4 we wrap up?
  • 30. Don’t distract user UI Eng PM Moderator User That’s a nice chat alert! I wonder if I can get it as a ringtone for my phone?
  • 31.
  • 32. CHI 2006, Montreal, April 24th 2006 No IM Please, We’re Testing Rick Boardman [email_address] PS: We’re recruiting Thank you to survey respondents!

Notas do Editor

  1. Hello everyone I’m going to be talking I’ll throw in a few