Slides from my "Usability Testing How To's" workshop with Event Handler.
http://www.eventhandler.co.uk/events/uxnightclass-usability2
Westminster Hub, London UK 22 January 2014
===
Who is it for?
This workshop is for those who want to create products that will be easy to use. Usability testing is an important part of the process of designing digital products, but it can often be overlooked due to time, money, and training constraints. In this workshop you'll learn how to test any product's usability without spending a large amount of time and money. And how to use what you've learned to improve the product.
Who is it taught by?
This workshop is being taught by Evgenia Grinblo @grinblo, User Experience Specialist at mobile agency, Future Workshops. Born in Siberia, Jenny freelanced and trained in ethnographic research in Israel and the USA, before bringing her talent to the UK. Her pet peeve is badly written error-messages and she has a growing collection of them. You'll find her speaking on empathy, UX, and other passions.
What you'll learn
An introduction to usability testing - what is it?
Who should you test your product on?
What do you test?
How to facilitate a test and get reliable results
How to manage data and act on your findings with your team
Tools: Cheap, quick and effective testing tools for mobile and the web.
CALL ON â„8923113531 đCall Girls Aminabad Lucknow best Night Fun service
Â
Usability Testing How To's - EventHandler, London Jan 22nd 2014
1. USABILITY TESTING HOW TOâs
For small teams & little budgets
Evgenia (Jenny) Grinblo
& www.eventhandler.co.uk
London, UK January 22, 2013
(This is Henrik)
5. Workshop schedule
USABILITY TESTING
0 / Usability testing introduction
1 / What do we test: preparing a test plan
2 / Facilitating a usability test & recording results
3 / Analysing and presenting key learnings
6. USABILITY TESTING: INTRODUCTION
!
How to run a ÂŁ3000 fool-proof test
â
â
â
â
The easiest, quickest, cheapest methods
Tips on facilitating, note-taking, & prioritising
How to run a usability test tomorrow
Resources & tools to keep learning
!
WHAT TO EXPECT TODAY
6
A
13. USABILITY TESTING: INTRODUCTION
2. EASY TO USE
Doesnât make people feel stupid or inferior to the tool they
are using. Helps them feel in control.
www.errorwallofshame.tumblr.com
13
20. USABILITY TESTING: INTRODUCTION
20
âą Behavioral vs. Self-reported
âą Opportunity to ask âwhy?â
âą Motivates teammates
âą Removes âdesigner biasâ
âą Can be done on prototypes
âą Can be cheap & quick
USABILITY TESTING
25. USABILITY TESTING: INTRODUCTION
âŁ
Friends, family, colleagues
âŁ
Social media followers
âŁ
Existing customers
âŁ
Streets and coïŹee shops
âŁ
Recruitment agencies (<expensive!)
WHERE DO WE FIND PARTICIPANTS?
25
26. USABILITY TESTING: INTRODUCTION
26
Idea stage
DeïŹnition stage
Exploring
Many ideas
High-level
âDream worldâ
Focusing
Best ideas
ReïŹned
Realistic
WHEN DO WE TEST?
AS EARLY AS POSSIBLE
28. USABILITY TESTING: INTRODUCTION
# OF TEAM MEMBERS EXPOSED TO
USERS IS MORE IMPORTANT THAN # OF
USERS
http://www.uie.com/articles/user_exposure_hours/
28
31. USABILITY TESTING: INTRODUCTION
!
â
I was completely surprised at how
cumbersome the users experience with the
app was. Basic tasks were which was so
obvious to me were suddenly a huge
barrier.
â DANIEL
Lead Developer, Future Workshops
http://www.uie.com/articles/user_exposure_hours/
31
32. USABILITY TESTING: INTRODUCTION
32
!
â
... What the usability testing did for me was
really prove how much tech people can
lose sight of who they are building
for. It about going back to basics in some
cases.
â DANIEL
Lead Developer, Future Workshops
http://www.uie.com/articles/user_exposure_hours/
33. USABILITY TESTING: INTRODUCTION
33
1. Highlights where our product isnât intuitive / easy to use
2. Puts team in the shoes of users
3. Helps sell product improvements to stakeholders/ clients
4. Helps prioritise feature backlog
!
IN SUMMARY:
USABILITY TESTING BENEFITS
35. Workshop schedule
USABILITY TESTING
0 / Usability testing introduction
1 / What do we test: preparing a test plan
2 / Facilitating a usability test & recording results
3 / Analysing and presenting key learnings
36. PREPARING A TEST PLAN
To run a test, you need
âŁ
Some representation of your product
âŁ
Preferably interactive
âŁ
Doesnât have to be ïŹnished
âŁ
Or: competitor product!
âŁ
Idea of what you want to test
37. PREPARING A TEST PLAN
What do we test?
âŁ
General impressions
âŁ
Ease of use of critical features
âŁ
Features weâre not sure about (e.g., is the
help clear?)
âŁ
Response to design, iconography
Tip: start from high-level when testing
prototypes, test the details with later builds
38. PREPARING A TEST PLAN
Wide
(Generative)
Narrow
(Validating)
SET THE SCOPE
3
A8
WHY will people use
this product?
HOW do these people
use this product?
39. PREPARING A TEST PLAN
Wide
(Generative)
3
A9
Explore
How is the value
proposition of this tool
ïŹt in with peopleâs lives
ConïŹrm/iterate
Observing what people
do with this tool, in
their own environment
Narrow
(Validating)
SET THE SCOPE
Validate
How do people perform
speciïŹc task with this tool?
40. PREPARING A TEST PLAN
Wide
(Generative)
First...
4
A0
Explore
How is the value
proposition of this tool
ïŹt in with peopleâs lives
ConïŹrm/iterate
Observing what people
do with this tool, in
their own environment
Narrow
(Validating)
SET THE SCOPE
Validate
How do people perform
speciïŹc task with this tool?
41. PREPARING A TEST PLAN
41
Ready?
FIRST IMPRESSIONS: THE 5 SECOND
TEST
43. PREPARING A TEST PLAN
âą What is the purpose of the website/app?
âą Name 3 things you can do with this website
âą Who does this site or app belong to?
âą How do you feel about this organisation?
!
5 SECOND TEST QUESTIONS
4
A3
44. PREPARING A TEST PLAN
Wide
(Generative)
4
A4
Explore
How is the value
proposition of this tool
ïŹt in with peopleâs lives
Now...
ConïŹrm/iterate
Observing what people
do with this tool, in
their own environment
Narrow
(Validating)
SET THE SCOPE
Validate
How do people perform
speciïŹc task with this tool?
45. PREPARING A TEST PLAN
Recruit
Participants
45
Prepare a
test plan
Test
Analyse +
iterate
PREPARING A DETAILED USABILITY
TEST
47. EXERCISE 1
Choose a product to test
Time: 10 minutes
âŁ
We are going to validate an existing,
ïŹnished product
âŁ
As a group, decide on a website or app to
test
âŁ
It can be your app - I must be able to
interact with it
Tip: avoid sites that require logging in (unless
you have a login to share)
49. PREPARING A TEST PLAN
Test plan
!
âŁ
Tasks: What are we testing? Why?
âŁ
Success Paths: What do we expect to
happen?
âŁ
Scenarios: How can we ïŹnd out if our
expectation is true?
50. // TEST PLAN FOR:
// GROUP:
// PART:
// GENERAL SCENARIO
!
Set up the motivation
What we are testing
TASK
// SCENARIO
TASK
// SCENARIO
Motivation to do the task + instructions
!
// INFO (passwords, etc)
!
// INFO (passwords, etc)
!
Information necessary for the task
// SUCCESS PATH
!
What we want/expect the user to do
!
// SUCCESS PATH
!
51. // TEST PLAN FOR:
// GROUP:
// PART:
// GENERAL SCENARIO
!
You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK
Text note
TASK
// SCENARIO
Share a note via e-mail
// SCENARIO
You need to remember what to buy.
Use the app to make a shopping list
!
you can take to the supermarket.
You really liked the new recipe and
you think your friend Jenny will like it
!
too.
Send the recipe to Jenny from within
the app.
// INFORMATION
// INFORMATION
!
Print-out of a recipe from the internet
// SUCCESS PATH
Donât show this to
the participant!
!
Create a text note and make a bulleted
list of ingredients
!
Jennyâs email:
jenny@futureworkshops.com
// SUCCESS PATH
!
E-mail a note to a friend using swipe
to share
52. PREPARING A TEST PLAN
Scenario Structure
!
âŁ
Your character
âŁ
Your motivation
âŁ
What you need to do
âŁ
Any details like login information, etc
53. PREPARING A TEST PLAN
Scenario Tips
âŁ
Avoid using terminology from the
interface (e.g., search, tag, ïŹlter)
âŁ
Scenarios can have steps (e.g., ïŹnd a
recipe and add it to your collection)
âŁ
Escalate the diïŹculty as the test
progresses
54. EXERCISE 2
Test Plan
Time: 20 mins
âŁ
DeïŹne 3 key tasks that must be intuitive
and easy to use in the application
âŁ
Identify the success paths for each task
(what we expect users to do)
âŁ
Decide on a general scenario + write
speciïŹc tasks
âŁ
Run through the test once
55. Workshop schedule
USABILITY TESTING
0 / Usability testing introduction
1 / What do we test: preparing a test plan
2 / Facilitating a usability test & recording results
3 / Analysing and presenting key learnings
56. FACILITATING A TEST & RECORDING RESULTS
Recruit
Participants
Prepare a
test plan
USABILITY TEST STEPS
56
Test
Analyse +
iterate
57. FACILITATING A TEST & RECORDING RESULTS
Facilitating
âŁ
Practice staying quiet
âŁ
Remind the participant to speak out loud
âŁ
Donât give anything away
âŁ
Be reassuring, say thank you
âŁ
If they get stuck, wait (a little)
58. FACILITATING A TEST & RECORDING RESULTS
Facilitator Cheat-Sheet
If they forget to think aloud
âŁ
"What are you thinking right now?"
âŁ
"What are you finding confusing on this
screen?"
âŁ
"I know it's an unusual thing to do but could I
please ask you to keep thinking out loud and
talk as you go along? It really helps me
understand your experience better."
59. FACILITATING A TEST & RECORDING RESULTS
Facilitator Cheat-Sheet
If they get stuck
âŁ
"This is very helpful for us, we are uncovering
a lot of problems in the design that will help us
make the app better."
âŁ
"I can already see how useful this is going to
be in improving the app."
60. FACILITATING A TEST & RECORDING RESULTS
Facilitator Cheat-Sheet
If they have a question
âŁ
"Please continue in the way that makes sense
to you. We will learn a lot from seeing how
you proceed with this without any help."
âŁ
"I will be happy to answer your questions at
the end. Please try to try this task for a bit
longer."
61. FACILITATING A TEST & RECORDING RESULTS
Facilitator Cheat-Sheet
The golden go-to
âŁ
"We expected to uncover problems in the
design. You are not doing anything
wrong - we knew there would be issues and
you are helping us find them."
62. FACILITATING A TEST & RECORDING RESULTS
People will feel stupid.
Make them feel at ease.
62
63. FACILITATING A TEST & RECORDING RESULTS
Ways to record our ïŹndings
From easy to complicated
âŁ
Pair up with a note-taker
âŁ
DIY recording equipment
âŁ
Professional recording equipment
âŁ
Live-stream to a group of stakeholders
64. FACILITATING A TEST & RECORDING RESULTS
Note-taking brings down 2
barriers to testing: time &
equipment
(But Iâll give you some tips on recording later!)
64
65. FACILITATING A TEST & RECORDING RESULTS
Note-taking tips
Only record whatâs important
âŁ
If someone is really happy
âŁ
If someone is really frustrated
âŁ
If someone fails a task
âŁ
Write down short quotes if you can
66. FACILITATING A TEST & RECORDING RESULTS
Notes Example
âą
Taps Map on merchant profile but this opens the system Maps
app â confused
!
âą
Goes to Search and types âcoffee shopsâ but there are no results
â âwhy canât I see whatâs around me?â
!
âą
"If I had to think about something around me, Iâd start the
merchant profile and expect to see other things around me"
!
âą
The icons arenât telling me that Cafe Nero is a coffee shop
!
!
67. FACILITATING A TEST & RECORDING RESULTS
What to bring to the test
Printed scenarios & tasks for participant
Printed scenarios & tasks with success paths for
facilitator
Facilitator script
Optional: List of pre-test and debrief questions
Consent form (if needed)
Pen + paper / recording tools
Test setup checklist
68. FACILITATING A TEST & RECORDING RESULTS
Setting up the test
Reset the mobile app / site to the default
settings
Clear the test area of any open
documents, written notes, etc.
Prepare participant forms: scenarios,
intro script, consent form
Optional: Verify the recording equipment
Optional: Make sure the brightness on
the screen is reduced
69. EXERCISE 3
Usability Test
Time: 40 minutes
âŁ
Every 8 minutes, swap one member of
your group in exchange for a member
from another group
âŁ
The âforeignâ member is the participant
âŁ
Start running through the test youâve
planned
âŁ
Everyone else in the group should be a
facilitator and a note-taker at least once
71. Workshop schedule
USABILITY TESTING
0 / Usability testing introduction
1 / What do we test: preparing a test plan
2 / Facilitating a usability test & recording results
3 / Analysing and presenting key learnings
72. ANALYSING & PRESENTING FINDINGS
Recruit
Participants
Prepare a
test plan
USABILITY TEST STEPS
72
Test
Analyse +
iterate
73. ANALYSING & PRESENTING FINDINGS
What to do with all the data?
âŁ
Identify changes with the biggest impact
& smallest eïŹort as a team
âŁ
Find the âlow-hanging fruitâ
âŁ
What has impact on the bottom line?
âŁ
Put everything else in the ice-box
74. ANALYSING & PRESENTING FINDINGS
Identifying key ïŹndings
High-priority: people fail, or abandon the
task
Medium: people succeed but are
frustrated and unhappy
Low: people would enjoy the app more if...
Tip: Work hard to prioritise the
highest-impact items. You canât ïŹx
everything.
76. ANALYSING & PRESENTING FINDINGS
Presenting ïŹndings
Task
What we expected
to happen
Interface screenshot
here
What really
happened
What we can fix
right now
77. EXERCISE 4
Identifying Key Findings
Time: 15 mins
âŁ
As a group, debrief on each personâs notes
âŁ
Find 2 high, 2 medium, and 2 low-priority
usability problems
âŁ
What will you ïŹx ïŹrst? Why?
âŁ
Jot down a quick summary of key ïŹndings
to present to the larger group
79. SUMMARY & CONCLUSION
Summary
âŁ
Match your test artifact to your scope
âŁ
Plan realistic scenarios that donât give
away the test purpose
âŁ
Be encouraging and open to feedback
âŁ
Record only whatâs needed
âŁ
Prioritise ïŹndings for maximum
impact
81. SUMMARY & CONCLUSION
Usability is only one part
Building a product isnât just about usability:
âŁ
Business goals
âŁ
Usefulness & desirability
âŁ
DiïŹerentiation
âŁ
Vision of the future
⊠But itâs a great start!
82. SUMMARY & CONCLUSION
Usability is only one part
Create a vision of
our oïŹering to
people
Match the vision
with real-world
behavior
Translate user
research into user
tasks
Create interfaces
to support that
journey
Plan the journey
to accomplish
each task
Iterate and
simplify those
interfaces
Test how real
people use our
interfaces
83. SUMMARY & CONCLUSION
DIY Usability
Testing
Steve Krug
8
A3
Lean UX
JeïŹ Gothelf
!
DIVE IN MORE DEEPLY
Remote Research
Nate Bolt & Tony
Tulathimutte
84. SUMMARY & CONCLUSION
â
Any intelligent fool can make things bigger
and more complex. It takes courage, and a
touch of genius, to move in the opposite
direction.
â Albert Einstein
A FINAL THOUGHT
http://www.humanfactors.com/ROIposter.asp
8
A4