SlideShare uma empresa Scribd logo
1 de 134
Baixar para ler offline
USABILITY TESTING HOW TO’s
For small teams & little budgets

Evgenia (Jenny) Grinblo
& www.eventhandler.co.uk
London, UK Oct 24, 2013

(This is Henrik)
USABILITY TESTING: INTRODUCTION

2

Hello, I’m...
Evgenia (Jenny) Grinblo
User Experience Specialist
Future Workshops, London
Workshop schedule

USABILITY TESTING
0 / Usability testing introduction
1 / What do we test: preparing a test plan
2 / Facilitating a usability test & recording results
3 / Analysing and presenting key learnings
USABILITY TESTING: INTRODUCTION

How to run a £3000 fool-proof test

✓
✓
✓
✓

The easiest, quickest, cheapest methods
Tips on facilitating, note-taking, & prioritising
How to run a usability test tomorrow
Resources & tools to keep learning

WHAT TO EXPECT TODAY

4
USABILITY TESTING: INTRODUCTION

What is usability testing
& why do it?

5
USABILITY TESTING: INTRODUCTION

6

USER EXPERIENCE BUILDING
BLOCKS
http://www.flickr.com/photos/7855449@N02/2779597129

Diagram by David Armano
USABILITY TESTING: INTRODUCTION

7

USABILITY IS A MAJOR BUILDING
BLOCK OF A GOOD EXPERIENCE
http://www.flickr.com/photos/7855449@N02/2779597129

Diagram by David Armano
USABILITY TESTING: INTRODUCTION

1. INTUITIVE (n.)
Using what one feels to be true without conscious
reasoning
www.youtube.com

8
USABILITY TESTING: INTRODUCTION

NEEDING INSTRUCTIONS
MEANS SOMETHING CAN BE
MADE MORE SIMPLE

9
USABILITY TESTING: INTRODUCTION

2. EASY TO USE
Doesn’t make people feel stupid or inferior to the tool they
are using. Helps them feel in control.
www.errorwallofshame.tumblr.com

10
USABILITY TESTING: INTRODUCTION

3. ACCESSIBLE
People of different abilities can use it

11
USABILITY TESTING: INTRODUCTION

12

YOU CAN’T DIFFERENTIATE IF
THE EXPERIENCE IS BROKEN
EVERYONE DEEPLY UNDERSTANDS THE USERS

13

67.45% (AVERAGE E-COMMERCE CART
ABANDONMENT RATE)
July 28, 2013

http://baymard.com/lists/cart-abandonment-rate
USABILITY TESTING: INTRODUCTION

http://www.shopify.com/blog/8484093-why-online-retailers-are-losing-67-45-of-sales-and-what-to-do-about-it

14
USABILITY TESTING: INTRODUCTION

http://www.shopify.com/blog/8484093-why-online-retailers-are-losing-67-45-of-sales-and-what-to-do-about-it

15
USABILITY TESTING: INTRODUCTION

16

Analytics

Survey

Usability test

(Impersonal)

(Tricky)

(Immediate, easy)

WHERE TO FIND USABILITY PROBLEMS
USABILITY TESTING: INTRODUCTION

17

• Behavioral vs. Self-reported
• Opportunity to ask “why?”
• Motivates teammates
• Removes “designer bias”
• Can be done on prototypes
• Can be cheap & quick

USABILITY TESTING
USABILITY TESTING: INTRODUCTION

WHAT HAPPENS IN A USABILITY TEST?
Video: http://www.youtube.com/watch?v=QckIzHC99Xc

18
USABILITY TESTING: INTRODUCTION

TEST YOUR IDEAS
REGULARLY WITH REAL
PEOPLE

19
USABILITY TESTING: INTRODUCTION

Recruit
Participants

Prepare a
test plan

USABILITY TEST STEPS

20

Test

Analyse +
iterate
USABILITY TESTING: INTRODUCTION

‣

Anyone who hasn’t seen the app

‣

Similar demographics to real users
(whenever possible)

WHO DO WE TEST WITH?

21
USABILITY TESTING: INTRODUCTION

WHERE DO WE FIND PARTICIPANTS?

22
USABILITY TESTING: INTRODUCTION

‣

Friends, family, colleagues

WHERE DO WE FIND PARTICIPANTS?

22
USABILITY TESTING: INTRODUCTION

‣

Friends, family, colleagues

‣

Social media followers

WHERE DO WE FIND PARTICIPANTS?

22
USABILITY TESTING: INTRODUCTION

‣

Friends, family, colleagues

‣

Social media followers

‣

Existing customers

WHERE DO WE FIND PARTICIPANTS?

22
USABILITY TESTING: INTRODUCTION

‣

Friends, family, colleagues

‣

Social media followers

‣

Existing customers

‣

Streets and coffee shops

WHERE DO WE FIND PARTICIPANTS?

22
USABILITY TESTING: INTRODUCTION

‣

Friends, family, colleagues

‣

Social media followers

‣

Existing customers

‣

Streets and coffee shops

‣

Recruitment agencies (<expensive!)

WHERE DO WE FIND PARTICIPANTS?

22
USABILITY TESTING: INTRODUCTION

23

Idea stage

Definition stage

Exploring
Many ideas
High-level
“Dream world”

Focusing
Best ideas
Refined
Realistic

WHEN DO WE TEST?
AS EARLY AS POSSIBLE
USABILITY TESTING: INTRODUCTION

DO USABILITY TESTING REGULARLY,
WITH YOUR WHOLE TEAM

24
USABILITY TESTING: INTRODUCTION

# OF TEAM MEMBERS EXPOSED TO
USERS IS MORE IMPORTANT THAN # OF
USERS
http://www.uie.com/articles/user_exposure_hours/

25
USABILITY TESTING: INTRODUCTION

26

SOMETIMES IT’S HARD TO ACCEPT YOUR
PRODUCT NEEDS HELP
https://twitter.com/adrianhungate/status/391954628184915970
USABILITY TESTING: INTRODUCTION

WHEN YOU SEE SOMEONE IN PAIN, YOU
WANT TO HELP THEM
http://www.flickr.com/photos/martin_mcdonald/371884786/

27
USABILITY TESTING: INTRODUCTION

“

I was completely surprised at how
cumbersome the users experience with the
app was. Basic tasks were which was so
obvious to me were suddenly a huge
barrier.

— DANIEL
Lead Developer, Future Workshops
http://www.uie.com/articles/user_exposure_hours/

28
USABILITY TESTING: INTRODUCTION

“

29

... What the usability testing did for me was
really prove how much tech people can
lose sight of who they are building
for. It about going back to basics in some
cases.

— DANIEL
Lead Developer, Future Workshops
http://www.uie.com/articles/user_exposure_hours/
USABILITY TESTING: INTRODUCTION

30

1. Highlights where our product isn’t intuitive / easy to use
2. Puts team in the shoes of users
3. Helps sell product improvements to stakeholders/ clients
4. Helps prioritise feature backlog

IN SUMMARY:
USABILITY TESTING BENEFITS
Time for a

5 minute break
Workshop schedule

USABILITY TESTING
0 / Usability testing introduction
1 / What do we test: preparing a test plan
2 / Facilitating a usability test & recording results
3 / Analysing and presenting key learnings
PREPARING A TEST PLAN

To run a test, you need
PREPARING A TEST PLAN

To run a test, you need
‣

Some representation of your product
PREPARING A TEST PLAN

To run a test, you need
‣

Some representation of your product

‣

Preferably interactive
PREPARING A TEST PLAN

To run a test, you need
‣

Some representation of your product

‣

Preferably interactive

‣

Doesn’t have to be finished
PREPARING A TEST PLAN

To run a test, you need
‣

Some representation of your product

‣

Preferably interactive

‣

Doesn’t have to be finished

‣

Or: competitor product!
PREPARING A TEST PLAN

To run a test, you need
‣

Some representation of your product

‣

Preferably interactive

‣

Doesn’t have to be finished

‣

Or: competitor product!

‣

Idea of what you want to test
PREPARING A TEST PLAN

What do we test?
PREPARING A TEST PLAN

What do we test?
‣

General impressions
PREPARING A TEST PLAN

What do we test?
‣

General impressions

‣

Ease of use of critical features
PREPARING A TEST PLAN

What do we test?
‣

General impressions

‣

Ease of use of critical features

‣

Features we’re not sure about (e.g., is the
help clear?)
PREPARING A TEST PLAN

What do we test?
‣

General impressions

‣

Ease of use of critical features

‣

Features we’re not sure about (e.g., is the
help clear?)

‣

Response to design, iconography
PREPARING A TEST PLAN

What do we test?
‣

General impressions

‣

Ease of use of critical features

‣

Features we’re not sure about (e.g., is the
help clear?)

‣

Response to design, iconography
Tip: start from high-level when testing
prototypes, test the details with later builds
PREPARING A TEST PLAN

Wide
(Generative)

SET THE SCOPE

35
PREPARING A TEST PLAN

Wide
(Generative)

SET THE SCOPE

35

WHY will people use
this product?
PREPARING A TEST PLAN

Wide
(Generative)

Narrow
(Validating)

SET THE SCOPE

35

WHY will people use
this product?
PREPARING A TEST PLAN

Wide
(Generative)

Narrow
(Validating)

SET THE SCOPE

35

WHY will people use
this product?

HOW do these people
use this product?
PREPARING A TEST PLAN

Wide
(Generative)

36
Explore
How is the value
proposition of this tool
fit in with people’s lives
Confirm/iterate
Observing what people
do with this tool, in
their own environment

Narrow
(Validating)

SET THE SCOPE

Validate
How do people perform
specific task with this tool?
PREPARING A TEST PLAN

Wide
(Generative)

First...

37

Explore
How is the value
proposition of this tool
fit in with people’s lives
Confirm/iterate
Observing what people
do with this tool, in
their own environment

Narrow
(Validating)

SET THE SCOPE

Validate
How do people perform
specific task with this tool?
PREPARING A TEST PLAN

38

Ready?

FIRST IMPRESSIONS: THE 5 SECOND
TEST
39
PREPARING A TEST PLAN

• What is the purpose of the website/app?
• Name 3 things you can do with this website
• Who does this site or app belong to?
• How do you feel about this organisation?

5 SECOND TEST QUESTIONS

40
PREPARING A TEST PLAN

Wide
(Generative)

41
Explore
How is the value
proposition of this tool
fit in with people’s lives

Now...

Confirm/iterate
Observing what people
do with this tool, in
their own environment

Narrow
(Validating)

SET THE SCOPE

Validate
How do people perform
specific task with this tool?
PREPARING A TEST PLAN

Recruit
Participants

42

Prepare a
test plan

Test

Analyse +
iterate

PREPARING A DETAILED USABILITY
TEST
USABILITY TESTING: INTRODUCTION

THE MORE DETAILED YOUR
ARTIFACT, THE MORE
DETAILED THE FEEDBACK

43
EXERCISE 1

Choose a product to test
Time: 10 minutes

‣

We are going to validate an existing,
finished product

‣

As a group, decide on a website or app to
test

‣

It can be your app - I must be able to
interact with it
Tip: avoid sites that require logging in (unless
you have a login to share)
EXERCISE 3

Show & Tell
PREPARING A TEST PLAN

Scenario Structure
PREPARING A TEST PLAN

Scenario Structure
‣

Your character
PREPARING A TEST PLAN

Scenario Structure
‣

Your character

‣

Your motivation
PREPARING A TEST PLAN

Scenario Structure
‣

Your character

‣

Your motivation

‣

What you need to do
PREPARING A TEST PLAN

Scenario Structure
‣

Your character

‣

Your motivation

‣

What you need to do

‣

Any details like login information, etc
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

TASK

TASK

// SUCCESS PATH

// SCENARIO

// SCENARIO

// INFO (passwords, etc)

// INFO (passwords, etc)

@ Template by @grinblo

// SUCCESS PATH
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

Set up the motivation
TASK

TASK

// SUCCESS PATH

// SCENARIO

// SCENARIO

// INFO (passwords, etc)

// INFO (passwords, etc)

@ Template by @grinblo

// SUCCESS PATH
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

Set up the motivation
What we are testing

TASK

TASK

// SUCCESS PATH

// SCENARIO

// SCENARIO

// INFO (passwords, etc)

// INFO (passwords, etc)

@ Template by @grinblo

// SUCCESS PATH
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

Set up the motivation
What we are testing

TASK

// SUCCESS PATH

TASK

// SUCCESS PATH

What we want/expect the user to do

// INFO (passwords, etc)

// SCENARIO

// INFO (passwords, etc)

@ Template by @grinblo

// SCENARIO
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

Set up the motivation
What we are testing

TASK

// SUCCESS PATH

TASK

// SUCCESS PATH

What we want/expect the user to do
// SCENARIO

// SCENARIO

// INFO (passwords, etc)

// INFO (passwords, etc)

@ Template by @grinblo

Motivation to do the task + instructions
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

Set up the motivation
What we are testing

TASK

// SUCCESS PATH

TASK

// SUCCESS PATH

What we want/expect the user to do
// SCENARIO

// SCENARIO

// INFO (passwords, etc)

Information necessary for the task

// INFO (passwords, etc)

@ Template by @grinblo

Motivation to do the task + instructions
// TEST PLAN FOR:

// GROUP:

// GENERAL SCENARIO

TASK

TASK

// SUCCESS PATH

// SUCCESS PATH

// SCENARIO

// SCENARIO

// INFORMATION

// INFORMATION

// PART:
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

TASK

// SUCCESS PATH

// SUCCESS PATH

// SCENARIO

// SCENARIO

// INFORMATION

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

TASK

// SUCCESS PATH

// SUCCESS PATH

// SCENARIO

// SCENARIO

// INFORMATION

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

// SUCCESS PATH

TASK
// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients
// SCENARIO

// INFORMATION

// SCENARIO

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

// SUCCESS PATH

TASK
// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients
// SCENARIO

// INFORMATION

// SCENARIO

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

Don’t show this to
the participant!

// SUCCESS PATH

TASK
// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients
// SCENARIO

// INFORMATION

// SCENARIO

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

Don’t show this to
the participant!

// SUCCESS PATH

TASK
// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients
// SCENARIO

// SCENARIO

You need to remember what to buy.
Use the app to make a shopping list
you can take to the supermarket.

// INFORMATION

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

Don’t show this to
the participant!

// SUCCESS PATH

TASK
// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients
// SCENARIO

// SCENARIO

You need to remember what to buy.
Use the app to make a shopping list
you can take to the supermarket.

// INFORMATION

Print-out of a recipe from the internet

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

Don’t show this to
the participant!

// SUCCESS PATH

TASK

Share a note via e-mail

// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients
// SCENARIO

// SCENARIO

You need to remember what to buy.
Use the app to make a shopping list
you can take to the supermarket.

// INFORMATION

Print-out of a recipe from the internet

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

Don’t show this to
the participant!

TASK

Share a note via e-mail

// SUCCESS PATH

// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients

E-mail a note to a friend using swipe
to share

// SCENARIO

// SCENARIO

You need to remember what to buy.
Use the app to make a shopping list
you can take to the supermarket.

// INFORMATION

Print-out of a recipe from the internet

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

Don’t show this to
the participant!

TASK

Share a note via e-mail

// SUCCESS PATH

// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients

E-mail a note to a friend using swipe
to share

// SCENARIO

// SCENARIO

You need to remember what to buy.
Use the app to make a shopping list
you can take to the supermarket.

You really liked the new recipe and
you think your friend Jenny will like it
too.
Send the recipe to Jenny from within
the app.

// INFORMATION

Print-out of a recipe from the internet

// INFORMATION
// TEST PLAN FOR:

// GROUP:

// PART:

// GENERAL SCENARIO

You need to cook a new recipe for the company potluck. You found a recipe
online and now you need to buy the ingredients and cook it.
TASK

Text note

Don’t show this to
the participant!

TASK

Share a note via e-mail

// SUCCESS PATH

// SUCCESS PATH

Create a text note and make a bulleted
list of ingredients

E-mail a note to a friend using swipe
to share

// SCENARIO

// SCENARIO

You need to remember what to buy.
Use the app to make a shopping list
you can take to the supermarket.

You really liked the new recipe and
you think your friend Jenny will like it
too.
Send the recipe to Jenny from within
the app.

// INFORMATION

Print-out of a recipe from the internet

// INFORMATION

Jenny’s email:
jenny@futureworkshops.com
PREPARING A TEST PLAN

Scenario Tips
PREPARING A TEST PLAN

Scenario Tips
‣

Avoid using terminology from the
interface (e.g., search, tag, filter)
PREPARING A TEST PLAN

Scenario Tips
‣

Avoid using terminology from the
interface (e.g., search, tag, filter)

‣

Scenarios can have steps (e.g., find a
recipe and add it to your collection)
PREPARING A TEST PLAN

Scenario Tips
‣

Avoid using terminology from the
interface (e.g., search, tag, filter)

‣

Scenarios can have steps (e.g., find a
recipe and add it to your collection)

‣

Escalate the difficulty as the test
progresses
EXERCISE 2

Test Plan
Time: 20 mins

‣

Define 3 key tasks that must be intuitive
and easy to use in the application

‣

Identify the success paths for each task
(what we expect users to do)

‣

Decide on a general scenario + write
specific tasks

‣

Run through the test once
Workshop schedule

USABILITY TESTING
0 / Usability testing introduction
1 / What do we test: preparing a test plan
2 / Facilitating a usability test & recording results
3 / Analysing and presenting key learnings
FACILITATING A TEST & RECORDING RESULTS

Recruit
Participants

Prepare a
test plan

USABILITY TEST STEPS

52

Test

Analyse +
iterate
FACILITATING A TEST & RECORDING RESULTS

Facilitating
‣

Practice staying quiet

‣

Remind the participant to speak out loud

‣

Don’t give anything away

‣

Be reassuring, say thank you

‣

If they get stuck, wait (a little)
FACILITATING A TEST & RECORDING RESULTS

Facilitator Cheat-Sheet
If they forget to think aloud

‣

"What are you thinking right now?"

‣

"What are you finding confusing on this
screen?"

‣

"I know it's an unusual thing to do but could I
please ask you to keep thinking out loud and
talk as you go along? It really helps me
understand your experience better."
FACILITATING A TEST & RECORDING RESULTS

Facilitator Cheat-Sheet
If they get stuck

‣

"This is very helpful for us, we are uncovering
a lot of problems in the design that will help us
make the app better."

‣

"I can already see how useful this is going to
be in improving the app."
FACILITATING A TEST & RECORDING RESULTS

Facilitator Cheat-Sheet
If they have a question

‣

"Please continue in the way that makes sense
to you. We will learn a lot from seeing how
you proceed with this without any help."

‣

"I will be happy to answer your questions at
the end. Please try to try this task for a bit
longer."
FACILITATING A TEST & RECORDING RESULTS

Facilitator Cheat-Sheet
The golden go-to

‣

"We expected to uncover problems in the
design. You are not doing anything
wrong - we knew there would be issues and
you are helping us find them."
FACILITATING A TEST & RECORDING RESULTS

People will feel stupid.
Make them feel at ease.

58
FACILITATING A TEST & RECORDING RESULTS

Ways to record our findings
FACILITATING A TEST & RECORDING RESULTS

Ways to record our findings
From easy to complicated
FACILITATING A TEST & RECORDING RESULTS

Ways to record our findings
From easy to complicated

‣

Pair up with a note-taker
FACILITATING A TEST & RECORDING RESULTS

Ways to record our findings
From easy to complicated

‣

Pair up with a note-taker

‣

DIY recording equipment
FACILITATING A TEST & RECORDING RESULTS

Ways to record our findings
From easy to complicated

‣

Pair up with a note-taker

‣

DIY recording equipment

‣

Professional recording equipment
FACILITATING A TEST & RECORDING RESULTS

Ways to record our findings
From easy to complicated

‣

Pair up with a note-taker

‣

DIY recording equipment

‣

Professional recording equipment

‣

Live-stream to a group of stakeholders
FACILITATING A TEST & RECORDING RESULTS

Note-taking brings down 2
barriers to testing: time &
equipment
(But I’ll give you some tips on recording later!)

60
FACILITATING A TEST & RECORDING RESULTS

Note-taking tips
Only record what’s important

‣

If someone is really happy

‣

If someone is really frustrated

‣

If someone fails a task

‣

Write down short quotes if you can
FACILITATING A TEST & RECORDING RESULTS

Notes Example
•

Taps Map on merchant profile but this opens the system Maps
app — confused

•

Goes to Search and types “coffee shops” but there are no results
— “why can’t I see what’s around me?”

•

"If I had to think about something around me, I’d start the
merchant profile and expect to see other things around me"

•

The icons aren’t telling me that Cafe Nero is a coffee shop
FACILITATING A TEST & RECORDING RESULTS

What to bring to the test
Printed scenarios & tasks for participant
Printed scenarios & tasks with success paths for
facilitator
Facilitator script
Optional: List of pre-test and debrief questions
Consent form (if needed)
Pen + paper / recording tools
Test setup checklist
FACILITATING A TEST & RECORDING RESULTS

Setting up the test
Reset the mobile app / site to the default
settings
Clear the test area of any open
documents, written notes, etc.
Prepare participant forms: scenarios,
intro script, consent form
Optional: Verify the recording equipment
Optional: Make sure the brightness on
the screen is reduced
EXERCISE 3

Usability Test
Time: 40 minutes

‣

Every 8 minutes, swap one member of
your group in exchange for a member
from another group

‣

The ‘foreign’ member is the participant

‣

Start running through the test you’ve
planned

‣

Everyone else in the group should be a
facilitator and a note-taker at least once
EXERCISE 2

Show & Tell
Workshop schedule

USABILITY TESTING
0 / Usability testing introduction
1 / What do we test: preparing a test plan
2 / Facilitating a usability test & recording results
3 / Analysing and presenting key learnings
ANALYSING & PRESENTING FINDINGS

Recruit
Participants

Prepare a
test plan

USABILITY TEST STEPS

68

Test

Analyse +
iterate
ANALYSING & PRESENTING FINDINGS

What to do with all the data?
‣

Identify changes with the biggest impact
& smallest effort as a team

‣

Find the “low-hanging fruit”

‣

What has impact on the bottom line?

‣

Put everything else in the ice-box
ANALYSING & PRESENTING FINDINGS

Identifying key findings
High-priority: people fail, or abandon the
task
Medium: people succeed but are
frustrated and unhappy
Low: people would enjoy the app more if...
ANALYSING & PRESENTING FINDINGS

Identifying key findings
High-priority: people fail, or abandon the
task
Medium: people succeed but are
frustrated and unhappy
Low: people would enjoy the app more if...
Tip: Work hard to prioritise the
highest-impact items. You can’t fix
everything.
ANALYSING & PRESENTING FINDINGS

Presenting findings
ANALYSING & PRESENTING FINDINGS

Presenting findings

Interface screenshot
here
ANALYSING & PRESENTING FINDINGS

Presenting findings
Task

Interface screenshot
here
ANALYSING & PRESENTING FINDINGS

Presenting findings
Task

What we expected
to happen

Interface screenshot
here
ANALYSING & PRESENTING FINDINGS

Presenting findings
Task

What we expected
to happen

Interface screenshot
here
What really
happened
ANALYSING & PRESENTING FINDINGS

Presenting findings
Task

What we expected
to happen

Interface screenshot
here
What really
happened

What we can fix
right now
EXERCISE 4

Identifying Key Findings
Time: 15 mins

‣

As a group, debrief on each person’s notes

‣

Find 2 high, 2 medium, and 2 low-priority
usability problems

‣

What will you fix first? Why?

‣

Jot down a quick summary of key findings
to present to the larger group
EXERCISE 3

Show & Tell
SUMMARY & CONCLUSION

Summary
SUMMARY & CONCLUSION

Summary
‣

Match your test artifact to your scope
SUMMARY & CONCLUSION

Summary
‣

Match your test artifact to your scope

‣

Plan realistic scenarios that don’t give
away the test purpose
SUMMARY & CONCLUSION

Summary
‣

Match your test artifact to your scope

‣

Plan realistic scenarios that don’t give
away the test purpose

‣

Be encouraging and open to feedback
SUMMARY & CONCLUSION

Summary
‣

Match your test artifact to your scope

‣

Plan realistic scenarios that don’t give
away the test purpose

‣

Be encouraging and open to feedback

‣

Record only what’s needed
SUMMARY & CONCLUSION

Summary
‣

Match your test artifact to your scope

‣

Plan realistic scenarios that don’t give
away the test purpose

‣

Be encouraging and open to feedback

‣

Record only what’s needed

‣

Prioritise findings for maximum
impact
SUMMARY & CONCLUSION

DIY Usability
Testing
Steve Krug

76

Lean UX
Jeff Gothelf

DIVE IN MORE DEEPLY

Remote Research
Nate Bolt & Tony
Tulathimutte
SUMMARY & CONCLUSION

“

Any intelligent fool can make things bigger
and more complex. It takes courage, and a
touch of genius, to move in the opposite
direction.
– Albert Einstein

A FINAL THOUGHT
http://www.humanfactors.com/ROIposter.asp

77
INTRODUCTION

Thank you!
Jenny@futureworkshops.com
www.grinblo.com
Twitter: @grinblo

78

Mais conteúdo relacionado

Mais procurados

UX Without the U Is Your X
UX Without the U Is Your XUX Without the U Is Your X
UX Without the U Is Your XBrandon Ward
 
Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Domain7
 
How to Crack the PM Execution Interview by Instacart Sr PM
How to Crack the PM Execution Interview by Instacart Sr PMHow to Crack the PM Execution Interview by Instacart Sr PM
How to Crack the PM Execution Interview by Instacart Sr PMProduct School
 
UX in Action: IBM Watson
UX in Action: IBM WatsonUX in Action: IBM Watson
UX in Action: IBM WatsonUserTesting
 
User Experience 101 - A Practical Guide
User Experience 101 - A Practical GuideUser Experience 101 - A Practical Guide
User Experience 101 - A Practical GuideAdrian Bunge
 
How PMs can diagnose funnel problems with user testing: AMA with Jason Amunwa
How PMs can diagnose funnel problems with user testing: AMA with Jason AmunwaHow PMs can diagnose funnel problems with user testing: AMA with Jason Amunwa
How PMs can diagnose funnel problems with user testing: AMA with Jason AmunwaUserTesting
 
User testing presentation
User testing presentationUser testing presentation
User testing presentationLindaKolker
 
UX research at Napster: A Product Manager’s perspective
UX research at Napster: A Product Manager’s perspectiveUX research at Napster: A Product Manager’s perspective
UX research at Napster: A Product Manager’s perspectiveUserTesting
 
Open Plans User Testing Workshop
Open Plans User Testing WorkshopOpen Plans User Testing Workshop
Open Plans User Testing WorkshopCyd Harrell
 
Introducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on DemandIntroducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on DemandUserTesting
 
The design secrets behind Slack’s amazing success
The design secrets behind Slack’s amazing successThe design secrets behind Slack’s amazing success
The design secrets behind Slack’s amazing successUserTesting
 
Introduction to Usability
Introduction to UsabilityIntroduction to Usability
Introduction to UsabilityGretchen Thomas
 
THE LEAN UX - SUMMARY
THE LEAN UX - SUMMARYTHE LEAN UX - SUMMARY
THE LEAN UX - SUMMARYVinsol
 
Usability testing - have fun and improve your work
Usability testing - have fun and improve your workUsability testing - have fun and improve your work
Usability testing - have fun and improve your workonthegosystems
 
Shuhari: Learn - Digress - Transcend
Shuhari: Learn - Digress - TranscendShuhari: Learn - Digress - Transcend
Shuhari: Learn - Digress - TranscendDinker Charak
 
The Scientific Method of Experimentation by Google PM
The Scientific Method of Experimentation by Google PMThe Scientific Method of Experimentation by Google PM
The Scientific Method of Experimentation by Google PMProduct School
 
Use Model-Based Testing to Navigate the Software Forest
Use Model-Based Testing to Navigate the Software ForestUse Model-Based Testing to Navigate the Software Forest
Use Model-Based Testing to Navigate the Software ForestTechWell
 
Reverse Chaos Method of Requirements Prioritisation
Reverse Chaos Method of Requirements Prioritisation  Reverse Chaos Method of Requirements Prioritisation
Reverse Chaos Method of Requirements Prioritisation Gena Drahun
 
Putting Yourself Where Your Users Are - How To Recruit for UX Research & Usab...
Putting Yourself Where Your Users Are - How To Recruit for UX Research & Usab...Putting Yourself Where Your Users Are - How To Recruit for UX Research & Usab...
Putting Yourself Where Your Users Are - How To Recruit for UX Research & Usab...UserZoom
 

Mais procurados (20)

UX Without the U Is Your X
UX Without the U Is Your XUX Without the U Is Your X
UX Without the U Is Your X
 
Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?
 
How to Crack the PM Execution Interview by Instacart Sr PM
How to Crack the PM Execution Interview by Instacart Sr PMHow to Crack the PM Execution Interview by Instacart Sr PM
How to Crack the PM Execution Interview by Instacart Sr PM
 
UX in Action: IBM Watson
UX in Action: IBM WatsonUX in Action: IBM Watson
UX in Action: IBM Watson
 
User Experience 101 - A Practical Guide
User Experience 101 - A Practical GuideUser Experience 101 - A Practical Guide
User Experience 101 - A Practical Guide
 
How PMs can diagnose funnel problems with user testing: AMA with Jason Amunwa
How PMs can diagnose funnel problems with user testing: AMA with Jason AmunwaHow PMs can diagnose funnel problems with user testing: AMA with Jason Amunwa
How PMs can diagnose funnel problems with user testing: AMA with Jason Amunwa
 
User testing presentation
User testing presentationUser testing presentation
User testing presentation
 
UX research at Napster: A Product Manager’s perspective
UX research at Napster: A Product Manager’s perspectiveUX research at Napster: A Product Manager’s perspective
UX research at Napster: A Product Manager’s perspective
 
Open Plans User Testing Workshop
Open Plans User Testing WorkshopOpen Plans User Testing Workshop
Open Plans User Testing Workshop
 
Introducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on DemandIntroducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on Demand
 
The design secrets behind Slack’s amazing success
The design secrets behind Slack’s amazing successThe design secrets behind Slack’s amazing success
The design secrets behind Slack’s amazing success
 
Introduction to Usability
Introduction to UsabilityIntroduction to Usability
Introduction to Usability
 
Google Design Spint
Google Design SpintGoogle Design Spint
Google Design Spint
 
THE LEAN UX - SUMMARY
THE LEAN UX - SUMMARYTHE LEAN UX - SUMMARY
THE LEAN UX - SUMMARY
 
Usability testing - have fun and improve your work
Usability testing - have fun and improve your workUsability testing - have fun and improve your work
Usability testing - have fun and improve your work
 
Shuhari: Learn - Digress - Transcend
Shuhari: Learn - Digress - TranscendShuhari: Learn - Digress - Transcend
Shuhari: Learn - Digress - Transcend
 
The Scientific Method of Experimentation by Google PM
The Scientific Method of Experimentation by Google PMThe Scientific Method of Experimentation by Google PM
The Scientific Method of Experimentation by Google PM
 
Use Model-Based Testing to Navigate the Software Forest
Use Model-Based Testing to Navigate the Software ForestUse Model-Based Testing to Navigate the Software Forest
Use Model-Based Testing to Navigate the Software Forest
 
Reverse Chaos Method of Requirements Prioritisation
Reverse Chaos Method of Requirements Prioritisation  Reverse Chaos Method of Requirements Prioritisation
Reverse Chaos Method of Requirements Prioritisation
 
Putting Yourself Where Your Users Are - How To Recruit for UX Research & Usab...
Putting Yourself Where Your Users Are - How To Recruit for UX Research & Usab...Putting Yourself Where Your Users Are - How To Recruit for UX Research & Usab...
Putting Yourself Where Your Users Are - How To Recruit for UX Research & Usab...
 

Semelhante a Usability Testing How To's - EventHandler, London Oct 24th 2013

What Is Product Excellence by Google Product Manager
What Is Product Excellence by Google Product ManagerWhat Is Product Excellence by Google Product Manager
What Is Product Excellence by Google Product ManagerProduct School
 
Validate your product with usability testing
Validate your product with usability testingValidate your product with usability testing
Validate your product with usability testingNearsoft
 
Experimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductExperimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductProduct School
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality productCarmen Brion
 
UX Lead Product Management
UX Lead Product ManagementUX Lead Product Management
UX Lead Product ManagementJohn Wyatt
 
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Fail Well, Pivot Fast: Product Experimentation for Continuous DiscoveryFail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Fail Well, Pivot Fast: Product Experimentation for Continuous DiscoveryAggregage
 
How to Know If You Should Fix or Kill Your Product by CNN Sr PM
How to Know If You Should Fix or Kill Your Product by CNN Sr PMHow to Know If You Should Fix or Kill Your Product by CNN Sr PM
How to Know If You Should Fix or Kill Your Product by CNN Sr PMProduct School
 
The Missing Piece between Discovery and Execution
The Missing Piece between Discovery and ExecutionThe Missing Piece between Discovery and Execution
The Missing Piece between Discovery and ExecutionSteffen Kastner
 
More Than Usability
More Than UsabilityMore Than Usability
More Than UsabilityRazan Sadeq
 
Lean UX NYC: Getting Buy-in For UX Research
Lean UX NYC: Getting Buy-in For UX ResearchLean UX NYC: Getting Buy-in For UX Research
Lean UX NYC: Getting Buy-in For UX ResearchPerfetti Media
 
Cox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple BrandsCox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple BrandsOptimizely
 
Know Thy Product: Tips from a Tester
Know Thy Product: Tips from a TesterKnow Thy Product: Tips from a Tester
Know Thy Product: Tips from a TesterAtlassian
 
Field Research at the Speed of Business
Field Research at the Speed of BusinessField Research at the Speed of Business
Field Research at the Speed of BusinessPaul Sherman
 
What is Product Management ?
What is Product Management ?What is Product Management ?
What is Product Management ?Charles Loumeau
 
Leverage The Power of Small Data
Leverage The Power of Small DataLeverage The Power of Small Data
Leverage The Power of Small DataKaryn Zuidinga
 
A/B Testing Best Practices - Do's and Don'ts
A/B Testing Best Practices - Do's and Don'tsA/B Testing Best Practices - Do's and Don'ts
A/B Testing Best Practices - Do's and Don'tsRamkumar Ravichandran
 
Learn build measure building products customers love
Learn build measure building products customers loveLearn build measure building products customers love
Learn build measure building products customers loveRahul PruthI
 

Semelhante a Usability Testing How To's - EventHandler, London Oct 24th 2013 (20)

What Is Product Excellence by Google Product Manager
What Is Product Excellence by Google Product ManagerWhat Is Product Excellence by Google Product Manager
What Is Product Excellence by Google Product Manager
 
Validate your product with usability testing
Validate your product with usability testingValidate your product with usability testing
Validate your product with usability testing
 
Experimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductExperimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of Product
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
UX Lead Product Management
UX Lead Product ManagementUX Lead Product Management
UX Lead Product Management
 
Test Framework V0.1
Test Framework V0.1Test Framework V0.1
Test Framework V0.1
 
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Fail Well, Pivot Fast: Product Experimentation for Continuous DiscoveryFail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
 
How to Know If You Should Fix or Kill Your Product by CNN Sr PM
How to Know If You Should Fix or Kill Your Product by CNN Sr PMHow to Know If You Should Fix or Kill Your Product by CNN Sr PM
How to Know If You Should Fix or Kill Your Product by CNN Sr PM
 
The Missing Piece between Discovery and Execution
The Missing Piece between Discovery and ExecutionThe Missing Piece between Discovery and Execution
The Missing Piece between Discovery and Execution
 
More Than Usability
More Than UsabilityMore Than Usability
More Than Usability
 
Lean UX NYC: Getting Buy-in For UX Research
Lean UX NYC: Getting Buy-in For UX ResearchLean UX NYC: Getting Buy-in For UX Research
Lean UX NYC: Getting Buy-in For UX Research
 
Cox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple BrandsCox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple Brands
 
Know Thy Product: Tips from a Tester
Know Thy Product: Tips from a TesterKnow Thy Product: Tips from a Tester
Know Thy Product: Tips from a Tester
 
Field Research at the Speed of Business
Field Research at the Speed of BusinessField Research at the Speed of Business
Field Research at the Speed of Business
 
What is Product Management ?
What is Product Management ?What is Product Management ?
What is Product Management ?
 
Leverage The Power of Small Data
Leverage The Power of Small DataLeverage The Power of Small Data
Leverage The Power of Small Data
 
A/B Testing Best Practices - Do's and Don'ts
A/B Testing Best Practices - Do's and Don'tsA/B Testing Best Practices - Do's and Don'ts
A/B Testing Best Practices - Do's and Don'ts
 
Lean UX principles
Lean UX principlesLean UX principles
Lean UX principles
 
Learn build measure building products customers love
Learn build measure building products customers loveLearn build measure building products customers love
Learn build measure building products customers love
 
Benchmarking Usability Performance
Benchmarking Usability PerformanceBenchmarking Usability Performance
Benchmarking Usability Performance
 

Último

Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 

Último (20)

Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 

Usability Testing How To's - EventHandler, London Oct 24th 2013

  • 1. USABILITY TESTING HOW TO’s For small teams & little budgets Evgenia (Jenny) Grinblo & www.eventhandler.co.uk London, UK Oct 24, 2013 (This is Henrik)
  • 2. USABILITY TESTING: INTRODUCTION 2 Hello, I’m... Evgenia (Jenny) Grinblo User Experience Specialist Future Workshops, London
  • 3. Workshop schedule USABILITY TESTING 0 / Usability testing introduction 1 / What do we test: preparing a test plan 2 / Facilitating a usability test & recording results 3 / Analysing and presenting key learnings
  • 4. USABILITY TESTING: INTRODUCTION How to run a £3000 fool-proof test ✓ ✓ ✓ ✓ The easiest, quickest, cheapest methods Tips on facilitating, note-taking, & prioritising How to run a usability test tomorrow Resources & tools to keep learning WHAT TO EXPECT TODAY 4
  • 5. USABILITY TESTING: INTRODUCTION What is usability testing & why do it? 5
  • 6. USABILITY TESTING: INTRODUCTION 6 USER EXPERIENCE BUILDING BLOCKS http://www.flickr.com/photos/7855449@N02/2779597129 Diagram by David Armano
  • 7. USABILITY TESTING: INTRODUCTION 7 USABILITY IS A MAJOR BUILDING BLOCK OF A GOOD EXPERIENCE http://www.flickr.com/photos/7855449@N02/2779597129 Diagram by David Armano
  • 8. USABILITY TESTING: INTRODUCTION 1. INTUITIVE (n.) Using what one feels to be true without conscious reasoning www.youtube.com 8
  • 9. USABILITY TESTING: INTRODUCTION NEEDING INSTRUCTIONS MEANS SOMETHING CAN BE MADE MORE SIMPLE 9
  • 10. USABILITY TESTING: INTRODUCTION 2. EASY TO USE Doesn’t make people feel stupid or inferior to the tool they are using. Helps them feel in control. www.errorwallofshame.tumblr.com 10
  • 11. USABILITY TESTING: INTRODUCTION 3. ACCESSIBLE People of different abilities can use it 11
  • 12. USABILITY TESTING: INTRODUCTION 12 YOU CAN’T DIFFERENTIATE IF THE EXPERIENCE IS BROKEN
  • 13. EVERYONE DEEPLY UNDERSTANDS THE USERS 13 67.45% (AVERAGE E-COMMERCE CART ABANDONMENT RATE) July 28, 2013 http://baymard.com/lists/cart-abandonment-rate
  • 16. USABILITY TESTING: INTRODUCTION 16 Analytics Survey Usability test (Impersonal) (Tricky) (Immediate, easy) WHERE TO FIND USABILITY PROBLEMS
  • 17. USABILITY TESTING: INTRODUCTION 17 • Behavioral vs. Self-reported • Opportunity to ask “why?” • Motivates teammates • Removes “designer bias” • Can be done on prototypes • Can be cheap & quick USABILITY TESTING
  • 18. USABILITY TESTING: INTRODUCTION WHAT HAPPENS IN A USABILITY TEST? Video: http://www.youtube.com/watch?v=QckIzHC99Xc 18
  • 19. USABILITY TESTING: INTRODUCTION TEST YOUR IDEAS REGULARLY WITH REAL PEOPLE 19
  • 20. USABILITY TESTING: INTRODUCTION Recruit Participants Prepare a test plan USABILITY TEST STEPS 20 Test Analyse + iterate
  • 21. USABILITY TESTING: INTRODUCTION ‣ Anyone who hasn’t seen the app ‣ Similar demographics to real users (whenever possible) WHO DO WE TEST WITH? 21
  • 22. USABILITY TESTING: INTRODUCTION WHERE DO WE FIND PARTICIPANTS? 22
  • 23. USABILITY TESTING: INTRODUCTION ‣ Friends, family, colleagues WHERE DO WE FIND PARTICIPANTS? 22
  • 24. USABILITY TESTING: INTRODUCTION ‣ Friends, family, colleagues ‣ Social media followers WHERE DO WE FIND PARTICIPANTS? 22
  • 25. USABILITY TESTING: INTRODUCTION ‣ Friends, family, colleagues ‣ Social media followers ‣ Existing customers WHERE DO WE FIND PARTICIPANTS? 22
  • 26. USABILITY TESTING: INTRODUCTION ‣ Friends, family, colleagues ‣ Social media followers ‣ Existing customers ‣ Streets and coffee shops WHERE DO WE FIND PARTICIPANTS? 22
  • 27. USABILITY TESTING: INTRODUCTION ‣ Friends, family, colleagues ‣ Social media followers ‣ Existing customers ‣ Streets and coffee shops ‣ Recruitment agencies (<expensive!) WHERE DO WE FIND PARTICIPANTS? 22
  • 28. USABILITY TESTING: INTRODUCTION 23 Idea stage Definition stage Exploring Many ideas High-level “Dream world” Focusing Best ideas Refined Realistic WHEN DO WE TEST? AS EARLY AS POSSIBLE
  • 29. USABILITY TESTING: INTRODUCTION DO USABILITY TESTING REGULARLY, WITH YOUR WHOLE TEAM 24
  • 30. USABILITY TESTING: INTRODUCTION # OF TEAM MEMBERS EXPOSED TO USERS IS MORE IMPORTANT THAN # OF USERS http://www.uie.com/articles/user_exposure_hours/ 25
  • 31. USABILITY TESTING: INTRODUCTION 26 SOMETIMES IT’S HARD TO ACCEPT YOUR PRODUCT NEEDS HELP https://twitter.com/adrianhungate/status/391954628184915970
  • 32. USABILITY TESTING: INTRODUCTION WHEN YOU SEE SOMEONE IN PAIN, YOU WANT TO HELP THEM http://www.flickr.com/photos/martin_mcdonald/371884786/ 27
  • 33. USABILITY TESTING: INTRODUCTION “ I was completely surprised at how cumbersome the users experience with the app was. Basic tasks were which was so obvious to me were suddenly a huge barrier. — DANIEL Lead Developer, Future Workshops http://www.uie.com/articles/user_exposure_hours/ 28
  • 34. USABILITY TESTING: INTRODUCTION “ 29 ... What the usability testing did for me was really prove how much tech people can lose sight of who they are building for. It about going back to basics in some cases. — DANIEL Lead Developer, Future Workshops http://www.uie.com/articles/user_exposure_hours/
  • 35. USABILITY TESTING: INTRODUCTION 30 1. Highlights where our product isn’t intuitive / easy to use 2. Puts team in the shoes of users 3. Helps sell product improvements to stakeholders/ clients 4. Helps prioritise feature backlog IN SUMMARY: USABILITY TESTING BENEFITS
  • 36. Time for a 5 minute break
  • 37. Workshop schedule USABILITY TESTING 0 / Usability testing introduction 1 / What do we test: preparing a test plan 2 / Facilitating a usability test & recording results 3 / Analysing and presenting key learnings
  • 38. PREPARING A TEST PLAN To run a test, you need
  • 39. PREPARING A TEST PLAN To run a test, you need ‣ Some representation of your product
  • 40. PREPARING A TEST PLAN To run a test, you need ‣ Some representation of your product ‣ Preferably interactive
  • 41. PREPARING A TEST PLAN To run a test, you need ‣ Some representation of your product ‣ Preferably interactive ‣ Doesn’t have to be finished
  • 42. PREPARING A TEST PLAN To run a test, you need ‣ Some representation of your product ‣ Preferably interactive ‣ Doesn’t have to be finished ‣ Or: competitor product!
  • 43. PREPARING A TEST PLAN To run a test, you need ‣ Some representation of your product ‣ Preferably interactive ‣ Doesn’t have to be finished ‣ Or: competitor product! ‣ Idea of what you want to test
  • 44. PREPARING A TEST PLAN What do we test?
  • 45. PREPARING A TEST PLAN What do we test? ‣ General impressions
  • 46. PREPARING A TEST PLAN What do we test? ‣ General impressions ‣ Ease of use of critical features
  • 47. PREPARING A TEST PLAN What do we test? ‣ General impressions ‣ Ease of use of critical features ‣ Features we’re not sure about (e.g., is the help clear?)
  • 48. PREPARING A TEST PLAN What do we test? ‣ General impressions ‣ Ease of use of critical features ‣ Features we’re not sure about (e.g., is the help clear?) ‣ Response to design, iconography
  • 49. PREPARING A TEST PLAN What do we test? ‣ General impressions ‣ Ease of use of critical features ‣ Features we’re not sure about (e.g., is the help clear?) ‣ Response to design, iconography Tip: start from high-level when testing prototypes, test the details with later builds
  • 50. PREPARING A TEST PLAN Wide (Generative) SET THE SCOPE 35
  • 51. PREPARING A TEST PLAN Wide (Generative) SET THE SCOPE 35 WHY will people use this product?
  • 52. PREPARING A TEST PLAN Wide (Generative) Narrow (Validating) SET THE SCOPE 35 WHY will people use this product?
  • 53. PREPARING A TEST PLAN Wide (Generative) Narrow (Validating) SET THE SCOPE 35 WHY will people use this product? HOW do these people use this product?
  • 54. PREPARING A TEST PLAN Wide (Generative) 36 Explore How is the value proposition of this tool fit in with people’s lives Confirm/iterate Observing what people do with this tool, in their own environment Narrow (Validating) SET THE SCOPE Validate How do people perform specific task with this tool?
  • 55. PREPARING A TEST PLAN Wide (Generative) First... 37 Explore How is the value proposition of this tool fit in with people’s lives Confirm/iterate Observing what people do with this tool, in their own environment Narrow (Validating) SET THE SCOPE Validate How do people perform specific task with this tool?
  • 56. PREPARING A TEST PLAN 38 Ready? FIRST IMPRESSIONS: THE 5 SECOND TEST
  • 57. 39
  • 58. PREPARING A TEST PLAN • What is the purpose of the website/app? • Name 3 things you can do with this website • Who does this site or app belong to? • How do you feel about this organisation? 5 SECOND TEST QUESTIONS 40
  • 59. PREPARING A TEST PLAN Wide (Generative) 41 Explore How is the value proposition of this tool fit in with people’s lives Now... Confirm/iterate Observing what people do with this tool, in their own environment Narrow (Validating) SET THE SCOPE Validate How do people perform specific task with this tool?
  • 60. PREPARING A TEST PLAN Recruit Participants 42 Prepare a test plan Test Analyse + iterate PREPARING A DETAILED USABILITY TEST
  • 61. USABILITY TESTING: INTRODUCTION THE MORE DETAILED YOUR ARTIFACT, THE MORE DETAILED THE FEEDBACK 43
  • 62. EXERCISE 1 Choose a product to test Time: 10 minutes ‣ We are going to validate an existing, finished product ‣ As a group, decide on a website or app to test ‣ It can be your app - I must be able to interact with it Tip: avoid sites that require logging in (unless you have a login to share)
  • 64. PREPARING A TEST PLAN Scenario Structure
  • 65. PREPARING A TEST PLAN Scenario Structure ‣ Your character
  • 66. PREPARING A TEST PLAN Scenario Structure ‣ Your character ‣ Your motivation
  • 67. PREPARING A TEST PLAN Scenario Structure ‣ Your character ‣ Your motivation ‣ What you need to do
  • 68. PREPARING A TEST PLAN Scenario Structure ‣ Your character ‣ Your motivation ‣ What you need to do ‣ Any details like login information, etc
  • 69. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO TASK TASK // SUCCESS PATH // SCENARIO // SCENARIO // INFO (passwords, etc) // INFO (passwords, etc) @ Template by @grinblo // SUCCESS PATH
  • 70. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO Set up the motivation TASK TASK // SUCCESS PATH // SCENARIO // SCENARIO // INFO (passwords, etc) // INFO (passwords, etc) @ Template by @grinblo // SUCCESS PATH
  • 71. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO Set up the motivation What we are testing TASK TASK // SUCCESS PATH // SCENARIO // SCENARIO // INFO (passwords, etc) // INFO (passwords, etc) @ Template by @grinblo // SUCCESS PATH
  • 72. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO Set up the motivation What we are testing TASK // SUCCESS PATH TASK // SUCCESS PATH What we want/expect the user to do // INFO (passwords, etc) // SCENARIO // INFO (passwords, etc) @ Template by @grinblo // SCENARIO
  • 73. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO Set up the motivation What we are testing TASK // SUCCESS PATH TASK // SUCCESS PATH What we want/expect the user to do // SCENARIO // SCENARIO // INFO (passwords, etc) // INFO (passwords, etc) @ Template by @grinblo Motivation to do the task + instructions
  • 74. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO Set up the motivation What we are testing TASK // SUCCESS PATH TASK // SUCCESS PATH What we want/expect the user to do // SCENARIO // SCENARIO // INFO (passwords, etc) Information necessary for the task // INFO (passwords, etc) @ Template by @grinblo Motivation to do the task + instructions
  • 75. // TEST PLAN FOR: // GROUP: // GENERAL SCENARIO TASK TASK // SUCCESS PATH // SUCCESS PATH // SCENARIO // SCENARIO // INFORMATION // INFORMATION // PART:
  • 76. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK TASK // SUCCESS PATH // SUCCESS PATH // SCENARIO // SCENARIO // INFORMATION // INFORMATION
  • 77. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note TASK // SUCCESS PATH // SUCCESS PATH // SCENARIO // SCENARIO // INFORMATION // INFORMATION
  • 78. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note // SUCCESS PATH TASK // SUCCESS PATH Create a text note and make a bulleted list of ingredients // SCENARIO // INFORMATION // SCENARIO // INFORMATION
  • 79. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note // SUCCESS PATH TASK // SUCCESS PATH Create a text note and make a bulleted list of ingredients // SCENARIO // INFORMATION // SCENARIO // INFORMATION
  • 80. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note Don’t show this to the participant! // SUCCESS PATH TASK // SUCCESS PATH Create a text note and make a bulleted list of ingredients // SCENARIO // INFORMATION // SCENARIO // INFORMATION
  • 81. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note Don’t show this to the participant! // SUCCESS PATH TASK // SUCCESS PATH Create a text note and make a bulleted list of ingredients // SCENARIO // SCENARIO You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket. // INFORMATION // INFORMATION
  • 82. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note Don’t show this to the participant! // SUCCESS PATH TASK // SUCCESS PATH Create a text note and make a bulleted list of ingredients // SCENARIO // SCENARIO You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket. // INFORMATION Print-out of a recipe from the internet // INFORMATION
  • 83. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note Don’t show this to the participant! // SUCCESS PATH TASK Share a note via e-mail // SUCCESS PATH Create a text note and make a bulleted list of ingredients // SCENARIO // SCENARIO You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket. // INFORMATION Print-out of a recipe from the internet // INFORMATION
  • 84. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note Don’t show this to the participant! TASK Share a note via e-mail // SUCCESS PATH // SUCCESS PATH Create a text note and make a bulleted list of ingredients E-mail a note to a friend using swipe to share // SCENARIO // SCENARIO You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket. // INFORMATION Print-out of a recipe from the internet // INFORMATION
  • 85. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note Don’t show this to the participant! TASK Share a note via e-mail // SUCCESS PATH // SUCCESS PATH Create a text note and make a bulleted list of ingredients E-mail a note to a friend using swipe to share // SCENARIO // SCENARIO You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket. You really liked the new recipe and you think your friend Jenny will like it too. Send the recipe to Jenny from within the app. // INFORMATION Print-out of a recipe from the internet // INFORMATION
  • 86. // TEST PLAN FOR: // GROUP: // PART: // GENERAL SCENARIO You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it. TASK Text note Don’t show this to the participant! TASK Share a note via e-mail // SUCCESS PATH // SUCCESS PATH Create a text note and make a bulleted list of ingredients E-mail a note to a friend using swipe to share // SCENARIO // SCENARIO You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket. You really liked the new recipe and you think your friend Jenny will like it too. Send the recipe to Jenny from within the app. // INFORMATION Print-out of a recipe from the internet // INFORMATION Jenny’s email: jenny@futureworkshops.com
  • 87. PREPARING A TEST PLAN Scenario Tips
  • 88. PREPARING A TEST PLAN Scenario Tips ‣ Avoid using terminology from the interface (e.g., search, tag, filter)
  • 89. PREPARING A TEST PLAN Scenario Tips ‣ Avoid using terminology from the interface (e.g., search, tag, filter) ‣ Scenarios can have steps (e.g., find a recipe and add it to your collection)
  • 90. PREPARING A TEST PLAN Scenario Tips ‣ Avoid using terminology from the interface (e.g., search, tag, filter) ‣ Scenarios can have steps (e.g., find a recipe and add it to your collection) ‣ Escalate the difficulty as the test progresses
  • 91. EXERCISE 2 Test Plan Time: 20 mins ‣ Define 3 key tasks that must be intuitive and easy to use in the application ‣ Identify the success paths for each task (what we expect users to do) ‣ Decide on a general scenario + write specific tasks ‣ Run through the test once
  • 92. Workshop schedule USABILITY TESTING 0 / Usability testing introduction 1 / What do we test: preparing a test plan 2 / Facilitating a usability test & recording results 3 / Analysing and presenting key learnings
  • 93. FACILITATING A TEST & RECORDING RESULTS Recruit Participants Prepare a test plan USABILITY TEST STEPS 52 Test Analyse + iterate
  • 94. FACILITATING A TEST & RECORDING RESULTS Facilitating ‣ Practice staying quiet ‣ Remind the participant to speak out loud ‣ Don’t give anything away ‣ Be reassuring, say thank you ‣ If they get stuck, wait (a little)
  • 95. FACILITATING A TEST & RECORDING RESULTS Facilitator Cheat-Sheet If they forget to think aloud ‣ "What are you thinking right now?" ‣ "What are you finding confusing on this screen?" ‣ "I know it's an unusual thing to do but could I please ask you to keep thinking out loud and talk as you go along? It really helps me understand your experience better."
  • 96. FACILITATING A TEST & RECORDING RESULTS Facilitator Cheat-Sheet If they get stuck ‣ "This is very helpful for us, we are uncovering a lot of problems in the design that will help us make the app better." ‣ "I can already see how useful this is going to be in improving the app."
  • 97. FACILITATING A TEST & RECORDING RESULTS Facilitator Cheat-Sheet If they have a question ‣ "Please continue in the way that makes sense to you. We will learn a lot from seeing how you proceed with this without any help." ‣ "I will be happy to answer your questions at the end. Please try to try this task for a bit longer."
  • 98. FACILITATING A TEST & RECORDING RESULTS Facilitator Cheat-Sheet The golden go-to ‣ "We expected to uncover problems in the design. You are not doing anything wrong - we knew there would be issues and you are helping us find them."
  • 99. FACILITATING A TEST & RECORDING RESULTS People will feel stupid. Make them feel at ease. 58
  • 100. FACILITATING A TEST & RECORDING RESULTS Ways to record our findings
  • 101. FACILITATING A TEST & RECORDING RESULTS Ways to record our findings From easy to complicated
  • 102. FACILITATING A TEST & RECORDING RESULTS Ways to record our findings From easy to complicated ‣ Pair up with a note-taker
  • 103. FACILITATING A TEST & RECORDING RESULTS Ways to record our findings From easy to complicated ‣ Pair up with a note-taker ‣ DIY recording equipment
  • 104. FACILITATING A TEST & RECORDING RESULTS Ways to record our findings From easy to complicated ‣ Pair up with a note-taker ‣ DIY recording equipment ‣ Professional recording equipment
  • 105. FACILITATING A TEST & RECORDING RESULTS Ways to record our findings From easy to complicated ‣ Pair up with a note-taker ‣ DIY recording equipment ‣ Professional recording equipment ‣ Live-stream to a group of stakeholders
  • 106. FACILITATING A TEST & RECORDING RESULTS Note-taking brings down 2 barriers to testing: time & equipment (But I’ll give you some tips on recording later!) 60
  • 107. FACILITATING A TEST & RECORDING RESULTS Note-taking tips Only record what’s important ‣ If someone is really happy ‣ If someone is really frustrated ‣ If someone fails a task ‣ Write down short quotes if you can
  • 108. FACILITATING A TEST & RECORDING RESULTS Notes Example • Taps Map on merchant profile but this opens the system Maps app — confused • Goes to Search and types “coffee shops” but there are no results — “why can’t I see what’s around me?” • "If I had to think about something around me, I’d start the merchant profile and expect to see other things around me" • The icons aren’t telling me that Cafe Nero is a coffee shop
  • 109. FACILITATING A TEST & RECORDING RESULTS What to bring to the test Printed scenarios & tasks for participant Printed scenarios & tasks with success paths for facilitator Facilitator script Optional: List of pre-test and debrief questions Consent form (if needed) Pen + paper / recording tools Test setup checklist
  • 110. FACILITATING A TEST & RECORDING RESULTS Setting up the test Reset the mobile app / site to the default settings Clear the test area of any open documents, written notes, etc. Prepare participant forms: scenarios, intro script, consent form Optional: Verify the recording equipment Optional: Make sure the brightness on the screen is reduced
  • 111. EXERCISE 3 Usability Test Time: 40 minutes ‣ Every 8 minutes, swap one member of your group in exchange for a member from another group ‣ The ‘foreign’ member is the participant ‣ Start running through the test you’ve planned ‣ Everyone else in the group should be a facilitator and a note-taker at least once
  • 113. Workshop schedule USABILITY TESTING 0 / Usability testing introduction 1 / What do we test: preparing a test plan 2 / Facilitating a usability test & recording results 3 / Analysing and presenting key learnings
  • 114. ANALYSING & PRESENTING FINDINGS Recruit Participants Prepare a test plan USABILITY TEST STEPS 68 Test Analyse + iterate
  • 115. ANALYSING & PRESENTING FINDINGS What to do with all the data? ‣ Identify changes with the biggest impact & smallest effort as a team ‣ Find the “low-hanging fruit” ‣ What has impact on the bottom line? ‣ Put everything else in the ice-box
  • 116. ANALYSING & PRESENTING FINDINGS Identifying key findings High-priority: people fail, or abandon the task Medium: people succeed but are frustrated and unhappy Low: people would enjoy the app more if...
  • 117. ANALYSING & PRESENTING FINDINGS Identifying key findings High-priority: people fail, or abandon the task Medium: people succeed but are frustrated and unhappy Low: people would enjoy the app more if... Tip: Work hard to prioritise the highest-impact items. You can’t fix everything.
  • 118. ANALYSING & PRESENTING FINDINGS Presenting findings
  • 119. ANALYSING & PRESENTING FINDINGS Presenting findings Interface screenshot here
  • 120. ANALYSING & PRESENTING FINDINGS Presenting findings Task Interface screenshot here
  • 121. ANALYSING & PRESENTING FINDINGS Presenting findings Task What we expected to happen Interface screenshot here
  • 122. ANALYSING & PRESENTING FINDINGS Presenting findings Task What we expected to happen Interface screenshot here What really happened
  • 123. ANALYSING & PRESENTING FINDINGS Presenting findings Task What we expected to happen Interface screenshot here What really happened What we can fix right now
  • 124. EXERCISE 4 Identifying Key Findings Time: 15 mins ‣ As a group, debrief on each person’s notes ‣ Find 2 high, 2 medium, and 2 low-priority usability problems ‣ What will you fix first? Why? ‣ Jot down a quick summary of key findings to present to the larger group
  • 127. SUMMARY & CONCLUSION Summary ‣ Match your test artifact to your scope
  • 128. SUMMARY & CONCLUSION Summary ‣ Match your test artifact to your scope ‣ Plan realistic scenarios that don’t give away the test purpose
  • 129. SUMMARY & CONCLUSION Summary ‣ Match your test artifact to your scope ‣ Plan realistic scenarios that don’t give away the test purpose ‣ Be encouraging and open to feedback
  • 130. SUMMARY & CONCLUSION Summary ‣ Match your test artifact to your scope ‣ Plan realistic scenarios that don’t give away the test purpose ‣ Be encouraging and open to feedback ‣ Record only what’s needed
  • 131. SUMMARY & CONCLUSION Summary ‣ Match your test artifact to your scope ‣ Plan realistic scenarios that don’t give away the test purpose ‣ Be encouraging and open to feedback ‣ Record only what’s needed ‣ Prioritise findings for maximum impact
  • 132. SUMMARY & CONCLUSION DIY Usability Testing Steve Krug 76 Lean UX Jeff Gothelf DIVE IN MORE DEEPLY Remote Research Nate Bolt & Tony Tulathimutte
  • 133. SUMMARY & CONCLUSION “ Any intelligent fool can make things bigger and more complex. It takes courage, and a touch of genius, to move in the opposite direction. – Albert Einstein A FINAL THOUGHT http://www.humanfactors.com/ROIposter.asp 77