SlideShare uma empresa Scribd logo
1 de 45
Intro to Lean UX with UserTesting
/Productschool @ProdSchool /ProductmanagementSF
Alexandra Michaelides, Ph.D.
- User Experience Researcher at UserTesting
- Former UER at FlyWheel Software
- User Experience background
www.productschool.com
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
Alexandra Michaelides, Ph.D.
What is user experience?
“User experience encompasses all aspects of the
end-user’s interaction with the company, its
services, and its products.” –Don Norman
UX isn’t a new concept
“When the point of contact between the product and the people
becomes a point of friction, then the industrial designer has failed. On
the other hand, if people are made safer, more comfortable, more
eager to purchase, more efficient—or just plain happier—by contact
with the product, then the designer has succeeded.”
–Henry Dreyfuss, Designing for People, 1955
Increased customer acceptance and engagement
•70% of projects fail due to lack of user acceptance. (Source: Forrester
Research)
Increased revenue
•Every $1 invested in UX returns up to $100. (Source: IBM)
Decreased costs
•Fixing a problem after launch is up to 100x more expensive than
fixing it during design and development. (Source: NASA)
Rule #1 of UX: You are NOT your user
Test early, test often. Be open to feedback.
Quantitative Qualitative
Focus on numbers Focus on narrative
How many, how much Why, how
Large sample sizes Smaller sample sizes
Done to “prove a point” Done to “understand, discover”
Expensive, time-consuming Cheaper, faster
Objective Subjective
https://www.interaction-design.org/literature/article/5-ideas-to-help-bring-lean-ux-into-your-research
What is UserTesting?
We provide insights based on videos of your
customers interacting with any brand, regardless of
device or location.
If you can imagine it, we can probably test it.
“If you can imagine it, we can probably test it.”
Test anything with our desktop and breakthrough mobile recorders
✓ From sketches, prototypes, and websites
✓ To mobile apps, mobile websites, and even unreleased apps
✓ To real-world experiences in-store and in-home, unboxing, and more
On-demand
panel of target
audience
Multi-channel
screen recording
technology
Reporting &
collaboration
Full support
services
You can test a design at any stage in the process
• Rough concepts and low-fidelity prototypes
• Clickable prototypes
• High fidelity prototypes & live sites
Remote Unmoderated Research
Pros:
Quick turn around time
Recruitment of testers
No researcher present/ honest feedback
Cons:
Inability to ask follow up questions, prod tester for more
Inability to clarify any confusions
Inability to see full context/ environment
Starting a new study
Screenshot
Usability testing: What can you gather insights on?
Visual Design: how it looks
Information Architecture (IA): how it’s organized
Interaction Design (IxD): how it works
Content: what it says & how it sounds
Functionality: what it does
What can you “test” with UserTesting?
• How do participants “use” or “interact” with an experience?
– Do they understand it?
– Can they access it?
– Can they use it?
– Is it easy to use?
– Do they enjoy using it?
What you shouldn’t “test” with UserTesting?
• Will participants use or adopt the experience in the future?
• Would they buy it?
• Do they “like” it?
• Which one do they “like” better?
Before you launch a study, define objectives
• What exactly are you
hoping to learn?
• Do you have broad or
specific objectives?
Writing objectives
• UserTesting sessions
should run
approximately 15
minutes
• Suggestion of 1-3
objectives
• User fatigue
A note about sample size
It depends on your objective, but
for a standard usability test, 5
participants per target audience
will identify 85% of usability
problems.
You can always add more if you
need to!
And you should always start with
just 1 user in a “pilot” study.
https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
Getting the right participants
• Define the most important
characteristics of your target
audience
– Age? Income? Hobbies?
Profession?
• For basic usability tests,
minimal screening is required
• Keep screener simple and
clear
Tip: Avoid leading questions and yes/no answers
Bad
❑ Do you prefer organic cotton sheets?
❑ Yes [Accept]
❑ No
Good
❑ What kind of sheets do you prefer?
❑ Organic cotton [Accept]
❑ Cotton
❑ Sateen
❑ Synthetic
❑ Polyester
❑ Silk
❑ Jersey
❑ Other
Tip: Use multiple, separate questions
Bad
❑ How often do you exercise on a treadmill?
❑ Less than 1 time a week
❑ 1-2 times a week
❑ 3+ times a week [Accept]
Good
❑ How often do you exercise?
❑ Less than 1 time a week
❑ 1-2 times a week
❑ 3+ times a week [Accept]
❑ What kind of exercise do you do most often?
❑ Yoga
❑ Elliptical
❑ Treadmill [Accept]
❑ Free Weights
❑ Other
Tip: Give participants an “out”
Bad
❑ What is your marital status?
❑ Married [Accept]
❑ Not married
Good
❑ What is your marital status?
❑ Married [Accept]
❑ Not married
❑ Other
❑ I prefer not to say
URL (where users start the test) & Intro
Consider broad & specific tasks
• Broad tasks are great for:
• Understanding how testers think or
behave
• Familiarizing testers with site
• Gathering impressions
• Specific tasks are great for:
• Tracking browser paths/ patterns
• Evaluating particular pages, processes,
features
• Identifying pain points at a particular
part of the process
Clarity is key
• The longer your task/question is, the
easier it will be for the user to miss
something
• Keep tasks simple
• Avoid listing multiple steps at once
• Use URLs or bit.ly links to ensure users
evaluate the correct pages
• Use instructive, active language
Be concise and clear
• Confusing questions = confusing
answers
• Avoid using jargon like “PDP” or
“callout”
• Emphasize important points
• Avoid repetition in task language
Getting honest feedback
• Be aware of areas where bias, discomfort, or privilege come
into play.
• Make your testers feel comfortable
• Use balanced language. This allows you to receive more
accurate and honest feedback
Beware of leading and bias
• Leading questions are phrased in a way that
steers users in a particular direction
• Examples:
• “How much better is the new version
than the original home page?”
• “Was it hard to find the Preferences
page?”
• “What would you improve about this
page?”
Using metrics
Using metrics
• When to use:
• Written questions
• Ratings scale
• Multiple choice
• Make sure they are aligned with
your objectives
• Use sparingly—beware of user
fatigue
• Be specific
Rating scale questions
• Define endpoints (1 and 5)
• Include both endpoint labels
in the body of question
• Label 1 as the “pain” point
and 5 as the “positive” point
• Don’t make the participant
rate multiple items in one
question.
How poorly (1) or well (5) does this
site explain its refund process? Please
explain your rating out loud.
1 – Very poorly
2
3
4
5 – Very well
Post-Test Questionnaire
Note: Participants type their answers
to these questions AFTER the
recording stops.
Consider asking participants to
describe current or previous behaviors.
This can help you predict future
behavior.
They aren’t required. (A simple
“Thanks!” typed in the first field is
fine.)
Default post-test questions
Test the test! Always.
Do tasks and questions make sense?
Does the test follow the right “flow”?
Do tasks contain jargon that particpiants don’t undersatnd?
Do links work?
Don’t judge the tester.
• Remember you are testing the site
• If you have poor results, don’t blame
the tester, change the test
Before starting your analysis
• Refresh yourself on the research objectives
• Get organized. What do you want to capture for each
participants?
– Success rate?
– Time on task?
– Satisfaction?
– Errors?
– Quotes?
Notes & clips in the UserTesting dashboard
Metrics view
Excel export
• Session Details
• Demographics
• Screener answers
• System information
• Study protocol
• Metrics
• Links to jump straight to each
participant doing each task or
question
• Time-on-task*
• Answers to questions
• Sortable Clips & Annotations
Learn from your mistakes. Get better. Have fun.
Upcoming Courses
www.productschool.com
www.productschool.com
jake@productschool.com
APPLY AT
SAN FRANCISCO
Weekdays: May 3rd
Weekends: May 7th
MOUNTAIN VIEW
Weekdays: June 14th
Weekends: June 18th
Mixpanel presents -- Behavioral Analytics as a
Driver of Product Strategy – March 16th
UPCOMING WORKSHOP
www.productschool.com
RSVP ON EVENTBRITE

Mais conteúdo relacionado

Mais procurados

Introducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on DemandIntroducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on DemandUserTesting
 
Accessibility Isn’t Enough - Designing Digital Properties to be Usable and Ac...
Accessibility Isn’t Enough - Designing Digital Properties to be Usable and Ac...Accessibility Isn’t Enough - Designing Digital Properties to be Usable and Ac...
Accessibility Isn’t Enough - Designing Digital Properties to be Usable and Ac...UserZoom
 
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskeyUncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskeyUserTesting
 
The what, when, why and how of usability
The what, when, why and how of usabilityThe what, when, why and how of usability
The what, when, why and how of usabilitySimpleUsability
 
UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC
 
Conducting Usability Research with a Team of One [Revised: October 2009]
Conducting Usability Research with a Team of One [Revised: October 2009]Conducting Usability Research with a Team of One [Revised: October 2009]
Conducting Usability Research with a Team of One [Revised: October 2009]cmk22
 
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Fiona Tranquada
 
Userchecks - Method for agile usability testing
Userchecks - Method for agile usability testingUserchecks - Method for agile usability testing
Userchecks - Method for agile usability testingAnouschka Scholten
 
World Usability day: Bridging Research-Practice Gap
World Usability day: Bridging Research-Practice GapWorld Usability day: Bridging Research-Practice Gap
World Usability day: Bridging Research-Practice GapKeith Instone
 
Advocating for usability: When, why, and how to improve user experiences
Advocating for usability: When, why, and how to improve user experiencesAdvocating for usability: When, why, and how to improve user experiences
Advocating for usability: When, why, and how to improve user experiencesSarah Joy Arnold
 
Usability and User Experience Training Seminar
Usability and User Experience Training SeminarUsability and User Experience Training Seminar
Usability and User Experience Training Seminarlabecvar
 
Content Strategy and Product Management (in science education)
Content Strategy and Product Management (in science education)Content Strategy and Product Management (in science education)
Content Strategy and Product Management (in science education)Roger Hart
 
Paper Prototype Evaluation
Paper Prototype EvaluationPaper Prototype Evaluation
Paper Prototype EvaluationDavid Lamas
 
Ubuntu Usability Test Report
Ubuntu Usability Test ReportUbuntu Usability Test Report
Ubuntu Usability Test ReportDan Fitek
 
Product management meet up post
Product management meet up postProduct management meet up post
Product management meet up postSteve Cook
 
Importance of the Usability of a website
Importance of the Usability of a websiteImportance of the Usability of a website
Importance of the Usability of a websiteSherihan Anver
 
Intro to guerilla usability testing
Intro to guerilla usability testingIntro to guerilla usability testing
Intro to guerilla usability testingRebecca Destello
 

Mais procurados (20)

Module 10: Usability Testing
Module 10: Usability TestingModule 10: Usability Testing
Module 10: Usability Testing
 
Introducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on DemandIntroducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on Demand
 
Usability testing
Usability testing  Usability testing
Usability testing
 
Usability Testing Basics
Usability Testing BasicsUsability Testing Basics
Usability Testing Basics
 
Accessibility Isn’t Enough - Designing Digital Properties to be Usable and Ac...
Accessibility Isn’t Enough - Designing Digital Properties to be Usable and Ac...Accessibility Isn’t Enough - Designing Digital Properties to be Usable and Ac...
Accessibility Isn’t Enough - Designing Digital Properties to be Usable and Ac...
 
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskeyUncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
 
The what, when, why and how of usability
The what, when, why and how of usabilityThe what, when, why and how of usability
The what, when, why and how of usability
 
UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research
 
Conducting Usability Research with a Team of One [Revised: October 2009]
Conducting Usability Research with a Team of One [Revised: October 2009]Conducting Usability Research with a Team of One [Revised: October 2009]
Conducting Usability Research with a Team of One [Revised: October 2009]
 
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
 
Userchecks - Method for agile usability testing
Userchecks - Method for agile usability testingUserchecks - Method for agile usability testing
Userchecks - Method for agile usability testing
 
World Usability day: Bridging Research-Practice Gap
World Usability day: Bridging Research-Practice GapWorld Usability day: Bridging Research-Practice Gap
World Usability day: Bridging Research-Practice Gap
 
Advocating for usability: When, why, and how to improve user experiences
Advocating for usability: When, why, and how to improve user experiencesAdvocating for usability: When, why, and how to improve user experiences
Advocating for usability: When, why, and how to improve user experiences
 
Usability and User Experience Training Seminar
Usability and User Experience Training SeminarUsability and User Experience Training Seminar
Usability and User Experience Training Seminar
 
Content Strategy and Product Management (in science education)
Content Strategy and Product Management (in science education)Content Strategy and Product Management (in science education)
Content Strategy and Product Management (in science education)
 
Paper Prototype Evaluation
Paper Prototype EvaluationPaper Prototype Evaluation
Paper Prototype Evaluation
 
Ubuntu Usability Test Report
Ubuntu Usability Test ReportUbuntu Usability Test Report
Ubuntu Usability Test Report
 
Product management meet up post
Product management meet up postProduct management meet up post
Product management meet up post
 
Importance of the Usability of a website
Importance of the Usability of a websiteImportance of the Usability of a website
Importance of the Usability of a website
 
Intro to guerilla usability testing
Intro to guerilla usability testingIntro to guerilla usability testing
Intro to guerilla usability testing
 

Destaque

How to create surveys that don't suck
How to create surveys that don't suckHow to create surveys that don't suck
How to create surveys that don't suckYana Alekseyevna
 
Plm Open Hours - Detailkonzepte welcher Art führen zu erfolgreichen Implement...
Plm Open Hours - Detailkonzepte welcher Art führen zu erfolgreichen Implement...Plm Open Hours - Detailkonzepte welcher Art führen zu erfolgreichen Implement...
Plm Open Hours - Detailkonzepte welcher Art führen zu erfolgreichen Implement...Intelliact AG
 
PLM Open Hours - PDM-ERP Schnittstellen (Prozesse und Technologien)
PLM Open Hours - PDM-ERP Schnittstellen (Prozesse und Technologien)PLM Open Hours - PDM-ERP Schnittstellen (Prozesse und Technologien)
PLM Open Hours - PDM-ERP Schnittstellen (Prozesse und Technologien)Intelliact AG
 
PDM Open Hours - Aufbau, Verwendung und Pflege von Bennennungskatalogen
PDM Open Hours - Aufbau, Verwendung und Pflege von BennennungskatalogenPDM Open Hours - Aufbau, Verwendung und Pflege von Bennennungskatalogen
PDM Open Hours - Aufbau, Verwendung und Pflege von BennennungskatalogenIntelliact AG
 
Một số biện pháp nâng cao hiệu quả công tác hoạch định nguồn...
Một số biện pháp nâng cao hiệu quả công tác hoạch định nguồn...Một số biện pháp nâng cao hiệu quả công tác hoạch định nguồn...
Một số biện pháp nâng cao hiệu quả công tác hoạch định nguồn...https://www.facebook.com/garmentspace
 
Kinotehnik - designing the Practilite
Kinotehnik - designing the PractiliteKinotehnik - designing the Practilite
Kinotehnik - designing the PractiliteMobileMonday Estonia
 
The marketers pocket_guide_to_writing_good
The marketers pocket_guide_to_writing_goodThe marketers pocket_guide_to_writing_good
The marketers pocket_guide_to_writing_goodConnecticut SEO Experts
 
Atelier Design Probes - FLUPA UX-Day 2015
Atelier Design Probes - FLUPA UX-Day 2015Atelier Design Probes - FLUPA UX-Day 2015
Atelier Design Probes - FLUPA UX-Day 2015Carine Lallemand
 
CV_HENOCQ Christophe-012016-V1.0
CV_HENOCQ Christophe-012016-V1.0CV_HENOCQ Christophe-012016-V1.0
CV_HENOCQ Christophe-012016-V1.0Christophe Hénocq
 
The Mission Driven Startup
The Mission Driven StartupThe Mission Driven Startup
The Mission Driven StartupNilan Peiris
 
Agile design pattern
Agile design patternAgile design pattern
Agile design patternPoppy Martono
 
AJPR Company and Business Profile 2016_
AJPR Company and Business Profile 2016_AJPR Company and Business Profile 2016_
AJPR Company and Business Profile 2016_Hendra Ocky Willyanto
 
Make it Big! The Effect of Font Size and Line Spacing on Online Readability.
Make it Big! The Effect of Font Size and Line Spacing on Online Readability.Make it Big! The Effect of Font Size and Line Spacing on Online Readability.
Make it Big! The Effect of Font Size and Line Spacing on Online Readability.Martin Pielot
 
PLM Open Hours - Das Potential generischer Produkstrukturen
PLM Open Hours - Das Potential generischer ProdukstrukturenPLM Open Hours - Das Potential generischer Produkstrukturen
PLM Open Hours - Das Potential generischer ProdukstrukturenIntelliact AG
 
Modelon FMI Tutorial NAMUG 2016
Modelon FMI Tutorial NAMUG 2016Modelon FMI Tutorial NAMUG 2016
Modelon FMI Tutorial NAMUG 2016Modelon
 

Destaque (20)

How to create surveys that don't suck
How to create surveys that don't suckHow to create surveys that don't suck
How to create surveys that don't suck
 
Plm Open Hours - Detailkonzepte welcher Art führen zu erfolgreichen Implement...
Plm Open Hours - Detailkonzepte welcher Art führen zu erfolgreichen Implement...Plm Open Hours - Detailkonzepte welcher Art führen zu erfolgreichen Implement...
Plm Open Hours - Detailkonzepte welcher Art führen zu erfolgreichen Implement...
 
Social Aware
Social AwareSocial Aware
Social Aware
 
PLM Open Hours - PDM-ERP Schnittstellen (Prozesse und Technologien)
PLM Open Hours - PDM-ERP Schnittstellen (Prozesse und Technologien)PLM Open Hours - PDM-ERP Schnittstellen (Prozesse und Technologien)
PLM Open Hours - PDM-ERP Schnittstellen (Prozesse und Technologien)
 
PDM Open Hours - Aufbau, Verwendung und Pflege von Bennennungskatalogen
PDM Open Hours - Aufbau, Verwendung und Pflege von BennennungskatalogenPDM Open Hours - Aufbau, Verwendung und Pflege von Bennennungskatalogen
PDM Open Hours - Aufbau, Verwendung und Pflege von Bennennungskatalogen
 
Pest is not_a_pest
Pest is not_a_pestPest is not_a_pest
Pest is not_a_pest
 
Một số biện pháp nâng cao hiệu quả công tác hoạch định nguồn...
Một số biện pháp nâng cao hiệu quả công tác hoạch định nguồn...Một số biện pháp nâng cao hiệu quả công tác hoạch định nguồn...
Một số biện pháp nâng cao hiệu quả công tác hoạch định nguồn...
 
Kinotehnik - designing the Practilite
Kinotehnik - designing the PractiliteKinotehnik - designing the Practilite
Kinotehnik - designing the Practilite
 
Margus Tiru - Positium LBS
Margus Tiru - Positium LBSMargus Tiru - Positium LBS
Margus Tiru - Positium LBS
 
The marketers pocket_guide_to_writing_good
The marketers pocket_guide_to_writing_goodThe marketers pocket_guide_to_writing_good
The marketers pocket_guide_to_writing_good
 
Atelier Design Probes - FLUPA UX-Day 2015
Atelier Design Probes - FLUPA UX-Day 2015Atelier Design Probes - FLUPA UX-Day 2015
Atelier Design Probes - FLUPA UX-Day 2015
 
CV_HENOCQ Christophe-012016-V1.0
CV_HENOCQ Christophe-012016-V1.0CV_HENOCQ Christophe-012016-V1.0
CV_HENOCQ Christophe-012016-V1.0
 
The Mission Driven Startup
The Mission Driven StartupThe Mission Driven Startup
The Mission Driven Startup
 
Agile design pattern
Agile design patternAgile design pattern
Agile design pattern
 
AJPR Company and Business Profile 2016_
AJPR Company and Business Profile 2016_AJPR Company and Business Profile 2016_
AJPR Company and Business Profile 2016_
 
Product = People
Product = PeopleProduct = People
Product = People
 
Make it Big! The Effect of Font Size and Line Spacing on Online Readability.
Make it Big! The Effect of Font Size and Line Spacing on Online Readability.Make it Big! The Effect of Font Size and Line Spacing on Online Readability.
Make it Big! The Effect of Font Size and Line Spacing on Online Readability.
 
Characteristics of soil
Characteristics of soilCharacteristics of soil
Characteristics of soil
 
PLM Open Hours - Das Potential generischer Produkstrukturen
PLM Open Hours - Das Potential generischer ProdukstrukturenPLM Open Hours - Das Potential generischer Produkstrukturen
PLM Open Hours - Das Potential generischer Produkstrukturen
 
Modelon FMI Tutorial NAMUG 2016
Modelon FMI Tutorial NAMUG 2016Modelon FMI Tutorial NAMUG 2016
Modelon FMI Tutorial NAMUG 2016
 

Semelhante a Intro to Lean UX with UserTesting

How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye trackingObjective Experience
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for StartupsPerfetti Media
 
More Than Usability
More Than UsabilityMore Than Usability
More Than UsabilityRazan Sadeq
 
User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an OverviewJulie Grundy
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital ProductKyle Soucy
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfVWO
 
User Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersUser Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersLaura B
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityUser Vision
 
Beyond "Quality Assurance"
Beyond "Quality Assurance"Beyond "Quality Assurance"
Beyond "Quality Assurance"Jason Benton
 
UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017Kelly Moran
 
Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Shilpa Thanawala
 
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventUsability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventKay Aubrey
 
Hands on Usability Testing (Jonathan Rubin)
Hands on Usability Testing (Jonathan Rubin)Hands on Usability Testing (Jonathan Rubin)
Hands on Usability Testing (Jonathan Rubin)uxpa-dc
 
Basic Principles of Interface design
Basic Principles of Interface designBasic Principles of Interface design
Basic Principles of Interface designZdeněk Lanc
 
Usability Testing 101 - an introduction
Usability Testing 101 - an introductionUsability Testing 101 - an introduction
Usability Testing 101 - an introductionElizabeth Snowdon
 
Advocating for Usability: When, Why, and How to Improve User Experiences
Advocating for Usability: When, Why, and How to Improve User ExperiencesAdvocating for Usability: When, Why, and How to Improve User Experiences
Advocating for Usability: When, Why, and How to Improve User Experiencesnclatechandtrends
 
Principles of Usability Testing For Historic Newspapers
Principles of Usability Testing For Historic NewspapersPrinciples of Usability Testing For Historic Newspapers
Principles of Usability Testing For Historic NewspapersEuropeana Newspapers
 
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank TorontoHow to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank TorontoTremis Skeete
 

Semelhante a Intro to Lean UX with UserTesting (20)

How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye tracking
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for Startups
 
More Than Usability
More Than UsabilityMore Than Usability
More Than Usability
 
User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an Overview
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital Product
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
 
User Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersUser Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with Users
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usability
 
Usability testing 2013.12.20.
Usability testing 2013.12.20.Usability testing 2013.12.20.
Usability testing 2013.12.20.
 
Beyond "Quality Assurance"
Beyond "Quality Assurance"Beyond "Quality Assurance"
Beyond "Quality Assurance"
 
UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017
 
Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15
 
體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達
 
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventUsability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
 
Hands on Usability Testing (Jonathan Rubin)
Hands on Usability Testing (Jonathan Rubin)Hands on Usability Testing (Jonathan Rubin)
Hands on Usability Testing (Jonathan Rubin)
 
Basic Principles of Interface design
Basic Principles of Interface designBasic Principles of Interface design
Basic Principles of Interface design
 
Usability Testing 101 - an introduction
Usability Testing 101 - an introductionUsability Testing 101 - an introduction
Usability Testing 101 - an introduction
 
Advocating for Usability: When, Why, and How to Improve User Experiences
Advocating for Usability: When, Why, and How to Improve User ExperiencesAdvocating for Usability: When, Why, and How to Improve User Experiences
Advocating for Usability: When, Why, and How to Improve User Experiences
 
Principles of Usability Testing For Historic Newspapers
Principles of Usability Testing For Historic NewspapersPrinciples of Usability Testing For Historic Newspapers
Principles of Usability Testing For Historic Newspapers
 
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank TorontoHow to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
 

Mais de Carlos González de Villaumbrosia

Mais de Carlos González de Villaumbrosia (9)

Mike Mayes Product School Presentation Consumer-v-Enterprise in Product Manag...
Mike Mayes Product School Presentation Consumer-v-Enterprise in Product Manag...Mike Mayes Product School Presentation Consumer-v-Enterprise in Product Manag...
Mike Mayes Product School Presentation Consumer-v-Enterprise in Product Manag...
 
The product team product school
The product team product schoolThe product team product school
The product team product school
 
Jason-Phillip Park on Creating User Stories that get your Developers Excited
Jason-Phillip Park on Creating User Stories that get your Developers ExcitedJason-Phillip Park on Creating User Stories that get your Developers Excited
Jason-Phillip Park on Creating User Stories that get your Developers Excited
 
Product school think like a product manager
Product school   think like a product managerProduct school   think like a product manager
Product school think like a product manager
 
How to Get a Product Manager Job and Grow Your PM Career
How to Get a Product Manager Job and Grow Your PM CareerHow to Get a Product Manager Job and Grow Your PM Career
How to Get a Product Manager Job and Grow Your PM Career
 
Prod school mironov-interviews
Prod school mironov-interviewsProd school mironov-interviews
Prod school mironov-interviews
 
Day in the life of product manager
Day in the life of product managerDay in the life of product manager
Day in the life of product manager
 
Startup Vs. Big Company Accessing whether you want to be a PM At a large or...
Startup Vs. Big Company  Accessing whether you want to be a PM  At a large or...Startup Vs. Big Company  Accessing whether you want to be a PM  At a large or...
Startup Vs. Big Company Accessing whether you want to be a PM At a large or...
 
How to parachute into an exisiting product
How to parachute into an exisiting productHow to parachute into an exisiting product
How to parachute into an exisiting product
 

Último

A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 

Último (20)

A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 

Intro to Lean UX with UserTesting

  • 1. Intro to Lean UX with UserTesting /Productschool @ProdSchool /ProductmanagementSF
  • 2. Alexandra Michaelides, Ph.D. - User Experience Researcher at UserTesting - Former UER at FlyWheel Software - User Experience background www.productschool.com Intro to Lean UX with UserTesting
  • 3. Intro to Lean UX with UserTesting Alexandra Michaelides, Ph.D.
  • 4. What is user experience? “User experience encompasses all aspects of the end-user’s interaction with the company, its services, and its products.” –Don Norman
  • 5. UX isn’t a new concept “When the point of contact between the product and the people becomes a point of friction, then the industrial designer has failed. On the other hand, if people are made safer, more comfortable, more eager to purchase, more efficient—or just plain happier—by contact with the product, then the designer has succeeded.” –Henry Dreyfuss, Designing for People, 1955
  • 6. Increased customer acceptance and engagement •70% of projects fail due to lack of user acceptance. (Source: Forrester Research) Increased revenue •Every $1 invested in UX returns up to $100. (Source: IBM) Decreased costs •Fixing a problem after launch is up to 100x more expensive than fixing it during design and development. (Source: NASA)
  • 7. Rule #1 of UX: You are NOT your user
  • 8. Test early, test often. Be open to feedback.
  • 9. Quantitative Qualitative Focus on numbers Focus on narrative How many, how much Why, how Large sample sizes Smaller sample sizes Done to “prove a point” Done to “understand, discover” Expensive, time-consuming Cheaper, faster Objective Subjective
  • 11. What is UserTesting? We provide insights based on videos of your customers interacting with any brand, regardless of device or location. If you can imagine it, we can probably test it.
  • 12. “If you can imagine it, we can probably test it.” Test anything with our desktop and breakthrough mobile recorders ✓ From sketches, prototypes, and websites ✓ To mobile apps, mobile websites, and even unreleased apps ✓ To real-world experiences in-store and in-home, unboxing, and more
  • 13. On-demand panel of target audience Multi-channel screen recording technology Reporting & collaboration Full support services
  • 14. You can test a design at any stage in the process • Rough concepts and low-fidelity prototypes • Clickable prototypes • High fidelity prototypes & live sites
  • 15. Remote Unmoderated Research Pros: Quick turn around time Recruitment of testers No researcher present/ honest feedback Cons: Inability to ask follow up questions, prod tester for more Inability to clarify any confusions Inability to see full context/ environment
  • 16. Starting a new study Screenshot
  • 17. Usability testing: What can you gather insights on? Visual Design: how it looks Information Architecture (IA): how it’s organized Interaction Design (IxD): how it works Content: what it says & how it sounds Functionality: what it does
  • 18. What can you “test” with UserTesting? • How do participants “use” or “interact” with an experience? – Do they understand it? – Can they access it? – Can they use it? – Is it easy to use? – Do they enjoy using it?
  • 19. What you shouldn’t “test” with UserTesting? • Will participants use or adopt the experience in the future? • Would they buy it? • Do they “like” it? • Which one do they “like” better?
  • 20. Before you launch a study, define objectives • What exactly are you hoping to learn? • Do you have broad or specific objectives?
  • 21. Writing objectives • UserTesting sessions should run approximately 15 minutes • Suggestion of 1-3 objectives • User fatigue
  • 22. A note about sample size It depends on your objective, but for a standard usability test, 5 participants per target audience will identify 85% of usability problems. You can always add more if you need to! And you should always start with just 1 user in a “pilot” study. https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
  • 23. Getting the right participants • Define the most important characteristics of your target audience – Age? Income? Hobbies? Profession? • For basic usability tests, minimal screening is required • Keep screener simple and clear
  • 24. Tip: Avoid leading questions and yes/no answers Bad ❑ Do you prefer organic cotton sheets? ❑ Yes [Accept] ❑ No Good ❑ What kind of sheets do you prefer? ❑ Organic cotton [Accept] ❑ Cotton ❑ Sateen ❑ Synthetic ❑ Polyester ❑ Silk ❑ Jersey ❑ Other
  • 25. Tip: Use multiple, separate questions Bad ❑ How often do you exercise on a treadmill? ❑ Less than 1 time a week ❑ 1-2 times a week ❑ 3+ times a week [Accept] Good ❑ How often do you exercise? ❑ Less than 1 time a week ❑ 1-2 times a week ❑ 3+ times a week [Accept] ❑ What kind of exercise do you do most often? ❑ Yoga ❑ Elliptical ❑ Treadmill [Accept] ❑ Free Weights ❑ Other
  • 26. Tip: Give participants an “out” Bad ❑ What is your marital status? ❑ Married [Accept] ❑ Not married Good ❑ What is your marital status? ❑ Married [Accept] ❑ Not married ❑ Other ❑ I prefer not to say
  • 27. URL (where users start the test) & Intro
  • 28. Consider broad & specific tasks • Broad tasks are great for: • Understanding how testers think or behave • Familiarizing testers with site • Gathering impressions • Specific tasks are great for: • Tracking browser paths/ patterns • Evaluating particular pages, processes, features • Identifying pain points at a particular part of the process
  • 29. Clarity is key • The longer your task/question is, the easier it will be for the user to miss something • Keep tasks simple • Avoid listing multiple steps at once • Use URLs or bit.ly links to ensure users evaluate the correct pages • Use instructive, active language
  • 30. Be concise and clear • Confusing questions = confusing answers • Avoid using jargon like “PDP” or “callout” • Emphasize important points • Avoid repetition in task language
  • 31. Getting honest feedback • Be aware of areas where bias, discomfort, or privilege come into play. • Make your testers feel comfortable • Use balanced language. This allows you to receive more accurate and honest feedback
  • 32. Beware of leading and bias • Leading questions are phrased in a way that steers users in a particular direction • Examples: • “How much better is the new version than the original home page?” • “Was it hard to find the Preferences page?” • “What would you improve about this page?”
  • 34. Using metrics • When to use: • Written questions • Ratings scale • Multiple choice • Make sure they are aligned with your objectives • Use sparingly—beware of user fatigue • Be specific
  • 35. Rating scale questions • Define endpoints (1 and 5) • Include both endpoint labels in the body of question • Label 1 as the “pain” point and 5 as the “positive” point • Don’t make the participant rate multiple items in one question. How poorly (1) or well (5) does this site explain its refund process? Please explain your rating out loud. 1 – Very poorly 2 3 4 5 – Very well
  • 36. Post-Test Questionnaire Note: Participants type their answers to these questions AFTER the recording stops. Consider asking participants to describe current or previous behaviors. This can help you predict future behavior. They aren’t required. (A simple “Thanks!” typed in the first field is fine.) Default post-test questions
  • 37. Test the test! Always. Do tasks and questions make sense? Does the test follow the right “flow”? Do tasks contain jargon that particpiants don’t undersatnd? Do links work?
  • 38. Don’t judge the tester. • Remember you are testing the site • If you have poor results, don’t blame the tester, change the test
  • 39. Before starting your analysis • Refresh yourself on the research objectives • Get organized. What do you want to capture for each participants? – Success rate? – Time on task? – Satisfaction? – Errors? – Quotes?
  • 40. Notes & clips in the UserTesting dashboard
  • 42. Excel export • Session Details • Demographics • Screener answers • System information • Study protocol • Metrics • Links to jump straight to each participant doing each task or question • Time-on-task* • Answers to questions • Sortable Clips & Annotations
  • 43. Learn from your mistakes. Get better. Have fun.
  • 44. Upcoming Courses www.productschool.com www.productschool.com jake@productschool.com APPLY AT SAN FRANCISCO Weekdays: May 3rd Weekends: May 7th MOUNTAIN VIEW Weekdays: June 14th Weekends: June 18th
  • 45. Mixpanel presents -- Behavioral Analytics as a Driver of Product Strategy – March 16th UPCOMING WORKSHOP www.productschool.com RSVP ON EVENTBRITE