SlideShare a Scribd company logo
1 of 40
You’re DoingThe Wrong
Research
Laura Klein
@lauraklein
laura@usersknow.com
http://www.usersknow.com
Wednesday, December 5, 2012
GET OUT OFTHE BUILDING!
@lauraklein
Wednesday, December 5, 2012
WhatYou Expect
@lauraklein
1. Get out of the building
2.Talk to “users”
3. Profit
Wednesday, December 5, 2012
What Really Happens
@lauraklein
1. Get out of the building
2. [A lot of really hard work]
3. Profit????
Wednesday, December 5, 2012
@lauraklein
Let’s figure out that middle bit...
Wednesday, December 5, 2012
How Many Ways AreYou
ListeningTo Users?
@lauraklein
Did you know that there are dozens of ways to do this?
Wednesday, December 5, 2012
Here Are A Few OfThem
@lauraklein
Task Based Usability
Analytics
Observational Usability
NPS Surveys
New User Interviews A/BTesting
Landing Pages
Wizard of Oz
Product Stubs (Fake Doors)
Customer Development Interviews
Prototype Usability
Sales
SurveysFocus Groups
Brain Imaging (yes, really!)
Guerilla UserTests
UnmoderatedTesting
ClickTests
Wednesday, December 5, 2012
@lauraklein
I’m not going to teach you how to do
all of those today.
(You’re welcome.)
Wednesday, December 5, 2012
@lauraklein
What you want to learn determines
the type of research you need to do!
Wednesday, December 5, 2012
You Only NeedTo Know About
TwoTypes Of Research*
@lauraklein
Generative & Evaluative
*for now
Wednesday, December 5, 2012
Generative Research
@lauraklein
You want to know what to do next.
Wednesday, December 5, 2012
You Don’t Have An Idea
@lauraklein
Find a great idea by learning about problems within
specific markets.
Best Methods:
•Contextual Inquiry
•Customer Development Interviews
Wednesday, December 5, 2012
LikeThis
@lauraklein
Wednesday, December 5, 2012
You Have A Great Idea
(maybe)
@lauraklein
Learn more about your potential customers and figure
out what’s necessary for an MVP.
Best Methods:
•Contextual Inquiry
•Customer Development Interviews
•Observational Studies of Competitive Products
Wednesday, December 5, 2012
LikeThis
@lauraklein
Wednesday, December 5, 2012
You Have An MVP & WantTo
Know How People Use It
@lauraklein
Understand more about your users and what they’re
really doing with your product.
Best Methods:
•Observational Studies
•Diary Studies
•Analytics
Wednesday, December 5, 2012
LikeThis
@lauraklein
Wednesday, December 5, 2012
OrThis
@lauraklein
Wednesday, December 5, 2012
See A Pattern?
@lauraklein
Generative research is about Generating Ideas.
Wednesday, December 5, 2012
Evaluative Research
@lauraklein
You want to know if what you did was right.
Wednesday, December 5, 2012
You’re Doing A Redesign & Want
To Make Sure It’s Better
@lauraklein
See whether users can perform key tasks in your
product easily and without confusion.
Best Methods:
•Task Based UsabilityTests
•Observation of Interactive Prototypes
Wednesday, December 5, 2012
LikeThis
@lauraklein
Wednesday, December 5, 2012
You Created A New Landing
Page & WantToTest Messaging
@lauraklein
Understand whether users really understand your new
tag line, and whether your messaging conveys what you
think it should.
Best Methods:
•Five SecondTests
•Guerilla Usability
•A/BTests
Wednesday, December 5, 2012
LikeThis
@lauraklein
Wednesday, December 5, 2012
You’reThinking Of Adding A
Feature
@lauraklein
Validate whether or not it’s a good idea before
spending time designing and building it.
Best Methods:
•Feature Stubs (Fake Doors)
•Wizard of Oz Features
Wednesday, December 5, 2012
LikeThis
@lauraklein
“This feature is coming soon!”
Wednesday, December 5, 2012
You Added A Feature & WantTo
KnowThe Impact
@lauraklein
Learn whether your changes improve both the user
experience and your key business metrics.
Best Methods:
•Customer Interviews
•Observation Studies
•A/BTest Against Control
•Analytics
Wednesday, December 5, 2012
LikeThis
@lauraklein
Wednesday, December 5, 2012
See A Pattern?
@lauraklein
Evaluative research is about Validating Hypotheses.
Wednesday, December 5, 2012
@lauraklein
Did you notice that some methods are
quantitative?
That’s because Qualitative Research
sucks for some things.
Wednesday, December 5, 2012
@lauraklein
Quantitative Research tells you what.
Qualitative Research tells you why.
Wednesday, December 5, 2012
@lauraklein
Some Common Questions
Wednesday, December 5, 2012
What Are Some Good Research
MethodsThat Don’t Involve
People OutsideThe Company?
@lauraklein
(This page intentionally left blank)
Wednesday, December 5, 2012
But What If I’m Solving My Own
Problem?
@lauraklein
That depends. How many of you are there?
Wednesday, December 5, 2012
What If I Don’t Have Any Users?
@lauraklein
Get some.
Wednesday, December 5, 2012
But What If I Can’t Get Enough
Users For Quantitative Research?
@lauraklein
Rely more heavily on Qualitative Research.
Wednesday, December 5, 2012
Ok,YourTurn
Wednesday, December 5, 2012
Exercise!
@lauraklein
Type Metric Plan
Fill this in with real life examples of some research.
Wednesday, December 5, 2012
Example!
@lauraklein
Type Metric Plan
Generative
Observational
Testing
Revenue
Observe 4 people who have never used the product
before go through the payment flow to find pain
points that are causing drop off in the funnel.
Generate ideas for fixing those usability bugs.
Evaluative
5 SecondTest
Sign Up
Test whether potential users understand the new
messaging on the home page by running 20 people
who have never seen the site before through a 5
second test and asking the question,“What does this
product do?”
Wednesday, December 5, 2012
More Questions?
You know where to find me...
@lauraklein
laura@usersknow.com
http://www.usersknow.com
pssst...this will all be in the book!
To be published by O’Reilly in early 2013.
Wednesday, December 5, 2012

More Related Content

What's hot

What's hot (7)

Slideshare presentation #3 kw
Slideshare presentation #3 kwSlideshare presentation #3 kw
Slideshare presentation #3 kw
 
Lead Generation: Inexpensive Tactics
Lead Generation: Inexpensive Tactics Lead Generation: Inexpensive Tactics
Lead Generation: Inexpensive Tactics
 
Implementing a Systematic Content Development Process
Implementing a Systematic Content Development ProcessImplementing a Systematic Content Development Process
Implementing a Systematic Content Development Process
 
Surveys in practice and theory
Surveys in practice and theorySurveys in practice and theory
Surveys in practice and theory
 
Design tips for surveys UIE 2012
Design tips for surveys UIE 2012Design tips for surveys UIE 2012
Design tips for surveys UIE 2012
 
Learning from your customers - Discovery & Validation research
Learning from your customers - Discovery & Validation researchLearning from your customers - Discovery & Validation research
Learning from your customers - Discovery & Validation research
 
Prepping Your Engineering Candidates to Reduce Your False Negatives
Prepping Your Engineering Candidates to Reduce Your False NegativesPrepping Your Engineering Candidates to Reduce Your False Negatives
Prepping Your Engineering Candidates to Reduce Your False Negatives
 

Viewers also liked (7)

Monitoring and management of recovery
Monitoring and management of recoveryMonitoring and management of recovery
Monitoring and management of recovery
 
Retail consultant kpi
Retail consultant kpiRetail consultant kpi
Retail consultant kpi
 
Strategically Screwing Up
Strategically Screwing UpStrategically Screwing Up
Strategically Screwing Up
 
2014 창립제발표(리눅스스터디)
2014 창립제발표(리눅스스터디)2014 창립제발표(리눅스스터디)
2014 창립제발표(리눅스스터디)
 
Prisa El Pais July 09
Prisa El Pais July 09Prisa El Pais July 09
Prisa El Pais July 09
 
Just dance 4
Just dance 4Just dance 4
Just dance 4
 
Math workshop
Math workshopMath workshop
Math workshop
 

Similar to Which research when

SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHubSOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
DevOpsDays Tel Aviv
 
Social Media Workshop
Social Media WorkshopSocial Media Workshop
Social Media Workshop
Nick Betts
 
What is it good for? Absolutely something! Remote, unmoderated usability stud...
What is it good for? Absolutely something! Remote, unmoderated usability stud...What is it good for? Absolutely something! Remote, unmoderated usability stud...
What is it good for? Absolutely something! Remote, unmoderated usability stud...
BoulderLisaS
 
Practical research project management
Practical research project managementPractical research project management
Practical research project management
Vickie Buenger
 

Similar to Which research when (20)

Getting Started with UX Research OCUX Camp CRossi Aug 2017
Getting Started with UX Research OCUX Camp CRossi Aug 2017Getting Started with UX Research OCUX Camp CRossi Aug 2017
Getting Started with UX Research OCUX Camp CRossi Aug 2017
 
Getting started with UX research October 2017.pptx
Getting started with UX research October 2017.pptxGetting started with UX research October 2017.pptx
Getting started with UX research October 2017.pptx
 
Create the Foundation of an App - UX Wannabe 5
Create the Foundation of an App - UX Wannabe 5Create the Foundation of an App - UX Wannabe 5
Create the Foundation of an App - UX Wannabe 5
 
User Research & Strategy for UX
User Research & Strategy for UXUser Research & Strategy for UX
User Research & Strategy for UX
 
UX Field Research Basics
 UX Field Research Basics  UX Field Research Basics
UX Field Research Basics
 
Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014
 
Clare Corthell: Learning Data Science Online
Clare Corthell: Learning Data Science OnlineClare Corthell: Learning Data Science Online
Clare Corthell: Learning Data Science Online
 
Building a Data Science Portfolio that Rocks
Building a Data Science Portfolio that RocksBuilding a Data Science Portfolio that Rocks
Building a Data Science Portfolio that Rocks
 
User interview workshop
User interview workshopUser interview workshop
User interview workshop
 
Group Discussion.pptx
Group Discussion.pptxGroup Discussion.pptx
Group Discussion.pptx
 
UX Field Research Basics Chicago Camp 2017
UX Field Research Basics Chicago Camp 2017UX Field Research Basics Chicago Camp 2017
UX Field Research Basics Chicago Camp 2017
 
How to Sell Design to Developers
How to Sell Design to DevelopersHow to Sell Design to Developers
How to Sell Design to Developers
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
 
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHubSOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
 
Social Media Workshop
Social Media WorkshopSocial Media Workshop
Social Media Workshop
 
What is it good for? Absolutely something! Remote, unmoderated usability stud...
What is it good for? Absolutely something! Remote, unmoderated usability stud...What is it good for? Absolutely something! Remote, unmoderated usability stud...
What is it good for? Absolutely something! Remote, unmoderated usability stud...
 
Never show a design you haven't tested
Never show a design you haven't testedNever show a design you haven't tested
Never show a design you haven't tested
 
Collaborative Research The Conference by Media Evolution Malmö
Collaborative Research The Conference by Media Evolution MalmöCollaborative Research The Conference by Media Evolution Malmö
Collaborative Research The Conference by Media Evolution Malmö
 
Practical research project management
Practical research project managementPractical research project management
Practical research project management
 
Product Management in the Era of Data Science
Product Management in the Era of Data ScienceProduct Management in the Era of Data Science
Product Management in the Era of Data Science
 

More from Robert-Emmanuel Mayssat

CSS alarm Handler (BEAST) at the EPICS Collaboration meeting 2010
CSS alarm Handler (BEAST) at the EPICS Collaboration meeting 2010CSS alarm Handler (BEAST) at the EPICS Collaboration meeting 2010
CSS alarm Handler (BEAST) at the EPICS Collaboration meeting 2010
Robert-Emmanuel Mayssat
 
Honeywell - Alarm management standards taken seriously
Honeywell - Alarm management standards taken seriouslyHoneywell - Alarm management standards taken seriously
Honeywell - Alarm management standards taken seriously
Robert-Emmanuel Mayssat
 

More from Robert-Emmanuel Mayssat (20)

Alarm management at DeltaV
Alarm management at DeltaVAlarm management at DeltaV
Alarm management at DeltaV
 
Beast alarm guideline_2013
Beast alarm guideline_2013Beast alarm guideline_2013
Beast alarm guideline_2013
 
CSS alarm Handler (BEAST) at the EPICS Collaboration meeting 2010
CSS alarm Handler (BEAST) at the EPICS Collaboration meeting 2010CSS alarm Handler (BEAST) at the EPICS Collaboration meeting 2010
CSS alarm Handler (BEAST) at the EPICS Collaboration meeting 2010
 
CSS - Alarm Management System (AMS)
CSS - Alarm Management System (AMS)CSS - Alarm Management System (AMS)
CSS - Alarm Management System (AMS)
 
Honeywell - Alarm management standards taken seriously
Honeywell - Alarm management standards taken seriouslyHoneywell - Alarm management standards taken seriously
Honeywell - Alarm management standards taken seriously
 
Sample Beamline Scientist Job Description
Sample Beamline Scientist Job DescriptionSample Beamline Scientist Job Description
Sample Beamline Scientist Job Description
 
Sample GUI Style Guide
Sample GUI Style Guide Sample GUI Style Guide
Sample GUI Style Guide
 
ALH user guide 1.2.33 (May 2013)
ALH user guide 1.2.33 (May 2013)ALH user guide 1.2.33 (May 2013)
ALH user guide 1.2.33 (May 2013)
 
CSS Alarm Handler (BEAST) 2009
CSS Alarm Handler (BEAST) 2009CSS Alarm Handler (BEAST) 2009
CSS Alarm Handler (BEAST) 2009
 
Storytelling for startups
Storytelling for startupsStorytelling for startups
Storytelling for startups
 
The New Soft-IOC Based alarm handler at the SNS
The New Soft-IOC Based alarm handler at the SNSThe New Soft-IOC Based alarm handler at the SNS
The New Soft-IOC Based alarm handler at the SNS
 
Manual of the CSS Alarm Handler (Beast)
Manual of the CSS Alarm Handler (Beast)Manual of the CSS Alarm Handler (Beast)
Manual of the CSS Alarm Handler (Beast)
 
BEST, the CSS Alarm Handler - Performance Testing
BEST, the CSS Alarm Handler - Performance TestingBEST, the CSS Alarm Handler - Performance Testing
BEST, the CSS Alarm Handler - Performance Testing
 
CSS Alarm Handling
CSS Alarm HandlingCSS Alarm Handling
CSS Alarm Handling
 
BEAST - CSS Alarm Handler Performance Tests
BEAST - CSS Alarm Handler Performance TestsBEAST - CSS Alarm Handler Performance Tests
BEAST - CSS Alarm Handler Performance Tests
 
Web browser design template
Web browser design templateWeb browser design template
Web browser design template
 
Ipad design template
Ipad design templateIpad design template
Ipad design template
 
Iphone 5 design template
Iphone 5 design templateIphone 5 design template
Iphone 5 design template
 
Epics Qt design specification
Epics Qt design specificationEpics Qt design specification
Epics Qt design specification
 
Epics Qt requirements specification
Epics Qt requirements specificationEpics Qt requirements specification
Epics Qt requirements specification
 

Recently uploaded

一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
wpkuukw
 
Minimalist Orange Portfolio by Slidesgo.pptx
Minimalist Orange Portfolio by Slidesgo.pptxMinimalist Orange Portfolio by Slidesgo.pptx
Minimalist Orange Portfolio by Slidesgo.pptx
balqisyamutia
 
Madhyamgram \ (Genuine) Escort Service Kolkata | Service-oriented sexy call g...
Madhyamgram \ (Genuine) Escort Service Kolkata | Service-oriented sexy call g...Madhyamgram \ (Genuine) Escort Service Kolkata | Service-oriented sexy call g...
Madhyamgram \ (Genuine) Escort Service Kolkata | Service-oriented sexy call g...
HyderabadDolls
 
Simple Conference Style Presentation by Slidesgo.pptx
Simple Conference Style Presentation by Slidesgo.pptxSimple Conference Style Presentation by Slidesgo.pptx
Simple Conference Style Presentation by Slidesgo.pptx
balqisyamutia
 
Top profile Call Girls In eluru [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In eluru [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In eluru [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In eluru [ 7014168258 ] Call Me For Genuine Models We ...
gajnagarg
 
Anupama Kundoo Cost Effective detailed ppt with plans and elevations with det...
Anupama Kundoo Cost Effective detailed ppt with plans and elevations with det...Anupama Kundoo Cost Effective detailed ppt with plans and elevations with det...
Anupama Kundoo Cost Effective detailed ppt with plans and elevations with det...
sriharipichandi
 
poliovirus-190801072449. pptx
poliovirus-190801072449.            pptxpoliovirus-190801072449.            pptx
poliovirus-190801072449. pptx
ssuser0ad194
 
ab-initio-training basics and architecture
ab-initio-training basics and architectureab-initio-training basics and architecture
ab-initio-training basics and architecture
saipriyacoool
 
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
nirzagarg
 

Recently uploaded (20)

Call Girls Jalaun Just Call 8617370543 Top Class Call Girl Service Available
Call Girls Jalaun Just Call 8617370543 Top Class Call Girl Service AvailableCall Girls Jalaun Just Call 8617370543 Top Class Call Girl Service Available
Call Girls Jalaun Just Call 8617370543 Top Class Call Girl Service Available
 
The hottest UI and UX Design Trends 2024
The hottest UI and UX Design Trends 2024The hottest UI and UX Design Trends 2024
The hottest UI and UX Design Trends 2024
 
Lecture 01 Introduction To Multimedia.pptx
Lecture 01 Introduction To Multimedia.pptxLecture 01 Introduction To Multimedia.pptx
Lecture 01 Introduction To Multimedia.pptx
 
Jordan_Amanda_DMBS202404_PB1_2024-04.pdf
Jordan_Amanda_DMBS202404_PB1_2024-04.pdfJordan_Amanda_DMBS202404_PB1_2024-04.pdf
Jordan_Amanda_DMBS202404_PB1_2024-04.pdf
 
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
 
Minimalist Orange Portfolio by Slidesgo.pptx
Minimalist Orange Portfolio by Slidesgo.pptxMinimalist Orange Portfolio by Slidesgo.pptx
Minimalist Orange Portfolio by Slidesgo.pptx
 
Madhyamgram \ (Genuine) Escort Service Kolkata | Service-oriented sexy call g...
Madhyamgram \ (Genuine) Escort Service Kolkata | Service-oriented sexy call g...Madhyamgram \ (Genuine) Escort Service Kolkata | Service-oriented sexy call g...
Madhyamgram \ (Genuine) Escort Service Kolkata | Service-oriented sexy call g...
 
Furniture & Joinery Details_Designs.pptx
Furniture & Joinery Details_Designs.pptxFurniture & Joinery Details_Designs.pptx
Furniture & Joinery Details_Designs.pptx
 
Simple Conference Style Presentation by Slidesgo.pptx
Simple Conference Style Presentation by Slidesgo.pptxSimple Conference Style Presentation by Slidesgo.pptx
Simple Conference Style Presentation by Slidesgo.pptx
 
LANDSCAPE ARCHITECTURE PORTFOLIO - MAREK MITACEK
LANDSCAPE ARCHITECTURE PORTFOLIO - MAREK MITACEKLANDSCAPE ARCHITECTURE PORTFOLIO - MAREK MITACEK
LANDSCAPE ARCHITECTURE PORTFOLIO - MAREK MITACEK
 
Just Call Vip call girls Fatehpur Escorts ☎️8617370543 Two shot with one girl...
Just Call Vip call girls Fatehpur Escorts ☎️8617370543 Two shot with one girl...Just Call Vip call girls Fatehpur Escorts ☎️8617370543 Two shot with one girl...
Just Call Vip call girls Fatehpur Escorts ☎️8617370543 Two shot with one girl...
 
Essential UI/UX Design Principles: A Comprehensive Guide
Essential UI/UX Design Principles: A Comprehensive GuideEssential UI/UX Design Principles: A Comprehensive Guide
Essential UI/UX Design Principles: A Comprehensive Guide
 
Top profile Call Girls In eluru [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In eluru [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In eluru [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In eluru [ 7014168258 ] Call Me For Genuine Models We ...
 
Anupama Kundoo Cost Effective detailed ppt with plans and elevations with det...
Anupama Kundoo Cost Effective detailed ppt with plans and elevations with det...Anupama Kundoo Cost Effective detailed ppt with plans and elevations with det...
Anupama Kundoo Cost Effective detailed ppt with plans and elevations with det...
 
poliovirus-190801072449. pptx
poliovirus-190801072449.            pptxpoliovirus-190801072449.            pptx
poliovirus-190801072449. pptx
 
Sweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptxSweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptx
 
TRose UXPA Experience Design Concord .pptx
TRose UXPA Experience Design Concord .pptxTRose UXPA Experience Design Concord .pptx
TRose UXPA Experience Design Concord .pptx
 
ab-initio-training basics and architecture
ab-initio-training basics and architectureab-initio-training basics and architecture
ab-initio-training basics and architecture
 
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
 
Independent Escorts Goregaon WhatsApp +91-9930687706, Best Service
Independent Escorts Goregaon WhatsApp +91-9930687706, Best ServiceIndependent Escorts Goregaon WhatsApp +91-9930687706, Best Service
Independent Escorts Goregaon WhatsApp +91-9930687706, Best Service
 

Which research when