SlideShare uma empresa Scribd logo
1 de 47
Baixar para ler offline
1




Making smart
design decisions
Collaborative analysis techniques
Dana Chisnell
UX Lx - May 2010
2
3



Telling
Stories
4
5
6
7




Wiki or Blog
8



Rolling
Issues
Lists
9
10



Rolling issues
lists
Observations in real time

Observer participation = buy-in

Low-fi reporting
11




Observations in real time

 Large whiteboard
 Colored markers
 Don’t worry about order
 Be clear enough to remember
 what was meant
Rolling issues
Angela Coulter




Rolling issues
14




Observer participation


 After 1-3 participants, longer
 break
 You start
 Invite observers to add and track
 items
15




Weighting



 Number of incidents
 Who’s who
16
17




Big ideas, so far
Consensus: Observers buy in

 observers contribute to identifying issues
 you learn constraints
 instant reporting
18
19




What obstacles do teams face in
implementing user experience design
practices?
20



KJ
Analysis
21




Priorities, democratically

 reach consensus from subjective data

 similar to affinity diagramming

 invented by Jiro Kawakita

 objective, quick

 8 simple steps
22



1. Focus
question
What needs to be fixed in Product
X to improve the user experience?
(observations, data)

What obstacles do teams face in
implementing UE practices?
(opinion)
23



2. Organize the
group
Call together everyone concerned

For user research, only those who
observed

Typically takes an hour
24




3. Put opinions
or data on notes
For a usability test, ask for
observations

(not inferences, not opinion)



No discussion
25



4. Put notes on
a wall
Random

Read others’

Add items



No discussion
26



5. Group
similar items
In another part of the room

Start with 2 items that seem like
they belong together

Place them together, one below the
other

Move all stickies

Review and move among groups

Every item in a group

No discussion
27



6. Name each
group
Use a different color

Each person gives each group a
name

Names must be noun clusters

Split groups

Join groups

Everyone must give every group a
name

No discussion
28




7. Vote for the most
important groups
Democratic sharing of opinions

Independent of influence or
coercion

Each person writes their top 3

Rank the choices from most to
least important

Record votes on the group sticky

No discussion
29



8. Rank the
groups
Pull notes with votes

Order by the number of votes

Read off the groups

Discuss combining groups

Agreement must be unanimous

Add combined groups’ votes
together

Stop at 3-5 clear top priorities
30



Observation
to Direction
31
32



Observations
to direction
Observation
Inference
Opinion
Theory: Direction
33




Participants typed in the top chat area rather
than the bottom area.




Observations
34




Observations
                   Sources:

   What you saw     usability testing

  What you heard    user research

                    sales feedback

                    support calls and emails

                    training
35

             - Participants are drawn to
             open areas when they are
             trying to communicate with
             other attendees

             - Participants are drawn to
             the first open area they see




Inferences
36




Inferences
             Judgements

             Conclusions

             Guesses

             Intuition
37

           - Participants are invited to
           click there because it looks
           clickable

           - It’s the first open area in
           the widget

           - Participants did not see
           the typing area below




Opinions
38




Opinions
           Review the inferences

           What are the causes?

           How likely is this inference to be the
           cause?

             How often did the observation happen?

             Are there any patterns in what kinds of
             users had issues?
39




- Make the response area smaller until it has content



 Direction
40




Direction
            What’s the evidence for a design change?

            What does the strength of the cause
            suggest about a solution?



            Test theories
41
42
43

Big idea: Making sense of the data
Observation     Inference           Opinion              Direction
What happened   Gap between UI      Why you think it’s   A theory about
                and user behavior   happening            what to do about it
44
45


Big idea: Collaborative analysis
 share experience: stories
 each person shares their experience with the user
 everyone hears/sees rich users stories
 easy to visualize people using designs
  build consensus in real time: rolling issues
 observers contribute to identifying issues
 you learn constraints
 instant reporting
 identify priorities: KJ analysis
 quick, democratic
 make sense of the data, together
 what you heard, saw
 gap between the UI and the behavior
 What you think is happening
46




Where to learn more


    Dana’s blog: http://
    usabilitytestinghowto.blogspot.com/

    Download templates, examples, and
    links to other resources from
    www.wiley.com/go/usabilitytesting
47



Dana
Chisnell
dana@usabilityworks.net

www.usabilityworks.net
415.519.1148

Mais conteúdo relacionado

Semelhante a Collaborative analysis techniques for user reseaerch

MINDSTORMING: UPA 2011 full presentation
MINDSTORMING: UPA 2011 full presentationMINDSTORMING: UPA 2011 full presentation
MINDSTORMING: UPA 2011 full presentation
Dante Murphy
 
06 spd conceptgeneration (1)
06 spd conceptgeneration (1)06 spd conceptgeneration (1)
06 spd conceptgeneration (1)
NURUL4762
 
2011 dialogue the language of complex systems v.2
2011 dialogue   the language of complex systems v.22011 dialogue   the language of complex systems v.2
2011 dialogue the language of complex systems v.2
herbisoj
 
What kind of collaboration is right for you
What kind of collaboration is right for youWhat kind of collaboration is right for you
What kind of collaboration is right for you
Dr. Mohammad Obeidat
 

Semelhante a Collaborative analysis techniques for user reseaerch (20)

MOA Innovation Award: Gamification in MROCs by InSites Consulting
MOA Innovation Award: Gamification in MROCs by InSites ConsultingMOA Innovation Award: Gamification in MROCs by InSites Consulting
MOA Innovation Award: Gamification in MROCs by InSites Consulting
 
Purpose Before Action: Why You Need a Design Language System
Purpose Before Action: Why You Need a Design Language SystemPurpose Before Action: Why You Need a Design Language System
Purpose Before Action: Why You Need a Design Language System
 
English versiontallerccb lab
English versiontallerccb labEnglish versiontallerccb lab
English versiontallerccb lab
 
MINDSTORMING: UPA 2011 full presentation
MINDSTORMING: UPA 2011 full presentationMINDSTORMING: UPA 2011 full presentation
MINDSTORMING: UPA 2011 full presentation
 
Connected Research
Connected ResearchConnected Research
Connected Research
 
Design process in an Open Community
Design process in an Open CommunityDesign process in an Open Community
Design process in an Open Community
 
06 spd conceptgeneration (1)
06 spd conceptgeneration (1)06 spd conceptgeneration (1)
06 spd conceptgeneration (1)
 
Using Design Thinking to Develop Visitor-Centered Experiences
Using Design Thinking to Develop Visitor-Centered ExperiencesUsing Design Thinking to Develop Visitor-Centered Experiences
Using Design Thinking to Develop Visitor-Centered Experiences
 
Scalable Exploration of Relevance Prospects to Support Decision Making
Scalable Exploration of Relevance Prospects to Support Decision MakingScalable Exploration of Relevance Prospects to Support Decision Making
Scalable Exploration of Relevance Prospects to Support Decision Making
 
Top 5 Usability Principles
Top 5 Usability PrinciplesTop 5 Usability Principles
Top 5 Usability Principles
 
A Place at the Table
A Place at the TableA Place at the Table
A Place at the Table
 
2011 dialogue the language of complex systems v.2
2011 dialogue   the language of complex systems v.22011 dialogue   the language of complex systems v.2
2011 dialogue the language of complex systems v.2
 
How do you build an innovation culture in your team? – An 8-Step Guide
How do you build an innovation culture in your team? – An 8-Step GuideHow do you build an innovation culture in your team? – An 8-Step Guide
How do you build an innovation culture in your team? – An 8-Step Guide
 
Discourse Centric Collective Intelligence for the Common Good
Discourse Centric Collective Intelligence for the Common GoodDiscourse Centric Collective Intelligence for the Common Good
Discourse Centric Collective Intelligence for the Common Good
 
Better UX Surveys part 1
Better UX Surveys part 1Better UX Surveys part 1
Better UX Surveys part 1
 
Communication testing
Communication testingCommunication testing
Communication testing
 
Design process
Design processDesign process
Design process
 
Evaluating the Impact of Design Thinking in Action III
Evaluating the Impact of Design Thinking in Action IIIEvaluating the Impact of Design Thinking in Action III
Evaluating the Impact of Design Thinking in Action III
 
What kind of collaboration is right for you
What kind of collaboration is right for youWhat kind of collaboration is right for you
What kind of collaboration is right for you
 
Notetaking workshop
Notetaking workshopNotetaking workshop
Notetaking workshop
 

Mais de Dana Chisnell

Next generation of civic designers
Next generation of civic designersNext generation of civic designers
Next generation of civic designers
Dana Chisnell
 
Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants
Dana Chisnell
 
Iterations paper prototype
Iterations   paper prototypeIterations   paper prototype
Iterations paper prototype
Dana Chisnell
 
Usability of County Election Websites
Usability of County Election WebsitesUsability of County Election Websites
Usability of County Election Websites
Dana Chisnell
 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systems
Dana Chisnell
 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social web
Dana Chisnell
 
Making sense of the data
Making sense of the dataMaking sense of the data
Making sense of the data
Dana Chisnell
 
The users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personasThe users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personas
Dana Chisnell
 

Mais de Dana Chisnell (20)

Next generation of civic designers
Next generation of civic designersNext generation of civic designers
Next generation of civic designers
 
Making Voting Accessible
Making Voting Accessible Making Voting Accessible
Making Voting Accessible
 
Answering voters' questions at county election websites
Answering voters' questions at county election websites Answering voters' questions at county election websites
Answering voters' questions at county election websites
 
Fooled by best practice
Fooled by best practiceFooled by best practice
Fooled by best practice
 
Don't make me read! Less is more in information for voters
Don't make me read! Less is more in information for votersDon't make me read! Less is more in information for voters
Don't make me read! Less is more in information for voters
 
I can't find what i'm looking for
I can't find what i'm looking forI can't find what i'm looking for
I can't find what i'm looking for
 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systems
 
Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants
 
Looking across the voter experience
Looking across the voter experienceLooking across the voter experience
Looking across the voter experience
 
Anywhere Ballot iterations
Anywhere Ballot iterationsAnywhere Ballot iterations
Anywhere Ballot iterations
 
Iterations paper prototype
Iterations   paper prototypeIterations   paper prototype
Iterations paper prototype
 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social web
 
Persona modeler
Persona modelerPersona modeler
Persona modeler
 
Usability of County Election Websites
Usability of County Election WebsitesUsability of County Election Websites
Usability of County Election Websites
 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systems
 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social web
 
Making sense of the data
Making sense of the dataMaking sense of the data
Making sense of the data
 
The users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personasThe users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personas
 
Democracy is a design problem
Democracy is a design problemDemocracy is a design problem
Democracy is a design problem
 
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methodsCounter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
 

Último

一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
wpkuukw
 
Minimalist Orange Portfolio by Slidesgo.pptx
Minimalist Orange Portfolio by Slidesgo.pptxMinimalist Orange Portfolio by Slidesgo.pptx
Minimalist Orange Portfolio by Slidesgo.pptx
balqisyamutia
 
一比一定(购)西悉尼大学毕业证(WSU毕业证)成绩单学位证
一比一定(购)西悉尼大学毕业证(WSU毕业证)成绩单学位证一比一定(购)西悉尼大学毕业证(WSU毕业证)成绩单学位证
一比一定(购)西悉尼大学毕业证(WSU毕业证)成绩单学位证
eqaqen
 
怎样办理巴斯大学毕业证(Bath毕业证书)成绩单留信认证
怎样办理巴斯大学毕业证(Bath毕业证书)成绩单留信认证怎样办理巴斯大学毕业证(Bath毕业证书)成绩单留信认证
怎样办理巴斯大学毕业证(Bath毕业证书)成绩单留信认证
eeanqy
 
Call Girls In Ratnagiri Escorts ☎️8617370543 🔝 💃 Enjoy 24/7 Escort Service En...
Call Girls In Ratnagiri Escorts ☎️8617370543 🔝 💃 Enjoy 24/7 Escort Service En...Call Girls In Ratnagiri Escorts ☎️8617370543 🔝 💃 Enjoy 24/7 Escort Service En...
Call Girls In Ratnagiri Escorts ☎️8617370543 🔝 💃 Enjoy 24/7 Escort Service En...
Nitya salvi
 
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
nirzagarg
 
Top profile Call Girls In fatehgarh [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In fatehgarh [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In fatehgarh [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In fatehgarh [ 7014168258 ] Call Me For Genuine Models...
gajnagarg
 

Último (20)

Call Girls Jalaun Just Call 8617370543 Top Class Call Girl Service Available
Call Girls Jalaun Just Call 8617370543 Top Class Call Girl Service AvailableCall Girls Jalaun Just Call 8617370543 Top Class Call Girl Service Available
Call Girls Jalaun Just Call 8617370543 Top Class Call Girl Service Available
 
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
一比一定(购)滑铁卢大学毕业证(UW毕业证)成绩单学位证
 
LANDSCAPE ARCHITECTURE PORTFOLIO - MAREK MITACEK
LANDSCAPE ARCHITECTURE PORTFOLIO - MAREK MITACEKLANDSCAPE ARCHITECTURE PORTFOLIO - MAREK MITACEK
LANDSCAPE ARCHITECTURE PORTFOLIO - MAREK MITACEK
 
Minimalist Orange Portfolio by Slidesgo.pptx
Minimalist Orange Portfolio by Slidesgo.pptxMinimalist Orange Portfolio by Slidesgo.pptx
Minimalist Orange Portfolio by Slidesgo.pptx
 
Abortion pills in Riyadh +966572737505 <> buy cytotec <> unwanted kit Saudi A...
Abortion pills in Riyadh +966572737505 <> buy cytotec <> unwanted kit Saudi A...Abortion pills in Riyadh +966572737505 <> buy cytotec <> unwanted kit Saudi A...
Abortion pills in Riyadh +966572737505 <> buy cytotec <> unwanted kit Saudi A...
 
一比一定(购)西悉尼大学毕业证(WSU毕业证)成绩单学位证
一比一定(购)西悉尼大学毕业证(WSU毕业证)成绩单学位证一比一定(购)西悉尼大学毕业证(WSU毕业证)成绩单学位证
一比一定(购)西悉尼大学毕业证(WSU毕业证)成绩单学位证
 
怎样办理巴斯大学毕业证(Bath毕业证书)成绩单留信认证
怎样办理巴斯大学毕业证(Bath毕业证书)成绩单留信认证怎样办理巴斯大学毕业证(Bath毕业证书)成绩单留信认证
怎样办理巴斯大学毕业证(Bath毕业证书)成绩单留信认证
 
Call Girls In Ratnagiri Escorts ☎️8617370543 🔝 💃 Enjoy 24/7 Escort Service En...
Call Girls In Ratnagiri Escorts ☎️8617370543 🔝 💃 Enjoy 24/7 Escort Service En...Call Girls In Ratnagiri Escorts ☎️8617370543 🔝 💃 Enjoy 24/7 Escort Service En...
Call Girls In Ratnagiri Escorts ☎️8617370543 🔝 💃 Enjoy 24/7 Escort Service En...
 
Just Call Vip call girls Kasganj Escorts ☎️8617370543 Two shot with one girl ...
Just Call Vip call girls Kasganj Escorts ☎️8617370543 Two shot with one girl ...Just Call Vip call girls Kasganj Escorts ☎️8617370543 Two shot with one girl ...
Just Call Vip call girls Kasganj Escorts ☎️8617370543 Two shot with one girl ...
 
Mohanlalganj ! Call Girls in Lucknow - 450+ Call Girl Cash Payment 9548273370...
Mohanlalganj ! Call Girls in Lucknow - 450+ Call Girl Cash Payment 9548273370...Mohanlalganj ! Call Girls in Lucknow - 450+ Call Girl Cash Payment 9548273370...
Mohanlalganj ! Call Girls in Lucknow - 450+ Call Girl Cash Payment 9548273370...
 
Raebareli Girl Whatsapp Number 📞 8617370543 | Girls Number for Friendship
Raebareli Girl Whatsapp Number 📞 8617370543 | Girls Number for FriendshipRaebareli Girl Whatsapp Number 📞 8617370543 | Girls Number for Friendship
Raebareli Girl Whatsapp Number 📞 8617370543 | Girls Number for Friendship
 
Sweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptxSweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptx
 
Pondicherry Escorts Service Girl ^ 9332606886, WhatsApp Anytime Pondicherry
Pondicherry Escorts Service Girl ^ 9332606886, WhatsApp Anytime PondicherryPondicherry Escorts Service Girl ^ 9332606886, WhatsApp Anytime Pondicherry
Pondicherry Escorts Service Girl ^ 9332606886, WhatsApp Anytime Pondicherry
 
High Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
High Profile Escorts Nerul WhatsApp +91-9930687706, Best ServiceHigh Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
High Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
 
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
Top profile Call Girls In Mau [ 7014168258 ] Call Me For Genuine Models We ar...
 
Eye-Catching Web Design Crafting User Interfaces .docx
Eye-Catching Web Design Crafting User Interfaces .docxEye-Catching Web Design Crafting User Interfaces .docx
Eye-Catching Web Design Crafting User Interfaces .docx
 
Just Call Vip call girls Fatehpur Escorts ☎️8617370543 Two shot with one girl...
Just Call Vip call girls Fatehpur Escorts ☎️8617370543 Two shot with one girl...Just Call Vip call girls Fatehpur Escorts ☎️8617370543 Two shot with one girl...
Just Call Vip call girls Fatehpur Escorts ☎️8617370543 Two shot with one girl...
 
Hackathon evaluation template_latest_uploadpdf
Hackathon evaluation template_latest_uploadpdfHackathon evaluation template_latest_uploadpdf
Hackathon evaluation template_latest_uploadpdf
 
Top profile Call Girls In fatehgarh [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In fatehgarh [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In fatehgarh [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In fatehgarh [ 7014168258 ] Call Me For Genuine Models...
 
Independent Escorts Goregaon WhatsApp +91-9930687706, Best Service
Independent Escorts Goregaon WhatsApp +91-9930687706, Best ServiceIndependent Escorts Goregaon WhatsApp +91-9930687706, Best Service
Independent Escorts Goregaon WhatsApp +91-9930687706, Best Service
 

Collaborative analysis techniques for user reseaerch