SlideShare uma empresa Scribd logo
1 de 62
Closing the feedback loop
with a little help from your
friends



Agile 2009 Jackson Fox August 26, 2009
A few things before we start
1. Feel free to ask questions at any time
2. Can also send questions to @jacksonfox
3. Please tag any posts #feedbackloop




Agile 2009                                  2
A bit about myself...
NAME: Jackson Fox
JOB: UX Designer
COMPANY: Viget Labs


Agile 2009              3
e this q uestion
         Sinc         a lot...
          com   es up


                   vi·get
                                 e

Agile 2009                           4
Previously...
Comp Sci Major C
Academic B+
Web Developer A


Agile 2009         5
Previously...
Comp Sci Major HCI
Academic Cog Psych
Web Developer Interfaces
= User Experience

Agile 2009                 6
Product Team + Users = $


Agile 2009                   7
w do w  e make
             Ho
               this h appen?


  Product Team + Users = $
                           The $300 mil
                              button


Agile 2009                            8
Ethnography




Agile 2009 http://flic.kr/p/3gXSyw   9
Usability Lab




Agile 2009 http://flic.kr/p/Kic8T   10
Most of the time,
             we need to be creative

             What Would
             MacGyver Do?
             (with apologies to m. jackson wilkinson)




Agile 2009                                              11
Level of interaction with
             the customer

   1. Talking to customers
   2. Thinking like a customer
   3. Thinking like yourself




Agile 2009                               12
Level of interaction with
             the customer

         Talking to customers
         Thinking like a customer
         Thinking like yourself

Increasing quality of
feedback & insight


Agile 2009                               13
Is there
  We rarely have              step her  another
  the time                             e?


         Talking to customers
         Thinking like a customer
         Thinking like yourself

                              d too much
                     W e spen
                     time here

Agile 2009                                        14
Everyone Else:
                      Doesn’t Do Usability
     UX Person:
    Does Usability




 Your organizat
                ion
Agile 2009                                   15
Wh y not?     Everyone Else:
                             Doesn’t Do Usability
     UX Person:
    Does Usability




 Your organizat
                ion
Agile 2009                                          16
The big picture


As an agile team, how do you collaborate with
other groups in your organization in order to get
insight into customer needs and get timely
customer feedback on your work?



Agile 2009                                     17
Our Agenda
An example
Step-by-step
    Making the plan
    Finding our allies
    Doing the research
Making it a habit


Agile 2009               18
Our Agenda
An example
Step-by-step
    Making the plan
    Finding our allies
    Doing the research
Making it a habit


Agile 2009               19
Example:
             Choice Hotels EU

Agile 2009                      20
We had a simple plan
1. Build a prototype
2. Get feedback
3. Make awesome site




Agile 2009             21
Just a few small problems
➡   Je ne parle pas français
➡   Ich spreche keine deutsch
➡   No hablo español




Agile 2009                      22
Just a few small problems
➡   No money for travel
➡   Those pesky time zones
➡   Local customs




Agile 2009                   23
We got everyone involved
                     Training          Remote Testing




        Viget Team              Choice Team         Users

Agile 2009                                                  24
The Results
 4 Teams (UK, FR, DE, Australia)
 4 Languages
50 Users
 2 Weeks


Agile 2009                         25
Benefits	
➡   Choice teams felt like we were really listening
➡   Helped Choice teams take an active role in the design process
➡   Teams felt ownership of the design process
➡   Teams felt ownership of the user experience
➡   Helped resolve differences of opinion
➡   Gained skills for the future




Agile 2009                                                          26
Things this presentation
isn’t about:
Usability Testing

Agile 2009                 27
Thing this presentation
isn’t about:
Usability Testing
Voice of the Customer
Analytics
Agile 2009                28
Our Agenda
An example
Step-by-step
    Making the plan
    Finding our allies
    Doing the research
Making it a habit


Agile 2009               29
Making the plan...
What do we want to know?
How are we going to find out?

Agile 2009                     30
“Designch”          “User
               Resear              Researc
                                          h”
                        Empathy
             Context                    Insight

                   Generate
                      Two kinds of
                     research tasks

                   Evaluate
              Perform
                     a            Optimi zation
                            nce
                            Usability
Agile 2009                                        31
The Rumsfeld Scale
 Known Knowns
 Known Unknowns
 Unknown Unknowns
                                           need t o know
                             What  do you          goals?
Where                                 mplish your
       are peo               t o acco
problem        ple havi
       s?               ng


 Agile 2009                                           32
Good Research Questions
Are concrete, with clear answers
Don’t worry (yet) about how you’re going to answer them
Are driven by near-term project needs (1-2 iterations ahead)




Agile 2009                                                     33
Meet TuningFork.com
TuningFork.com is a specialized digital music store (not really), and
you are the product team. TurningFork has been doing relatively well
in their niche, but is facing increasing pressure from PolkaTunez.com.
To fight back, TuningFork is planning to release a greatly improved
shopping experience. In 12 weeks (6 iterations).

Project Goal
Decrease support calls related to purchasing and downloads



Agile 2009                                                          34
Task: Research Questions
Project Goal
Decrease support calls related to music downloads

Our Task
What are 5 research questions we should be asking? [5 min]




Agile 2009                                                   35
Pick the method that fits
the question, not the
question that fits the
method
Agile 2009                 36
Research Methods
Usability Testing            Contextual Interviews
Remote Usability Testing     Surveys
Guerilla Usability Testing   A/B Testing
5-Second Tests               Multivariate Testing
Card Sorting                 Divide the Dollar
Field Research
These are all useful, but don’t get hung-up
on them, try to be c reative in finding ways to
approach your question


Agile 2009                                           37
Task: Research Methods
Project Goal
Decrease support calls related to music downloads

Your Task
What research methods could we use to get answers to our
research question? (Pick one question from our list.) [5 min]




Agile 2009                                                      38
Finding our allies...
Who do we want to talk to?
Who can help us?

Agile 2009                   39
Is there a specific group of
customers we want to talk
to in order to answer our
questions?
Agile 2009                    40
Task: Which Users?
Project Goal
Decrease support calls related to music downloads

Our Task
What are 5 characteristics of the people we should be talking to? [5
min]




Agile 2009                                                             41
Identifying Allies
Access
Who is already in contact with users?
Who is already in contact with your users?

Mutual Interest
Who would be interested in this information?
Who else has a stake in your project goals?

Strengths
Who already has complementary skills?
Agile 2009                                     42
Who are these people?


Agile 2009              43
Task: Which Allies?
Project Goal
Decrease support calls related to music downloads

Our Task
Within your groups, brainstorm a list of roles/people within an
organization that might serve as allies on our project. Think about
groups with access, groups with mutual interest, groups with
complementary strengths, and groups that might have all three. [5
min]


Agile 2009                                                            44
How Do We Collaborate?
➡   We’re looking for collaborators, not subject
➡   Split up the work (planning, recruiting, testing)
➡   Share your experience
➡   Review results as a team




Agile 2009                                              45
Doing the research...
Creating the infrastructure
Getting good results

Agile 2009                    46
Creating The Infrastructure
➡   Clearly define which users we want to talk to
➡   Identify and test out the tools
➡   Document who is responsible for specific tasks
➡   Document the process
➡   Do a practice run




Agile 2009                                           47
Getting Good Results
➡   No, seriously, practice
➡   Identify the information you want to collect
➡   Decide if you’re going to record sessions
➡   Create a form for collecting information




Agile 2009                                         48
Our Agenda
An example
Step-by-step
    Making the plan
    Finding our allies
    Doing the research
Making it a habit


Agile 2009               49
Agile workflow
➡   Focus on information needs 1-2 weeks or iterations ahead
➡   Identify information needs in user stories
➡   Make it a habit




Agile 2009                                                     50
Building a customer-centric
organization


Agile 2009                    51
Vision
             Feedback
             Culture
                Jared Spool
              IA Summit 2008




Agile 2009                     52
Feedback
In the last six weeks, have you
spent more than two hours
watching someone use yours or a
competitors design?


Agile 2009                        53
Our Results
➡   Teams felt like partners in the design process
➡   Teams felt ownership of the user experience
➡   Resolved conflicts based on individual opinions
    and preconceived notions




Agile 2009                                            54
Keeping the channel open
➡   It’s easier to get feedback through open channels than it is to work
    from a cold start every time
➡   You can get user feedback when you need it, not when it’s most
    convenient to get




Agile 2009                                                             55
Recap


Agile 2009   56
Stop, Collaborate, Listen
➡   There are times when we don’t have the time or the opportunity to
    do the research we need to feed the design process
➡   There are other people in your organization who want to know the
    same things you do
➡   You can fill in knowledge gaps by collaborating
➡   Keep research efforts targeted, and focus on project goals
➡   The best results and efficiencies will come when you make this a
    regular part of your process



Agile 2009                                                          57
Good
➡   Can provide insight and feedback in circumstances where it
    otherwise wouldn’t have been possible
➡   Exposes more of the organization to the needs of your users
➡   Helps the rest of your team and your organization become part of
    the design process




Agile 2009                                                             58
Bad/Ugly
➡   May require a good deal of effort and political will to find allies
➡   Never as good as being there in person
➡   High up-front costs depending on methods and practice




Agile 2009                                                                59
Questions?
Agile 2009                60
The End
             You’ve Been Awesome
             http://spkr8.com/talks/1389




Agile 2009                                 61
Get in touch!
NAME: Jackson Fox
EMAIL: jacksonfox@gmail.com
TWITTER: @jacksonfox



Agile 2009                    62

Mais conteúdo relacionado

Mais procurados

The Emperor's New Lean UX: Why I'm not using lean UX, and perhaps why you sho...
The Emperor's New Lean UX: Why I'm not using lean UX, and perhaps why you sho...The Emperor's New Lean UX: Why I'm not using lean UX, and perhaps why you sho...
The Emperor's New Lean UX: Why I'm not using lean UX, and perhaps why you sho...Everett McKay
 
Agile india2012 po role_can you hear me now
Agile india2012  po role_can you hear me nowAgile india2012  po role_can you hear me now
Agile india2012 po role_can you hear me nowbelkisvasquez
 
CX Design and Journey Mapping for Social Thinkers
CX Design and Journey Mapping for Social ThinkersCX Design and Journey Mapping for Social Thinkers
CX Design and Journey Mapping for Social ThinkersJohn Kembel
 
Is Lean Architecture needed in Agile
Is Lean Architecture needed in AgileIs Lean Architecture needed in Agile
Is Lean Architecture needed in AgileBusiness901
 
Think you know your user? Think Again (Agile 2013)
Think you know your user? Think Again (Agile 2013)Think you know your user? Think Again (Agile 2013)
Think you know your user? Think Again (Agile 2013)Ariadna Font Llitjos
 
Design Processes and Systems in Craft
Design Processes and Systems in CraftDesign Processes and Systems in Craft
Design Processes and Systems in CraftCourtney Bradford
 
PICS - Development Process & Roles
PICS - Development Process & RolesPICS - Development Process & Roles
PICS - Development Process & Roleschemoish
 
Puc class5 discovery
Puc class5 discoveryPuc class5 discovery
Puc class5 discoveryrealstarters
 
Carmen Brion - The value for product teams to design think
Carmen Brion - The value for product teams to design thinkCarmen Brion - The value for product teams to design think
Carmen Brion - The value for product teams to design thinkuxbri
 
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...ux singapore
 
Lean UX - Integrated Teams
Lean UX - Integrated TeamsLean UX - Integrated Teams
Lean UX - Integrated TeamsFabio Armani
 
APIA2018 - Zahra Tashakorinia - Design Hacks & Paper Prototyping
APIA2018 - Zahra Tashakorinia - Design Hacks & Paper PrototypingAPIA2018 - Zahra Tashakorinia - Design Hacks & Paper Prototyping
APIA2018 - Zahra Tashakorinia - Design Hacks & Paper PrototypingEuropean Innovation Academy
 
Lean Software Development Alan Shalloway
Lean Software Development   Alan ShallowayLean Software Development   Alan Shalloway
Lean Software Development Alan ShallowayValtech UK
 
Master thesis presentation
Master thesis presentationMaster thesis presentation
Master thesis presentationTania Pavlenko
 
Surviving the Hype: An Experimental Framework for Scaling Enterprise Design T...
Surviving the Hype: An Experimental Framework for Scaling Enterprise Design T...Surviving the Hype: An Experimental Framework for Scaling Enterprise Design T...
Surviving the Hype: An Experimental Framework for Scaling Enterprise Design T...uxpin
 
다양한 입장에서의 애자일 도입
다양한 입장에서의 애자일 도입다양한 입장에서의 애자일 도입
다양한 입장에서의 애자일 도입Won Shin
 
Software development is hard
Software development is hardSoftware development is hard
Software development is hardEd Wong
 
Agile Innovation - Product Management in Turbulent times
Agile Innovation - Product Management in Turbulent timesAgile Innovation - Product Management in Turbulent times
Agile Innovation - Product Management in Turbulent timesVasco Duarte
 

Mais procurados (20)

The Emperor's New Lean UX: Why I'm not using lean UX, and perhaps why you sho...
The Emperor's New Lean UX: Why I'm not using lean UX, and perhaps why you sho...The Emperor's New Lean UX: Why I'm not using lean UX, and perhaps why you sho...
The Emperor's New Lean UX: Why I'm not using lean UX, and perhaps why you sho...
 
Agile india2012 po role_can you hear me now
Agile india2012  po role_can you hear me nowAgile india2012  po role_can you hear me now
Agile india2012 po role_can you hear me now
 
CX Design and Journey Mapping for Social Thinkers
CX Design and Journey Mapping for Social ThinkersCX Design and Journey Mapping for Social Thinkers
CX Design and Journey Mapping for Social Thinkers
 
Is Lean Architecture needed in Agile
Is Lean Architecture needed in AgileIs Lean Architecture needed in Agile
Is Lean Architecture needed in Agile
 
Think you know your user? Think Again (Agile 2013)
Think you know your user? Think Again (Agile 2013)Think you know your user? Think Again (Agile 2013)
Think you know your user? Think Again (Agile 2013)
 
Design Processes and Systems in Craft
Design Processes and Systems in CraftDesign Processes and Systems in Craft
Design Processes and Systems in Craft
 
IBM design thinking @LeanUXNYC
IBM design thinking @LeanUXNYCIBM design thinking @LeanUXNYC
IBM design thinking @LeanUXNYC
 
PICS - Development Process & Roles
PICS - Development Process & RolesPICS - Development Process & Roles
PICS - Development Process & Roles
 
Puc class5 discovery
Puc class5 discoveryPuc class5 discovery
Puc class5 discovery
 
Carmen Brion - The value for product teams to design think
Carmen Brion - The value for product teams to design thinkCarmen Brion - The value for product teams to design think
Carmen Brion - The value for product teams to design think
 
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
UXSG2014 Lightning Talks - The MUDD Model - Marrying UX, Design and Developme...
 
Lean UX - Integrated Teams
Lean UX - Integrated TeamsLean UX - Integrated Teams
Lean UX - Integrated Teams
 
APIA2018 - Zahra Tashakorinia - Design Hacks & Paper Prototyping
APIA2018 - Zahra Tashakorinia - Design Hacks & Paper PrototypingAPIA2018 - Zahra Tashakorinia - Design Hacks & Paper Prototyping
APIA2018 - Zahra Tashakorinia - Design Hacks & Paper Prototyping
 
Lean Software Development Alan Shalloway
Lean Software Development   Alan ShallowayLean Software Development   Alan Shalloway
Lean Software Development Alan Shalloway
 
Master thesis presentation
Master thesis presentationMaster thesis presentation
Master thesis presentation
 
Surviving the Hype: An Experimental Framework for Scaling Enterprise Design T...
Surviving the Hype: An Experimental Framework for Scaling Enterprise Design T...Surviving the Hype: An Experimental Framework for Scaling Enterprise Design T...
Surviving the Hype: An Experimental Framework for Scaling Enterprise Design T...
 
다양한 입장에서의 애자일 도입
다양한 입장에서의 애자일 도입다양한 입장에서의 애자일 도입
다양한 입장에서의 애자일 도입
 
UX. How to start?
UX. How to start?UX. How to start?
UX. How to start?
 
Software development is hard
Software development is hardSoftware development is hard
Software development is hard
 
Agile Innovation - Product Management in Turbulent times
Agile Innovation - Product Management in Turbulent timesAgile Innovation - Product Management in Turbulent times
Agile Innovation - Product Management in Turbulent times
 

Semelhante a Closing the feedback loop with a little help from your friends

Certified Scrum Product Owner Training
Certified Scrum Product Owner TrainingCertified Scrum Product Owner Training
Certified Scrum Product Owner Trainingguest74599
 
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (P...
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (P...UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (P...
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (P...UserZoom
 
How to get stakeholder involvement in an agile world?v2
How to get stakeholder involvement in an agile world?v2How to get stakeholder involvement in an agile world?v2
How to get stakeholder involvement in an agile world?v2Pierre E. NEIS
 
OSCON 2007: Open Design, Not By Committee
OSCON 2007: Open Design, Not By CommitteeOSCON 2007: Open Design, Not By Committee
OSCON 2007: Open Design, Not By CommitteeTed Leung
 
How to get your app or site built
How to get your app or site builtHow to get your app or site built
How to get your app or site builtJoe Chin
 
What your customers REALLY think: Incorporating usability testing into agile
What your customers REALLY think: Incorporating usability testing into agileWhat your customers REALLY think: Incorporating usability testing into agile
What your customers REALLY think: Incorporating usability testing into agilePhil Barrett
 
PMI-ACP Lesson 02 Agile Communication
PMI-ACP Lesson 02 Agile CommunicationPMI-ACP Lesson 02 Agile Communication
PMI-ACP Lesson 02 Agile CommunicationThanh Nguyen
 
An idea in a making
An idea in a makingAn idea in a making
An idea in a makingLisa Tyboni
 
Product Design for Effective Branding
Product Design for Effective Branding Product Design for Effective Branding
Product Design for Effective Branding Nizar Maulana
 
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisationLean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisationCraig Sullivan
 
Agile 10 Step Story Model
Agile 10 Step Story ModelAgile 10 Step Story Model
Agile 10 Step Story Modelallan kelly
 
A Developer’s Guide to Interaction and Interface Design
A Developer’s Guide to Interaction and Interface DesignA Developer’s Guide to Interaction and Interface Design
A Developer’s Guide to Interaction and Interface DesignHoltstrom
 
Digital Innovation Done Right with Agile, Teams & Lean Startup Thinking
Digital Innovation Done Right with Agile, Teams & Lean Startup ThinkingDigital Innovation Done Right with Agile, Teams & Lean Startup Thinking
Digital Innovation Done Right with Agile, Teams & Lean Startup ThinkingGeoff Wilson
 
User Experience
User ExperienceUser Experience
User ExperienceHans Shih
 
Paul Ellarby - Why do scrum?
Paul Ellarby - Why do scrum?Paul Ellarby - Why do scrum?
Paul Ellarby - Why do scrum?Paul Ellarby
 
UX STRAT 2013: Jon Innes and Liam Friedland, UX Strategy and Organizational S...
UX STRAT 2013: Jon Innes and Liam Friedland, UX Strategy and Organizational S...UX STRAT 2013: Jon Innes and Liam Friedland, UX Strategy and Organizational S...
UX STRAT 2013: Jon Innes and Liam Friedland, UX Strategy and Organizational S...UX STRAT
 
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...UserZoom
 
Lean Apart: A Case Study in Agile UX Design for a Distributed Team
Lean Apart: A Case Study in Agile UX Design for a Distributed TeamLean Apart: A Case Study in Agile UX Design for a Distributed Team
Lean Apart: A Case Study in Agile UX Design for a Distributed TeamC4Media
 
Google Design sprint
Google Design sprintGoogle Design sprint
Google Design sprintBruno Mendes
 

Semelhante a Closing the feedback loop with a little help from your friends (20)

Certified Scrum Product Owner Training
Certified Scrum Product Owner TrainingCertified Scrum Product Owner Training
Certified Scrum Product Owner Training
 
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (P...
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (P...UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (P...
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (P...
 
How to get stakeholder involvement in an agile world?v2
How to get stakeholder involvement in an agile world?v2How to get stakeholder involvement in an agile world?v2
How to get stakeholder involvement in an agile world?v2
 
OSCON 2007: Open Design, Not By Committee
OSCON 2007: Open Design, Not By CommitteeOSCON 2007: Open Design, Not By Committee
OSCON 2007: Open Design, Not By Committee
 
How to get your app or site built
How to get your app or site builtHow to get your app or site built
How to get your app or site built
 
What your customers REALLY think: Incorporating usability testing into agile
What your customers REALLY think: Incorporating usability testing into agileWhat your customers REALLY think: Incorporating usability testing into agile
What your customers REALLY think: Incorporating usability testing into agile
 
PMI-ACP Lesson 02 Agile Communication
PMI-ACP Lesson 02 Agile CommunicationPMI-ACP Lesson 02 Agile Communication
PMI-ACP Lesson 02 Agile Communication
 
An idea in a making
An idea in a makingAn idea in a making
An idea in a making
 
Selling Agile
Selling AgileSelling Agile
Selling Agile
 
Product Design for Effective Branding
Product Design for Effective Branding Product Design for Effective Branding
Product Design for Effective Branding
 
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisationLean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
Lean UX and Optimisation - Userzoom : 24 jan 2012 - lean optimisation
 
Agile 10 Step Story Model
Agile 10 Step Story ModelAgile 10 Step Story Model
Agile 10 Step Story Model
 
A Developer’s Guide to Interaction and Interface Design
A Developer’s Guide to Interaction and Interface DesignA Developer’s Guide to Interaction and Interface Design
A Developer’s Guide to Interaction and Interface Design
 
Digital Innovation Done Right with Agile, Teams & Lean Startup Thinking
Digital Innovation Done Right with Agile, Teams & Lean Startup ThinkingDigital Innovation Done Right with Agile, Teams & Lean Startup Thinking
Digital Innovation Done Right with Agile, Teams & Lean Startup Thinking
 
User Experience
User ExperienceUser Experience
User Experience
 
Paul Ellarby - Why do scrum?
Paul Ellarby - Why do scrum?Paul Ellarby - Why do scrum?
Paul Ellarby - Why do scrum?
 
UX STRAT 2013: Jon Innes and Liam Friedland, UX Strategy and Organizational S...
UX STRAT 2013: Jon Innes and Liam Friedland, UX Strategy and Organizational S...UX STRAT 2013: Jon Innes and Liam Friedland, UX Strategy and Organizational S...
UX STRAT 2013: Jon Innes and Liam Friedland, UX Strategy and Organizational S...
 
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...
UserZoom Education Series - Research Deep Dive - Advanced - Task-Based TOL (b...
 
Lean Apart: A Case Study in Agile UX Design for a Distributed Team
Lean Apart: A Case Study in Agile UX Design for a Distributed TeamLean Apart: A Case Study in Agile UX Design for a Distributed Team
Lean Apart: A Case Study in Agile UX Design for a Distributed Team
 
Google Design sprint
Google Design sprintGoogle Design sprint
Google Design sprint
 

Último

Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...home
 
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...instagramfab782445
 
DESIGN THINKING in architecture- Introduction
DESIGN THINKING in architecture- IntroductionDESIGN THINKING in architecture- Introduction
DESIGN THINKING in architecture- Introductionsivagami49
 
Editorial design Magazine design project.pdf
Editorial design Magazine design project.pdfEditorial design Magazine design project.pdf
Editorial design Magazine design project.pdftbatkhuu1
 
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...Call Girls in Nagpur High Profile
 
Case Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneCase Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneLukeKholes
 
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...RitikaRoy32
 
Top Rated Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
Top Rated  Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...Top Rated  Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
Top Rated Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...Call Girls in Nagpur High Profile
 
Sweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptxSweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptxbingyichin04
 
Jordan_Amanda_DMBS202404_PB1_2024-04.pdf
Jordan_Amanda_DMBS202404_PB1_2024-04.pdfJordan_Amanda_DMBS202404_PB1_2024-04.pdf
Jordan_Amanda_DMBS202404_PB1_2024-04.pdfamanda2495
 
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...kumaririma588
 
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...nirzagarg
 
Top Rated Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
Top Rated  Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...Top Rated  Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
Top Rated Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...Call Girls in Nagpur High Profile
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756dollysharma2066
 
AMBER GRAIN EMBROIDERY | Growing folklore elements | Root-based materials, w...
AMBER GRAIN EMBROIDERY | Growing folklore elements |  Root-based materials, w...AMBER GRAIN EMBROIDERY | Growing folklore elements |  Root-based materials, w...
AMBER GRAIN EMBROIDERY | Growing folklore elements | Root-based materials, w...BarusRa
 
SD_The MATATAG Curriculum Training Design.pptx
SD_The MATATAG Curriculum Training Design.pptxSD_The MATATAG Curriculum Training Design.pptx
SD_The MATATAG Curriculum Training Design.pptxjanettecruzeiro1
 
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard ...
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard  ...Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard  ...
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard ...nirzagarg
 
HiFi Call Girl Service Delhi Phone ☞ 9899900591 ☜ Escorts Service at along wi...
HiFi Call Girl Service Delhi Phone ☞ 9899900591 ☜ Escorts Service at along wi...HiFi Call Girl Service Delhi Phone ☞ 9899900591 ☜ Escorts Service at along wi...
HiFi Call Girl Service Delhi Phone ☞ 9899900591 ☜ Escorts Service at along wi...poojakaurpk09
 
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...SUHANI PANDEY
 

Último (20)

Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
Recommendable # 971589162217 # philippine Young Call Girls in Dubai By Marina...
 
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
 
DESIGN THINKING in architecture- Introduction
DESIGN THINKING in architecture- IntroductionDESIGN THINKING in architecture- Introduction
DESIGN THINKING in architecture- Introduction
 
B. Smith. (Architectural Portfolio.).pdf
B. Smith. (Architectural Portfolio.).pdfB. Smith. (Architectural Portfolio.).pdf
B. Smith. (Architectural Portfolio.).pdf
 
Editorial design Magazine design project.pdf
Editorial design Magazine design project.pdfEditorial design Magazine design project.pdf
Editorial design Magazine design project.pdf
 
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
 
Case Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneCase Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, Pune
 
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
 
Top Rated Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
Top Rated  Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...Top Rated  Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
Top Rated Pune Call Girls Saswad ⟟ 6297143586 ⟟ Call Me For Genuine Sex Serv...
 
Sweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptxSweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptx
 
Jordan_Amanda_DMBS202404_PB1_2024-04.pdf
Jordan_Amanda_DMBS202404_PB1_2024-04.pdfJordan_Amanda_DMBS202404_PB1_2024-04.pdf
Jordan_Amanda_DMBS202404_PB1_2024-04.pdf
 
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
 
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
 
Top Rated Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
Top Rated  Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...Top Rated  Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
Top Rated Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
AMBER GRAIN EMBROIDERY | Growing folklore elements | Root-based materials, w...
AMBER GRAIN EMBROIDERY | Growing folklore elements |  Root-based materials, w...AMBER GRAIN EMBROIDERY | Growing folklore elements |  Root-based materials, w...
AMBER GRAIN EMBROIDERY | Growing folklore elements | Root-based materials, w...
 
SD_The MATATAG Curriculum Training Design.pptx
SD_The MATATAG Curriculum Training Design.pptxSD_The MATATAG Curriculum Training Design.pptx
SD_The MATATAG Curriculum Training Design.pptx
 
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard ...
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard  ...Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard  ...
Anamika Escorts Service Darbhanga ❣️ 7014168258 ❣️ High Cost Unlimited Hard ...
 
HiFi Call Girl Service Delhi Phone ☞ 9899900591 ☜ Escorts Service at along wi...
HiFi Call Girl Service Delhi Phone ☞ 9899900591 ☜ Escorts Service at along wi...HiFi Call Girl Service Delhi Phone ☞ 9899900591 ☜ Escorts Service at along wi...
HiFi Call Girl Service Delhi Phone ☞ 9899900591 ☜ Escorts Service at along wi...
 
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
 

Closing the feedback loop with a little help from your friends

  • 1. Closing the feedback loop with a little help from your friends Agile 2009 Jackson Fox August 26, 2009
  • 2. A few things before we start 1. Feel free to ask questions at any time 2. Can also send questions to @jacksonfox 3. Please tag any posts #feedbackloop Agile 2009 2
  • 3. A bit about myself... NAME: Jackson Fox JOB: UX Designer COMPANY: Viget Labs Agile 2009 3
  • 4. e this q uestion Sinc a lot... com es up vi·get e Agile 2009 4
  • 5. Previously... Comp Sci Major C Academic B+ Web Developer A Agile 2009 5
  • 6. Previously... Comp Sci Major HCI Academic Cog Psych Web Developer Interfaces = User Experience Agile 2009 6
  • 7. Product Team + Users = $ Agile 2009 7
  • 8. w do w e make Ho this h appen? Product Team + Users = $ The $300 mil button Agile 2009 8
  • 10. Usability Lab Agile 2009 http://flic.kr/p/Kic8T 10
  • 11. Most of the time, we need to be creative What Would MacGyver Do? (with apologies to m. jackson wilkinson) Agile 2009 11
  • 12. Level of interaction with the customer 1. Talking to customers 2. Thinking like a customer 3. Thinking like yourself Agile 2009 12
  • 13. Level of interaction with the customer Talking to customers Thinking like a customer Thinking like yourself Increasing quality of feedback & insight Agile 2009 13
  • 14. Is there We rarely have step her another the time e? Talking to customers Thinking like a customer Thinking like yourself d too much W e spen time here Agile 2009 14
  • 15. Everyone Else: Doesn’t Do Usability UX Person: Does Usability Your organizat ion Agile 2009 15
  • 16. Wh y not? Everyone Else: Doesn’t Do Usability UX Person: Does Usability Your organizat ion Agile 2009 16
  • 17. The big picture As an agile team, how do you collaborate with other groups in your organization in order to get insight into customer needs and get timely customer feedback on your work? Agile 2009 17
  • 18. Our Agenda An example Step-by-step Making the plan Finding our allies Doing the research Making it a habit Agile 2009 18
  • 19. Our Agenda An example Step-by-step Making the plan Finding our allies Doing the research Making it a habit Agile 2009 19
  • 20. Example: Choice Hotels EU Agile 2009 20
  • 21. We had a simple plan 1. Build a prototype 2. Get feedback 3. Make awesome site Agile 2009 21
  • 22. Just a few small problems ➡ Je ne parle pas français ➡ Ich spreche keine deutsch ➡ No hablo español Agile 2009 22
  • 23. Just a few small problems ➡ No money for travel ➡ Those pesky time zones ➡ Local customs Agile 2009 23
  • 24. We got everyone involved Training Remote Testing Viget Team Choice Team Users Agile 2009 24
  • 25. The Results 4 Teams (UK, FR, DE, Australia) 4 Languages 50 Users 2 Weeks Agile 2009 25
  • 26. Benefits ➡ Choice teams felt like we were really listening ➡ Helped Choice teams take an active role in the design process ➡ Teams felt ownership of the design process ➡ Teams felt ownership of the user experience ➡ Helped resolve differences of opinion ➡ Gained skills for the future Agile 2009 26
  • 27. Things this presentation isn’t about: Usability Testing Agile 2009 27
  • 28. Thing this presentation isn’t about: Usability Testing Voice of the Customer Analytics Agile 2009 28
  • 29. Our Agenda An example Step-by-step Making the plan Finding our allies Doing the research Making it a habit Agile 2009 29
  • 30. Making the plan... What do we want to know? How are we going to find out? Agile 2009 30
  • 31. “Designch” “User Resear Researc h” Empathy Context Insight Generate Two kinds of research tasks Evaluate Perform a Optimi zation nce Usability Agile 2009 31
  • 32. The Rumsfeld Scale Known Knowns Known Unknowns Unknown Unknowns need t o know What do you goals? Where mplish your are peo t o acco problem ple havi s? ng Agile 2009 32
  • 33. Good Research Questions Are concrete, with clear answers Don’t worry (yet) about how you’re going to answer them Are driven by near-term project needs (1-2 iterations ahead) Agile 2009 33
  • 34. Meet TuningFork.com TuningFork.com is a specialized digital music store (not really), and you are the product team. TurningFork has been doing relatively well in their niche, but is facing increasing pressure from PolkaTunez.com. To fight back, TuningFork is planning to release a greatly improved shopping experience. In 12 weeks (6 iterations). Project Goal Decrease support calls related to purchasing and downloads Agile 2009 34
  • 35. Task: Research Questions Project Goal Decrease support calls related to music downloads Our Task What are 5 research questions we should be asking? [5 min] Agile 2009 35
  • 36. Pick the method that fits the question, not the question that fits the method Agile 2009 36
  • 37. Research Methods Usability Testing Contextual Interviews Remote Usability Testing Surveys Guerilla Usability Testing A/B Testing 5-Second Tests Multivariate Testing Card Sorting Divide the Dollar Field Research These are all useful, but don’t get hung-up on them, try to be c reative in finding ways to approach your question Agile 2009 37
  • 38. Task: Research Methods Project Goal Decrease support calls related to music downloads Your Task What research methods could we use to get answers to our research question? (Pick one question from our list.) [5 min] Agile 2009 38
  • 39. Finding our allies... Who do we want to talk to? Who can help us? Agile 2009 39
  • 40. Is there a specific group of customers we want to talk to in order to answer our questions? Agile 2009 40
  • 41. Task: Which Users? Project Goal Decrease support calls related to music downloads Our Task What are 5 characteristics of the people we should be talking to? [5 min] Agile 2009 41
  • 42. Identifying Allies Access Who is already in contact with users? Who is already in contact with your users? Mutual Interest Who would be interested in this information? Who else has a stake in your project goals? Strengths Who already has complementary skills? Agile 2009 42
  • 43. Who are these people? Agile 2009 43
  • 44. Task: Which Allies? Project Goal Decrease support calls related to music downloads Our Task Within your groups, brainstorm a list of roles/people within an organization that might serve as allies on our project. Think about groups with access, groups with mutual interest, groups with complementary strengths, and groups that might have all three. [5 min] Agile 2009 44
  • 45. How Do We Collaborate? ➡ We’re looking for collaborators, not subject ➡ Split up the work (planning, recruiting, testing) ➡ Share your experience ➡ Review results as a team Agile 2009 45
  • 46. Doing the research... Creating the infrastructure Getting good results Agile 2009 46
  • 47. Creating The Infrastructure ➡ Clearly define which users we want to talk to ➡ Identify and test out the tools ➡ Document who is responsible for specific tasks ➡ Document the process ➡ Do a practice run Agile 2009 47
  • 48. Getting Good Results ➡ No, seriously, practice ➡ Identify the information you want to collect ➡ Decide if you’re going to record sessions ➡ Create a form for collecting information Agile 2009 48
  • 49. Our Agenda An example Step-by-step Making the plan Finding our allies Doing the research Making it a habit Agile 2009 49
  • 50. Agile workflow ➡ Focus on information needs 1-2 weeks or iterations ahead ➡ Identify information needs in user stories ➡ Make it a habit Agile 2009 50
  • 52. Vision Feedback Culture Jared Spool IA Summit 2008 Agile 2009 52
  • 53. Feedback In the last six weeks, have you spent more than two hours watching someone use yours or a competitors design? Agile 2009 53
  • 54. Our Results ➡ Teams felt like partners in the design process ➡ Teams felt ownership of the user experience ➡ Resolved conflicts based on individual opinions and preconceived notions Agile 2009 54
  • 55. Keeping the channel open ➡ It’s easier to get feedback through open channels than it is to work from a cold start every time ➡ You can get user feedback when you need it, not when it’s most convenient to get Agile 2009 55
  • 57. Stop, Collaborate, Listen ➡ There are times when we don’t have the time or the opportunity to do the research we need to feed the design process ➡ There are other people in your organization who want to know the same things you do ➡ You can fill in knowledge gaps by collaborating ➡ Keep research efforts targeted, and focus on project goals ➡ The best results and efficiencies will come when you make this a regular part of your process Agile 2009 57
  • 58. Good ➡ Can provide insight and feedback in circumstances where it otherwise wouldn’t have been possible ➡ Exposes more of the organization to the needs of your users ➡ Helps the rest of your team and your organization become part of the design process Agile 2009 58
  • 59. Bad/Ugly ➡ May require a good deal of effort and political will to find allies ➡ Never as good as being there in person ➡ High up-front costs depending on methods and practice Agile 2009 59
  • 61. The End You’ve Been Awesome http://spkr8.com/talks/1389 Agile 2009 61
  • 62. Get in touch! NAME: Jackson Fox EMAIL: jacksonfox@gmail.com TWITTER: @jacksonfox Agile 2009 62