SlideShare uma empresa Scribd logo
1 de 39
User Research on the
                      Cheap

    The views       Jen McGinn        Chris LaRoche,
expressed in this
                    User Researcher   Usability Consultant
presentation are
 my own and do      Oracle            MIT
 not necessarily
reflect the views
    of Oracle
Agenda
๏   Recruiting & incentives on the cheap
๏   Inexpensive methods
๏   Agile testing on the cheap
๏   Tools and technologies for under $100
๏   Mobile testing on the cheap
๏   Q &A
Camera
                                     Mirror

             Test system
Microphone          Connections to
                     control room



  Speaker
   phone
PiP
                      Monitor
 PiP
Monitor   Recording             Sound
           system               mixer




   Microphone     Camera
                 controller
What other costs are there?
๏   Recruiting
    -   Recruiters charge ~$150 per participant + an
        administrative fee for each study

๏   Incentives
    -   $100 - $150 per participant

๏   Time
    -   As an employee
    -   As a consultant
    -   As a function of whether or not the
        stakeholders can take action on your results
Remember the 1990’s?



              Good




       Fast          Cheap
Recruiting
๏   Your existing customers
    -   Get contacts from sales or support
    -   Licensee databases

๏   Friends & family recruit
    -   Send an email to your company alias
    -   Include dates, general recruiting criteria,
        incentives, and description of the activity

๏   Employees
    -   Same process as friends & family
Recruiting: Creating a DB
๏   User group meetings or conferences
    -    By industry or product
    -    Set up a table
        - Get permission, have them announce you
        - Hand out chocolates or branded swag
        - Gather contact info or business cards from
           people who are willing to opt into future
           research
๏   Link on the company home page, in the
    forums, or at the end of the installer flow
        -   Have them complete a screening survey
Considerations for Recruiting
๏   Conflict with other departments or orgs
๏   Do not contact lists
๏   Legal responsibilities
    -    Massachusetts 201 CMR 17.00
        - Protection & storage
    -    Maintaining and updating personal
         information
Incentives
๏   Customers
    -   Often not allowed to offer $$
    -   Company-branded pens, caps, water bottles,
        etc. under $20 if not government employees
    -   $5 coffee cards

๏   Employees
    -   Will often opt in for no incentive
    -   Company-branded swag
    -   Lunch on us
    -   $25 gift cards
Incentives
๏   Depends on the (in)convenience of the
    research
๏   Ways to drive down the inconvenience
    (and therefore cost of the incentive)
    -   Go to them (eg. Engineers at work)
    -   Go to them (eg. Social site users at home)
    -   Turn it into a phone call
    -   Remote meeting/test/feedback session using
        screen sharing software
Methods: Competitive Analysis
๏   Compare features or tasks across
    products
    -   Great for background data
    -   No users required
    -   Uncovers mental models, current experience
    -   Great if competitors exist
    -   Great if those products are obtainable
    -   Great if the competitors are going after the
        same customers or business space
Methods: Data Mining
๏   Customer support data (bugs filed) &
    helpdesk (live)
    -   Great if you can get access to it
    -   Great if it’s being collected & you know
        where to look for it

๏   Usage (click stream) data
    -   Great if you are allowed to gather usage data
    -   Great if you can install code on the website
    -   Great if data is complete enough that you
        can draw conclusions from it
Methods: Surveys
          ๏   Data Collection
              -   Profile: when you want to get a snapshot of
                  the composition of your current user
                  population
              -   Satisfaction: when you want to find out what
                  works well and what doesn’t
              -   Value: when you want to know what people
                  find important

          ๏   Click stream analysis
              -   Adding hidden code to the survey can turn it
                  into an unmoderated testing tool: Demo

http://www.slideshare.net/Andrea_Evans/andrea-evans-upa-
                        2012-ignite
Methods: Interviews/Site Visit
๏   In person
    -   Great if you are within driving distance
    -   Gives you rich, contextual data
    -   Can view them in their environment, see their
        performance support tools
    -   Recommendation: pair up with a colleague

๏   On the phone
    -   Great for quick scheduling and execution
    -   Great for geographically distributed
        participants
Methods: Remote Testing
๏   Moderated remote testing
    -   Just like testing in the lab
    -   Using an online meeting and conference call
    -   Any length

๏   Unmoderated remote testing
    -   No facilitator
    -   Participants screen themselves
    -   Participants can be instructed to think aloud
    -   Usually tasks under 30 minutes total
    -   Fast! Same day results
Methods: Agile Testing
         ๏   RITE-Krug combines 2 “discount” test methods
             -   RITE = Rapid Iterative Test Environment
             -   Krug = Steve Krug’s approach in his books
         ๏   Formative: testing designs or code about to
              change
         ๏   Representatives from PM, Dev & Design are
             required to attend all sessions + debrief
         ๏   3 – 4 participants within 24 hours
         ๏   Prototypes can change between participants
         ๏   Debrief happens ASAP after last participant
         ๏   No formal report, just observations & action
             items that stakeholders will take as a result

Submitted for publication, Copyright 2012 Oracle
Usability Testing Lab Costs
 ๏   Facilities (participant room, control room,
     giant wall of mirror in between)
 ๏   Recording hardware (camera and mic)
 ๏   Web-conferencing software
 ๏   Recording software
 ๏   Observation system (computer, optional
     second monitor)
 ๏   Conference call
Portable Lab
                              Speaker
   Microphone   Test system    phone

 Camera
Conference room /observation room

                         Web conferencing
                            software

             Recording
              software
Conference
   call




                                  Second monitor
                                   for observers
Screen Sharing 1:1




     http://www.skype.com/intl/en-
us/features/allfeatures/screen-sharing/
Screen Sharing 1:M




   https://join.me/ (About link)
Conference Call




https://www.freeconferencecall.com/loginaccount.asp
Participant Camera & Mic




http://www.logitech.com/en-us/product/hd-
        pro-webcam-c920?crid=34
Note-taking




  http://www.livescribe.com/en-us/
Audio Recording




  http://store.sony.com/c/Recorders-and-
  Microphones/en/c/S_Voice_Recorders
Note-taking: Live Note


                       Bamboo stylus




http://itunes.apple.com/us/app/live-notes/id383300181?mt=8#
Note-taking: EverNote




 http://evernote.com/download/
Web
      join.me
cam




         FreeConferencecall.com
Analytics




http://www.google.com/analytics/features/index.html
Heat Maps (~$100)




   http://www.crazyegg.com/
Unmoderated Testing




 http://www.usertesting.com/
Mobile: Before the Test




http://4ourth.com/wiki/4ourth%20Mobile%20Touch%20Template
Mobile Screen-casting




    http://www.reflectorapp.com/
Mobile Testing




http://www.ipevo.com/prods/Point-2-View-USB-Camera
Hardware Review

                                        < $100
      MobileTemplate                  4th Mobile ($5)

       Mobile Camera                    IPevo ($69)

                                   Sony Digital Recorder
      Audio recording
                                        ($29 - 79)
   Audio-video recording        Logitech webcam ($30 – 100)

Note taking & audio recording     LiveScribe ($89 and up)

      Note-taking input             iPad Stylus ($2-30)
Software Review
                                Free               < or ~$100
 Web conferencing           Skype, join.me
        VoIP                Skype, join.me
 Conference call for
                       FreeConferenceCall.com      Skype, join.me
      phones
 Screen recording       QuickTime Player (Mac)      SnagIt ($50)
Note taking & audio
                               Evernote             Live Note ($6)
     recording
                       Survey tool (assuming you   UserTesting.com
Unmoderated testing
                          already pay for one)          ($39)
Mobile device screen                                   Reflector
       casting                                       ($15 or $50)
     Analytics             Google Analytics        NewEgg ($102)
Questions?
The views
expressed in this
                    Thank you!
presentation are
                    Jen McGinn
 my own and do
 not necessarily    jen dot mcginn at oracle dot com
reflect the views   Chris LaRoche
    of Oracle
                    c dot laroche at neu dot edu

Mais conteúdo relacionado

Mais procurados

Agile User Experience Design
Agile User Experience DesignAgile User Experience Design
Agile User Experience DesignKevin Wong
 
Great Agile in a UX World
Great Agile in a UX WorldGreat Agile in a UX World
Great Agile in a UX WorldAnthony Viviano
 
3wks Introduction Pack
3wks Introduction Pack3wks Introduction Pack
3wks Introduction PackAlex Freeman
 
Agile User Experience Design
Agile User Experience DesignAgile User Experience Design
Agile User Experience DesignAlla Zollers
 
Agile-User Experience Design: an Agile and User-Centered Process?
Agile-User Experience Design: an Agile and User-Centered Process?Agile-User Experience Design: an Agile and User-Centered Process?
Agile-User Experience Design: an Agile and User-Centered Process?louschwartz
 
UX Research in an Agile World
UX Research in an Agile WorldUX Research in an Agile World
UX Research in an Agile WorldHirajaved10
 
Build The Right Thing With The RITE Method | Rapid Usability Testing
Build The Right Thing With The RITE Method | Rapid Usability TestingBuild The Right Thing With The RITE Method | Rapid Usability Testing
Build The Right Thing With The RITE Method | Rapid Usability TestingKyle Soucy
 
Design Spikes for the Dual-Track Agile Process
Design Spikes for the Dual-Track Agile ProcessDesign Spikes for the Dual-Track Agile Process
Design Spikes for the Dual-Track Agile Processuxpin
 
Agile-User Experience Design: With or Without a Usability Expert in the Team?
Agile-User Experience Design: With or Without a Usability Expert in the Team?Agile-User Experience Design: With or Without a Usability Expert in the Team?
Agile-User Experience Design: With or Without a Usability Expert in the Team?louschwartz
 
Collaborative usability observation session intro
Collaborative usability observation session introCollaborative usability observation session intro
Collaborative usability observation session introNeil Allison
 
UX in a Dual Track Agile World
UX in a Dual Track Agile WorldUX in a Dual Track Agile World
UX in a Dual Track Agile WorldAndrea Neuhoff
 
Introducing Agile to Product Teams
Introducing Agile to Product TeamsIntroducing Agile to Product Teams
Introducing Agile to Product TeamsJeremy Horn
 
Drupalcamp London 2015
Drupalcamp London 2015Drupalcamp London 2015
Drupalcamp London 2015Amazee Labs
 
Integrating User Centered Design with Agile Development
Integrating User Centered Design with Agile DevelopmentIntegrating User Centered Design with Agile Development
Integrating User Centered Design with Agile DevelopmentJulia Borkenhagen
 
Using Prototyping to Streamline the Instructional Design Process
Using Prototyping to Streamline the Instructional Design ProcessUsing Prototyping to Streamline the Instructional Design Process
Using Prototyping to Streamline the Instructional Design ProcessLisa Whalen
 
Importance of the Usability of a website
Importance of the Usability of a websiteImportance of the Usability of a website
Importance of the Usability of a websiteSherihan Anver
 
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI ResearchTutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI ResearchEd Chi
 

Mais procurados (20)

Agile User Experience Design
Agile User Experience DesignAgile User Experience Design
Agile User Experience Design
 
Great Agile in a UX World
Great Agile in a UX WorldGreat Agile in a UX World
Great Agile in a UX World
 
3wks Introduction Pack
3wks Introduction Pack3wks Introduction Pack
3wks Introduction Pack
 
Agile User Experience Design
Agile User Experience DesignAgile User Experience Design
Agile User Experience Design
 
Agile-User Experience Design: an Agile and User-Centered Process?
Agile-User Experience Design: an Agile and User-Centered Process?Agile-User Experience Design: an Agile and User-Centered Process?
Agile-User Experience Design: an Agile and User-Centered Process?
 
UX Research in an Agile World
UX Research in an Agile WorldUX Research in an Agile World
UX Research in an Agile World
 
Build The Right Thing With The RITE Method | Rapid Usability Testing
Build The Right Thing With The RITE Method | Rapid Usability TestingBuild The Right Thing With The RITE Method | Rapid Usability Testing
Build The Right Thing With The RITE Method | Rapid Usability Testing
 
Design Spikes for the Dual-Track Agile Process
Design Spikes for the Dual-Track Agile ProcessDesign Spikes for the Dual-Track Agile Process
Design Spikes for the Dual-Track Agile Process
 
Agile-User Experience Design: With or Without a Usability Expert in the Team?
Agile-User Experience Design: With or Without a Usability Expert in the Team?Agile-User Experience Design: With or Without a Usability Expert in the Team?
Agile-User Experience Design: With or Without a Usability Expert in the Team?
 
Collaborative usability observation session intro
Collaborative usability observation session introCollaborative usability observation session intro
Collaborative usability observation session intro
 
Agile UX
Agile UXAgile UX
Agile UX
 
UX in a Dual Track Agile World
UX in a Dual Track Agile WorldUX in a Dual Track Agile World
UX in a Dual Track Agile World
 
Introducing Agile to Product Teams
Introducing Agile to Product TeamsIntroducing Agile to Product Teams
Introducing Agile to Product Teams
 
Breaking the mold: Lean Product Management and MVP in a Large Company
Breaking the mold: Lean Product Management and MVP in a Large CompanyBreaking the mold: Lean Product Management and MVP in a Large Company
Breaking the mold: Lean Product Management and MVP in a Large Company
 
Drupalcamp London 2015
Drupalcamp London 2015Drupalcamp London 2015
Drupalcamp London 2015
 
Agile and UX
Agile and UXAgile and UX
Agile and UX
 
Integrating User Centered Design with Agile Development
Integrating User Centered Design with Agile DevelopmentIntegrating User Centered Design with Agile Development
Integrating User Centered Design with Agile Development
 
Using Prototyping to Streamline the Instructional Design Process
Using Prototyping to Streamline the Instructional Design ProcessUsing Prototyping to Streamline the Instructional Design Process
Using Prototyping to Streamline the Instructional Design Process
 
Importance of the Usability of a website
Importance of the Usability of a websiteImportance of the Usability of a website
Importance of the Usability of a website
 
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI ResearchTutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
Tutorial on Using Amazon Mechanical Turk (MTurk) for HCI Research
 

Semelhante a UR on the Cheap December 2012

Pay pal paypal continuous performance as a self-service with fully-automated...
Pay pal  paypal continuous performance as a self-service with fully-automated...Pay pal  paypal continuous performance as a self-service with fully-automated...
Pay pal paypal continuous performance as a self-service with fully-automated...Dynatrace
 
Measure camp tools of the cro rabble
Measure camp   tools of the cro rabbleMeasure camp   tools of the cro rabble
Measure camp tools of the cro rabbleCraig Sullivan
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityUser Vision
 
Conversionista : Conversion manager course - Stockholm 20 march 2013
Conversionista : Conversion manager course  - Stockholm 20 march 2013Conversionista : Conversion manager course  - Stockholm 20 march 2013
Conversionista : Conversion manager course - Stockholm 20 march 2013Craig Sullivan
 
Advanced Codeless Testing for Web Apps
Advanced Codeless Testing for Web AppsAdvanced Codeless Testing for Web Apps
Advanced Codeless Testing for Web AppsPerfecto by Perforce
 
DOES15 - Mirco Hering - Adopting DevOps Practices for Systems of Record – An ...
DOES15 - Mirco Hering - Adopting DevOps Practices for Systems of Record – An ...DOES15 - Mirco Hering - Adopting DevOps Practices for Systems of Record – An ...
DOES15 - Mirco Hering - Adopting DevOps Practices for Systems of Record – An ...Gene Kim
 
Mirco hering devops for systems of record final
Mirco hering devops for systems of record finalMirco hering devops for systems of record final
Mirco hering devops for systems of record finalMirco Hering
 
Toolkits and tips of the conversion pros v 1.6
Toolkits and tips of the conversion pros v 1.6Toolkits and tips of the conversion pros v 1.6
Toolkits and tips of the conversion pros v 1.6Craig Sullivan
 
Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...
Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...
Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...XBOSoft
 
Continuous delivery is more than dev ops
Continuous delivery is more than dev opsContinuous delivery is more than dev ops
Continuous delivery is more than dev opsAgile Montréal
 
Useagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility
 
Build the Right Regression Suite with Behavior-Driven Testing
Build the Right Regression Suite with Behavior-Driven TestingBuild the Right Regression Suite with Behavior-Driven Testing
Build the Right Regression Suite with Behavior-Driven TestingTechWell
 
Webinar: Survey Pocket Demonstration
Webinar: Survey Pocket DemonstrationWebinar: Survey Pocket Demonstration
Webinar: Survey Pocket DemonstrationQuestionPro
 
Models and Methods for Global User Research
Models and Methods for Global User ResearchModels and Methods for Global User Research
Models and Methods for Global User ResearchGfK User Centric
 
User Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of ExcellenceUser Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of ExcellenceTechWell
 
Діана Пінчук “How to test mobile SDK and do not loose faith in yourself “
Діана Пінчук “How to test mobile SDK and do not loose faith in yourself “Діана Пінчук “How to test mobile SDK and do not loose faith in yourself “
Діана Пінчук “How to test mobile SDK and do not loose faith in yourself “Dakiry
 
Barcamp Bangalore 2 - On User Experience and Usability Testing
Barcamp Bangalore 2 - On User Experience and Usability TestingBarcamp Bangalore 2 - On User Experience and Usability Testing
Barcamp Bangalore 2 - On User Experience and Usability TestingAmit Pande
 

Semelhante a UR on the Cheap December 2012 (20)

Pay pal paypal continuous performance as a self-service with fully-automated...
Pay pal  paypal continuous performance as a self-service with fully-automated...Pay pal  paypal continuous performance as a self-service with fully-automated...
Pay pal paypal continuous performance as a self-service with fully-automated...
 
Measure camp tools of the cro rabble
Measure camp   tools of the cro rabbleMeasure camp   tools of the cro rabble
Measure camp tools of the cro rabble
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usability
 
The Future of Testing
The Future of TestingThe Future of Testing
The Future of Testing
 
Conversionista : Conversion manager course - Stockholm 20 march 2013
Conversionista : Conversion manager course  - Stockholm 20 march 2013Conversionista : Conversion manager course  - Stockholm 20 march 2013
Conversionista : Conversion manager course - Stockholm 20 march 2013
 
Advanced Codeless Testing for Web Apps
Advanced Codeless Testing for Web AppsAdvanced Codeless Testing for Web Apps
Advanced Codeless Testing for Web Apps
 
Whatusersdo
WhatusersdoWhatusersdo
Whatusersdo
 
DOES15 - Mirco Hering - Adopting DevOps Practices for Systems of Record – An ...
DOES15 - Mirco Hering - Adopting DevOps Practices for Systems of Record – An ...DOES15 - Mirco Hering - Adopting DevOps Practices for Systems of Record – An ...
DOES15 - Mirco Hering - Adopting DevOps Practices for Systems of Record – An ...
 
Mirco hering devops for systems of record final
Mirco hering devops for systems of record finalMirco hering devops for systems of record final
Mirco hering devops for systems of record final
 
Toolkits and tips of the conversion pros v 1.6
Toolkits and tips of the conversion pros v 1.6Toolkits and tips of the conversion pros v 1.6
Toolkits and tips of the conversion pros v 1.6
 
Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...
Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...
Not Your Grandfather's Requirements-Based Testing Webinar – Robin Goldsmith, ...
 
Continuous delivery is more than dev ops
Continuous delivery is more than dev opsContinuous delivery is more than dev ops
Continuous delivery is more than dev ops
 
Useagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility Webinar - Automated User Testing
Useagility Webinar - Automated User Testing
 
Build the Right Regression Suite with Behavior-Driven Testing
Build the Right Regression Suite with Behavior-Driven TestingBuild the Right Regression Suite with Behavior-Driven Testing
Build the Right Regression Suite with Behavior-Driven Testing
 
Webinar: Survey Pocket Demonstration
Webinar: Survey Pocket DemonstrationWebinar: Survey Pocket Demonstration
Webinar: Survey Pocket Demonstration
 
Models and Methods for Global User Research
Models and Methods for Global User ResearchModels and Methods for Global User Research
Models and Methods for Global User Research
 
User Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of ExcellenceUser Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of Excellence
 
Діана Пінчук “How to test mobile SDK and do not loose faith in yourself “
Діана Пінчук “How to test mobile SDK and do not loose faith in yourself “Діана Пінчук “How to test mobile SDK and do not loose faith in yourself “
Діана Пінчук “How to test mobile SDK and do not loose faith in yourself “
 
Barcamp Bangalore 2 - On User Experience and Usability Testing
Barcamp Bangalore 2 - On User Experience and Usability TestingBarcamp Bangalore 2 - On User Experience and Usability Testing
Barcamp Bangalore 2 - On User Experience and Usability Testing
 
Grothues ndc oslo_2016
Grothues ndc oslo_2016Grothues ndc oslo_2016
Grothues ndc oslo_2016
 

Mais de Jennifer (Jen) McGinn

Crafting your UX resume and designing your portfolio
Crafting your UX resume and designing your portfolioCrafting your UX resume and designing your portfolio
Crafting your UX resume and designing your portfolioJennifer (Jen) McGinn
 
Gamestorming your way to a UX strategy
Gamestorming your way to a UX strategy Gamestorming your way to a UX strategy
Gamestorming your way to a UX strategy Jennifer (Jen) McGinn
 
Do no harm: Tips for avoiding the unethical turn of events in user research (...
Do no harm: Tips for avoiding the unethical turn of events in user research (...Do no harm: Tips for avoiding the unethical turn of events in user research (...
Do no harm: Tips for avoiding the unethical turn of events in user research (...Jennifer (Jen) McGinn
 
Talk to PS SIG CHI on Agile user research
Talk to PS SIG CHI on Agile user researchTalk to PS SIG CHI on Agile user research
Talk to PS SIG CHI on Agile user researchJennifer (Jen) McGinn
 
Jen McGinn persona development for upa (uxpa) 2012
Jen McGinn persona development for upa (uxpa) 2012Jen McGinn persona development for upa (uxpa) 2012
Jen McGinn persona development for upa (uxpa) 2012Jennifer (Jen) McGinn
 

Mais de Jennifer (Jen) McGinn (6)

Crafting your UX resume and designing your portfolio
Crafting your UX resume and designing your portfolioCrafting your UX resume and designing your portfolio
Crafting your UX resume and designing your portfolio
 
Gamestorming your way to a UX strategy
Gamestorming your way to a UX strategy Gamestorming your way to a UX strategy
Gamestorming your way to a UX strategy
 
Do no harm: Tips for avoiding the unethical turn of events in user research (...
Do no harm: Tips for avoiding the unethical turn of events in user research (...Do no harm: Tips for avoiding the unethical turn of events in user research (...
Do no harm: Tips for avoiding the unethical turn of events in user research (...
 
Talk to PS SIG CHI on Agile user research
Talk to PS SIG CHI on Agile user researchTalk to PS SIG CHI on Agile user research
Talk to PS SIG CHI on Agile user research
 
Jen McGinn persona development for upa (uxpa) 2012
Jen McGinn persona development for upa (uxpa) 2012Jen McGinn persona development for upa (uxpa) 2012
Jen McGinn persona development for upa (uxpa) 2012
 
Team M CUE 9 report
Team M CUE 9 reportTeam M CUE 9 report
Team M CUE 9 report
 

Último

Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 

Último (20)

Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 

UR on the Cheap December 2012

  • 1. User Research on the Cheap The views Jen McGinn Chris LaRoche, expressed in this User Researcher Usability Consultant presentation are my own and do Oracle MIT not necessarily reflect the views of Oracle
  • 2. Agenda ๏ Recruiting & incentives on the cheap ๏ Inexpensive methods ๏ Agile testing on the cheap ๏ Tools and technologies for under $100 ๏ Mobile testing on the cheap ๏ Q &A
  • 3. Camera Mirror Test system Microphone Connections to control room Speaker phone
  • 4. PiP Monitor PiP Monitor Recording Sound system mixer Microphone Camera controller
  • 5. What other costs are there? ๏ Recruiting - Recruiters charge ~$150 per participant + an administrative fee for each study ๏ Incentives - $100 - $150 per participant ๏ Time - As an employee - As a consultant - As a function of whether or not the stakeholders can take action on your results
  • 6. Remember the 1990’s? Good Fast Cheap
  • 7. Recruiting ๏ Your existing customers - Get contacts from sales or support - Licensee databases ๏ Friends & family recruit - Send an email to your company alias - Include dates, general recruiting criteria, incentives, and description of the activity ๏ Employees - Same process as friends & family
  • 8. Recruiting: Creating a DB ๏ User group meetings or conferences - By industry or product - Set up a table - Get permission, have them announce you - Hand out chocolates or branded swag - Gather contact info or business cards from people who are willing to opt into future research ๏ Link on the company home page, in the forums, or at the end of the installer flow - Have them complete a screening survey
  • 9. Considerations for Recruiting ๏ Conflict with other departments or orgs ๏ Do not contact lists ๏ Legal responsibilities - Massachusetts 201 CMR 17.00 - Protection & storage - Maintaining and updating personal information
  • 10. Incentives ๏ Customers - Often not allowed to offer $$ - Company-branded pens, caps, water bottles, etc. under $20 if not government employees - $5 coffee cards ๏ Employees - Will often opt in for no incentive - Company-branded swag - Lunch on us - $25 gift cards
  • 11. Incentives ๏ Depends on the (in)convenience of the research ๏ Ways to drive down the inconvenience (and therefore cost of the incentive) - Go to them (eg. Engineers at work) - Go to them (eg. Social site users at home) - Turn it into a phone call - Remote meeting/test/feedback session using screen sharing software
  • 12. Methods: Competitive Analysis ๏ Compare features or tasks across products - Great for background data - No users required - Uncovers mental models, current experience - Great if competitors exist - Great if those products are obtainable - Great if the competitors are going after the same customers or business space
  • 13. Methods: Data Mining ๏ Customer support data (bugs filed) & helpdesk (live) - Great if you can get access to it - Great if it’s being collected & you know where to look for it ๏ Usage (click stream) data - Great if you are allowed to gather usage data - Great if you can install code on the website - Great if data is complete enough that you can draw conclusions from it
  • 14. Methods: Surveys ๏ Data Collection - Profile: when you want to get a snapshot of the composition of your current user population - Satisfaction: when you want to find out what works well and what doesn’t - Value: when you want to know what people find important ๏ Click stream analysis - Adding hidden code to the survey can turn it into an unmoderated testing tool: Demo http://www.slideshare.net/Andrea_Evans/andrea-evans-upa- 2012-ignite
  • 15. Methods: Interviews/Site Visit ๏ In person - Great if you are within driving distance - Gives you rich, contextual data - Can view them in their environment, see their performance support tools - Recommendation: pair up with a colleague ๏ On the phone - Great for quick scheduling and execution - Great for geographically distributed participants
  • 16. Methods: Remote Testing ๏ Moderated remote testing - Just like testing in the lab - Using an online meeting and conference call - Any length ๏ Unmoderated remote testing - No facilitator - Participants screen themselves - Participants can be instructed to think aloud - Usually tasks under 30 minutes total - Fast! Same day results
  • 17. Methods: Agile Testing ๏ RITE-Krug combines 2 “discount” test methods - RITE = Rapid Iterative Test Environment - Krug = Steve Krug’s approach in his books ๏ Formative: testing designs or code about to change ๏ Representatives from PM, Dev & Design are required to attend all sessions + debrief ๏ 3 – 4 participants within 24 hours ๏ Prototypes can change between participants ๏ Debrief happens ASAP after last participant ๏ No formal report, just observations & action items that stakeholders will take as a result Submitted for publication, Copyright 2012 Oracle
  • 18. Usability Testing Lab Costs ๏ Facilities (participant room, control room, giant wall of mirror in between) ๏ Recording hardware (camera and mic) ๏ Web-conferencing software ๏ Recording software ๏ Observation system (computer, optional second monitor) ๏ Conference call
  • 19. Portable Lab Speaker Microphone Test system phone Camera
  • 20. Conference room /observation room Web conferencing software Recording software Conference call Second monitor for observers
  • 21. Screen Sharing 1:1 http://www.skype.com/intl/en- us/features/allfeatures/screen-sharing/
  • 22. Screen Sharing 1:M https://join.me/ (About link)
  • 24. Participant Camera & Mic http://www.logitech.com/en-us/product/hd- pro-webcam-c920?crid=34
  • 26. Audio Recording http://store.sony.com/c/Recorders-and- Microphones/en/c/S_Voice_Recorders
  • 27. Note-taking: Live Note Bamboo stylus http://itunes.apple.com/us/app/live-notes/id383300181?mt=8#
  • 29. Web join.me cam FreeConferencecall.com
  • 31. Heat Maps (~$100) http://www.crazyegg.com/
  • 33. Mobile: Before the Test http://4ourth.com/wiki/4ourth%20Mobile%20Touch%20Template
  • 34. Mobile Screen-casting http://www.reflectorapp.com/
  • 36. Hardware Review < $100 MobileTemplate 4th Mobile ($5) Mobile Camera IPevo ($69) Sony Digital Recorder Audio recording ($29 - 79) Audio-video recording Logitech webcam ($30 – 100) Note taking & audio recording LiveScribe ($89 and up) Note-taking input iPad Stylus ($2-30)
  • 37. Software Review Free < or ~$100 Web conferencing Skype, join.me VoIP Skype, join.me Conference call for FreeConferenceCall.com Skype, join.me phones Screen recording QuickTime Player (Mac) SnagIt ($50) Note taking & audio Evernote Live Note ($6) recording Survey tool (assuming you UserTesting.com Unmoderated testing already pay for one) ($39) Mobile device screen Reflector casting ($15 or $50) Analytics Google Analytics NewEgg ($102)
  • 39. The views expressed in this Thank you! presentation are Jen McGinn my own and do not necessarily jen dot mcginn at oracle dot com reflect the views Chris LaRoche of Oracle c dot laroche at neu dot edu

Notas do Editor

  1. So here we are in the typical tricked out usability lab. We’ve got a dedicated room with a mirrored window, a dedicated test system, speakerphone, camera, and microphone all hard-wired to an observation room next door.
  2. As an employee, faster studies &amp; results mean that you can conduct more studies. As a consultant, more studies can == more $$. As a f() of stakeholders’ abilities to implement your recommendations, that comes down to how effective you are as a practitioner – what value are you providing? So sometimes cheap == fast.
  3. In the 1990’s, the business joke was you could “pick two” Good and Fast (but not cheap), cheap and fast (but not good). We’ll show you tools and methods so you can have all three.
  4. If you only need to share your screen with the one system in conference room where your observers will be sitting, you can use Skype. It ‘s free, includes VoIP calling, and works on Mac, PC and mobile platforms.
  5. And if you need to share your screen with multiple observers, you can try join.me. Like Skype, it can provide a VoIP phone number, but allows you to share your screen with up to 250 people. Free. And it works on PC, Mac, and Mobile platforms.
  6. But for the Skype call to be free, everyone has to have a Skype-enabled device, like a computer or smart phone. What if they just have phones? Not a problem. You can set up a reservationless conference with free conference call dot com.
  7. The observers can hear over the phone , but I recommend adding a webcam to your test system, to improve the sound quality of your recordings. You can get one for around $30. Because it’s likely your laptop mic isn’t great.
  8. Now what about a note-taker? If you can’t afford to hire one, and you can’t afford one of those super-cool pens that records conversations while you write on special paper, there are options.
  9. Say you already have an iPad – you can purchase a stylus for between $2 and $30. Live Note is an app that records while you write for $6. The notes play back as the same time as the audio, so you can hear what was being said when you wrote them.
  10. Evernote is free, works on the Mac, PC and mobile platforms, and your notes get stored in the cloud. It will record the audio as you write – it just won’t be synchronized with the text as it plays back. That’s what the $6 for LiveNote gets you.
  11. Rather than having a dedicated lab, you can get the same high quality results of a dedicated lab at a much lower cost and greater portability, so you can take the lab to where your participants work and live, or even conduct research from the comfort of your home.
  12. http://www.reflectorapp.com/
  13. Now, I have to be honest -- I do love the ease and convenience of having a permanent usability lab. But if you’re an independent or if your company doesn’t have the budget for a traditional usability lab, you probably have budget for these options.
  14. Now, I have to be honest -- I do love the ease and convenience of having a permanent usability lab. But if you’re an independent or if your company doesn’t have the budget for a traditional usability lab, you probably have budget for these options.