SlideShare a Scribd company logo
1 of 9
Open Source Usability Testing Software
                      Megan McKeever
                          Sep. 23 2012
   Infomaki is an open-
    source, lightweight
    usability tool developed
    for and by the New York
    Public Library.
       Launched in February
        2009
   It presents respondents
    with a single question
    at a time from a pool of
    active questions.
   In its first seven months
    of use, it had fielded
    over 100,000 responses
    from over 10,000
    respondents.
• Traditionally, the NYPL had used surveys to get customer feedback.
    • It was a regular, please-answer-these-questions pitch with 19
      questions about web usage habits spread across 8 pages.
    • Over 14 days, that survey received 7,341 individual answers to
      questions from 520 respondents, just 60% of whom completed
      the whole survey.
    • But, in November of 2008 with a re-design launch looming,
      they wanted to look for new feedback tools.
December 2010                            January 2010
                Images via archive.org
 NYPL learned about the Five Second
 Test (open source usability software),
 which allows users to upload two
 designs and polls users on preference,
 upload one design and ask participants
 to recall elements after initial sighting.
 (http://fivesecondtest.com/)
   Designed to act as a “one question” survey, it
    presents respondents with a randomly selected
    questions from a pool of active questions.
    Initially, two types of questions were supported:
    multiple choice and “Where would you click
    to…?” (attached to a screenshot or other
    image).
   Recently, they have added five-second tests for
    comparing two designs and for testing recall of
    a design’s features. Response times for each
    answer are also recorded.
   All of the language used in the project is
    “geared towards lowering the cognitive load on
    the respondent.”
       The link from the main web site to the tool
        reads, “Answer a single question and help us
        improve our web site!” “The sales pitch makes it
        clear that even if you only answer one question,
        it will be welcomed.” - Michael Lascarides,
        Code4Lib
   After answering a single question, participants
    are taken to a “thank you” page where they are
    asked if they’d like to answer additional
    questions.
       90% of respondents answer more than one
        question, and the average number of questions
        answered per respondent is nearly 11. - NYPL
•   The application stores all
    results from varied types of
    questions in a single database
    table, which makes it
    extremely easy to analyze
    response statistics and ensure
    that no respondent sees the
    same question more than once.
•   Response data is displayed in
    tables and histograms (for
    multiple choice-type
    questions) and heat maps (for
    “click on this”-style
    questions).
      • Heat maps can show up as
         individual clicks or a
         percentage grid overlay,
                                       Infomaki sample Histogram results
         and colors are adjustable
         for contrast with different
         designs.
Infomaki Sample Heatmap
 Released to public in May 2009
 Can be downloaded at SourceForge


 Other   options
    Chalkmark – Free trial
    Usabila – Free first month

More Related Content

Featured

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Megan McKeever - Open Source

  • 1. Open Source Usability Testing Software Megan McKeever Sep. 23 2012
  • 2. Infomaki is an open- source, lightweight usability tool developed for and by the New York Public Library.  Launched in February 2009  It presents respondents with a single question at a time from a pool of active questions.  In its first seven months of use, it had fielded over 100,000 responses from over 10,000 respondents.
  • 3. • Traditionally, the NYPL had used surveys to get customer feedback. • It was a regular, please-answer-these-questions pitch with 19 questions about web usage habits spread across 8 pages. • Over 14 days, that survey received 7,341 individual answers to questions from 520 respondents, just 60% of whom completed the whole survey. • But, in November of 2008 with a re-design launch looming, they wanted to look for new feedback tools.
  • 4. December 2010 January 2010 Images via archive.org
  • 5.  NYPL learned about the Five Second Test (open source usability software), which allows users to upload two designs and polls users on preference, upload one design and ask participants to recall elements after initial sighting. (http://fivesecondtest.com/)
  • 6. Designed to act as a “one question” survey, it presents respondents with a randomly selected questions from a pool of active questions. Initially, two types of questions were supported: multiple choice and “Where would you click to…?” (attached to a screenshot or other image).  Recently, they have added five-second tests for comparing two designs and for testing recall of a design’s features. Response times for each answer are also recorded.  All of the language used in the project is “geared towards lowering the cognitive load on the respondent.”  The link from the main web site to the tool reads, “Answer a single question and help us improve our web site!” “The sales pitch makes it clear that even if you only answer one question, it will be welcomed.” - Michael Lascarides, Code4Lib  After answering a single question, participants are taken to a “thank you” page where they are asked if they’d like to answer additional questions.  90% of respondents answer more than one question, and the average number of questions answered per respondent is nearly 11. - NYPL
  • 7. The application stores all results from varied types of questions in a single database table, which makes it extremely easy to analyze response statistics and ensure that no respondent sees the same question more than once. • Response data is displayed in tables and histograms (for multiple choice-type questions) and heat maps (for “click on this”-style questions). • Heat maps can show up as individual clicks or a percentage grid overlay, Infomaki sample Histogram results and colors are adjustable for contrast with different designs.
  • 9.  Released to public in May 2009  Can be downloaded at SourceForge  Other options  Chalkmark – Free trial  Usabila – Free first month