This document discusses guerrilla usability testing techniques that can provide quick feedback from users. It introduces whiteboards, coffee time testing, sketch boards, and online resources as methods. Whiteboards involve posting interfaces on a whiteboard and collecting anonymous comments. Coffee time testing buys people's time in exchange for coffee to get quick feedback. Sketch boards use templates for users to provide input over 45-60 minutes. Online resources like UsabilityHub and Usability.gov provide free templates and guides. The goal is to start conversations with users early to understand what they do and do not want.
Scaling API-first – The story of a global engineering organization
Guerilla Usability Testing
1. Welcome
SharePoint TechFest Houston
Guerilla Usability Testing
@sparkhound
James Thompson
sparkhound User Experience designer
@pixelneer
2. “If I had asked people what they wanted,
they would have said faster horses.”
Horseshit.
- Henry Ford
3. “If I had asked people what they wanted,
they would have said faster horses.”
Horseshit.
- Henry Ford
horse sh!t
4. Some Popular excuses for not asking
users
It’s too hard
It’s too expensive
We don’t have access to users
We are the users
We already know what the users want
5. Keep in mind…
These techniques are intended to help you start
having conversations with your users.
The user doesn’t always know what they want –
but they do know what they DO NOT.
If nobody wants to use your project when it’s done …
wouldn’t you want to know before you start it?
7. • A whiteboard preferably in a high traffic area
• A printout / drawing of the interface
• A simple question you want answered
Whiteboards
What do you need?
8. Whiteboards
What do you do? • Post the interface you want feedback for on the
whiteboard. (masking tape or magnets)
• Ask your question.
• Make sure there are plenty of markers available.
9. Whiteboards
Advantages
• Quick and easy
• Users can comment anonymously
• Easily done in an agile environment
Disadvantages
• May get no suggestions for improvement
• Little opportunity for any follow-up with users
• Potential for non-focused comments
10. • A laptop/ tablet or just paper and a pen
• Coffee, Tea, or tasty beverage* (coffee shop or break room)
• A simple question(s) you want answered
• No more than 5 minutes of someone’s time
Coffee Time
What do you need?
* search Drunk User Testing
11. Coffee Time
What do you do? • Setup in a corner table etc.
• Have your laptop/ tablet or sketches out and ready
• Ask random people if you can buy their coffee for 5
minutes of their time getting some feedback.
• Ask no more than 2-3 ‘non-leading’ questions and
take note of their responses.
12. Coffee Time
Advantages
• Fairly easy
• Instant user feedback
• User is present for follow up questions - Like why?
What about…?
Disadvantages
• ‘Random’ people will have dynamically different skill
levels (This is not necessarily a bad thing.)
• Potentially quick turn-around
• High Distraction level
13. sketch boards
6-up template 1-up template
• Some Sharpies, post it notes
• A small group (typically no more that 5 or so)
• Some 6-up and 1-up templates*
• 45 minutes to an hour
• A moderator to take notes and manage time boxes.
What do you need?
* PDF downloads at sparkhound.com/blog
14. sketch boards
6-up template 1-up template
What do you do? • Distribute the 6-up templates and begin the timebox.
• At the conclusion of the timbebox, each user should
present his/hers 6-up explaining choices they made.
• Repeat the process with the 1-up template.
15. sketch boards
6-up template 1-up template
Advantages
• Allows the users to feel like they are part of the
process
• Gets early ‘buy-in’ from users
• Facilitates an open conversation that will almost
always provide new ideas.
Disadvantages
• A bit more time consuming than the other options
• Works best at the front of an agile process
16. online resources
usabilityhub.com
• Free (You gain credits by participating in other tests)
• Make your own OR use one of 9 ‘templates’
• Tablet and phone versions available
usability.gov
• Free
• Over 60 Testing Documents and Templates
• How to’s, Best Practices…
17. Thank You.
SharePoint TechFest Houston
Guerilla Usability Testing
@sparkhound
James Thompson
sparkhound User Experience designer
@pixelneer
Notas do Editor
Show of hands. How many have heard this before?
How many have used it as a reason to not ask users for feedback?
Faster horses were NOT a problem. In fact, horses were THE problem.
More specifically…
An easier way to remove the average of 41 dead horses a day on the streets of New York
Some place to relocate the 1200~ metric tons of manure produced each day, and someone to do the relocating
Some place to stable the 100,000+ horses that operated within New York, and food to feed them
Nobody would have asked for faster ones.
Any of these sound familiar?
These techniques are intended to help you start
having conversations with your users.
The user doesn’t always know what they want –
however they always know what they DO NOT.
If nobody wants to user your project when your done …
wouldn’t you want to know before you start it?
I’m going to introduce you to 4 fairly quick and dirty methods of getting feedback on your interface or project.
- whiteboards
- coffee time
sketch boards
Online resources
Every office has them.
Print up or draw a wireframe on a whiteboard in a prominent area. Right next to the coffee is a good spot.Ask a simple question you want answeredSwap it out weekly. As people get used to seeing it, they will get used to sharing their thoughts..
Tip:
If I see someone standing looking at the whiteboard, walk up and ask them if they have any questions or thoughts.
A good suggestion is to setup up a bit of a routine… a new comp or mockup is posted every Wednesday.
This gives everyone plenty of time to comment, but also keeps it fresh
In an agile environment, put up the wireframes for the next sprint for feedback. You can then take the feedback and apply it to the next sprint, while getting feedback on the NEXT iteration.
Remember to keep your questions from ‘leading’ the user, and keep them simple and short.
Listen to the user, and allow them tangents.
Keep the sessions time-boxed to 5 minutes or so (allow the user to expand the time if they wish, but your session should be quick)
This is easily achieved by keeping it simple
1. Where would you click to find more information about x?
2. Why did you choose that option?
Now. I’ve done this at several local Starbucks to the point the barristas will send someone over for me when the seat across from me becomes available, and just have a ‘running tab’ that I’ve told them to cut at a certain dollar amount.
Should be informal to help participants to relax and share their feedback. (Not too casual, you still want credibility with the participant)
Make notes of what the participant says they do and don’t like including any anecdotes they may want to share
Sharpies help people from focusing on details too deeply
Post it notes for making notes during the conversation/ reviews
6-up and 1-up PDF templates that are available from the sparkhound blog
a good 45 minutes to an hour
6 up template
drawing should be time-boxed to no more than 10-15min (roughly 1-2min per)
drawing should be done with sharpies to keep the picture big
Nothing should be off limits. Draw what you want. ‘We can figure out the technology later’
Each user should discuss each of their 6 options, and why they wanted something in a particular place
1 up template
drawing should be time-boxed to 5 minutes or so.
Participants should take the ideas from either their own 6 up, or another participants and ‘finalize’ their sketch
Discussion with group about the decisions they made
Moderator takes notes on the post-it-notes during this time making note of any ideas, or suggestions that resonate with the group.
Match the results of the sketch board session(s) with the business goals, and see how the two can be paired to give the users what they are wanting, while still meeting the business goals.
This is a great tool to start generating buzz and getting the users to ‘buy-in’
usabilityhub.com
Free to participate, and each test you participate in gains you credits to then spend on your own tests.
Recommended tests include Trust, Branding, Shopping Cart, Benefits, Prominence, Language, Audience, Newsletter, and Sign up
The tablet version is a good way to rack up credits quickly by spending a short bit of time just taking tests while waiting at the doctors or other appointments.
usability.gov
Great resource for standardized documents including UX study overview, Test Plan, Screener questionnaire , Survey formats and on and on.