Validating Ideas Fast With Remote User Research | Digital Gaggle Conference October 2016
•
1 gostou•764 visualizações
These slides are from Adam Babajee-Pycroft's talk at the October 2016 Digital Gaggle Conference in Bristol. Adam is Managing Director and Head of UX at Natural Interaction in Bristol. Talk summary: Involving users in the design process is critical to digital success but how many times have you been told things like: we don’t have time, we can’t afford it, we’ll do it after the site is built. You needed to get the feature live yesterday, but there’s no reason that user research should suffer. The solution? Remote user research. In this talk Adam will share what he’s learnt having executed hundreds of hours of remote research on a variety of projects including: common mistakes and issues, how to find the right participants and the advantages of disadvantages of certain tools.
Recomendados
Recomendados
Mais conteúdo relacionado
Destaque
Semelhante a Validating Ideas Fast With Remote User Research | Digital Gaggle Conference October 2016
Semelhante a Validating Ideas Fast With Remote User Research | Digital Gaggle Conference October 2016 (20)
Mais de Noisy Little Monkey
Mais de Noisy Little Monkey (20)
Último
Último (20)
Validating Ideas Fast With Remote User Research | Digital Gaggle Conference October 2016
- 1. Validating Ideas Fast with Remote User Research
- 2. I’m Adam Babajee-Pycroft Managing Director at Natural Interaction @adam_ux on Twitter 2 : Hello Hello @adam_ux #DigitalGaggle
- 3. 3 : Who are you? Who are you? @adam_ux #DigitalGaggle
- 4. Introduction
- 5. Remote user research can include anything from self-moderated or remotely moderated usability testing, to idea validation, to card sorts, to depth interviews to tree-tests. 5 : Overview > Definition Definition @adam_ux #DigitalGaggle
- 6. Simply put, it means conducting the same research we always have, but doing it remotely. 6 : Overview > Definition Definition @adam_ux #DigitalGaggle
- 7. 7 : Overview > I used to be a skeptic I used to be a skeptic @adam_ux #DigitalGaggle
- 8. Speed ● Quicker to arrange ● Multiple tests can happen simultaneously ● You don’t have to sit there during the tests 8 : Overview > Advantages Advantages @adam_ux #DigitalGaggle
- 9. Cost ● Self-moderated sessions don’t consume your time ● Participants are cheaper to recruit as they don’t have to travel 9 : Overview > Advantages Advantages @adam_ux #DigitalGaggle
- 10. Participant location ● Removes the temptation to intervene ● You can recruit participants from anywhere 10 : Overview > Advantages Advantages @adam_ux #DigitalGaggle
- 11. See users in their natural habitat 11 : Overview > Advantages Advantages @adam_ux #DigitalGaggle
- 12. Harder to build relationships ● This specifically applies to self moderated Not impossible: ● Remotely moderated or Skype calls, Hangouts etc could help bridge the gap 12 : Overview > Disadvantages Disadvantages @adam_ux #DigitalGaggle
- 13. You can’t see their wider context 13 : Overview > Disadvantages Disadvantages @adam_ux #DigitalGaggle
- 14. Connection speeds vary 14 : Overview > Disadvantages Disadvantages @adam_ux #DigitalGaggle
- 15. Choosing tools
- 16. 16 : Choosing Tools : Surveys Surveys @adam_ux #DigitalGaggle
- 17. 17 : Choosing Tools : Interviews Interview Tools @adam_ux #DigitalGaggle
- 18. 18 : Choosing Tools : Quantitative Research Quantitative Tools @adam_ux #DigitalGaggle ● Card Sorting ● Tree Testing ● Click Testing ● Card Sorting ● Tree Testing ● More... ● Click tests ● Annotation ● Memory ● Mood
- 19. 19 : Choosing Tools : Qualitative Tools @adam_ux #DigitalGaggle Qualitative Tools Plenty of choice… (Giant table imminent)
- 20. 20 : Choosing Tools : Qualitative Tools @adam_ux #DigitalGaggle Speed Recruitment Options What do users install? 2 hours (simple screener) Panel (Few frequency limits) Self Moderated macOS / Windows App Native iOS / Android App 2 days desktop 5 days mobile (simple screener) Panel (1 test / user / month) Bring your own Self Moderated macOS / Windows App Native iOS / Android App 1-2 hours (simple screener) 5 days (complex screener) Social Media Bespoke Bring your own Self Moderated Remotely Moderated Chrome Plugin Native iOS / Android App UserZoom Same day (simple screener) Multiple panels (No limits) Bring your own Self Moderated macOS / Windows App Native iOS / Android App Loop11 1-2 hours (simple screener) Multiple panels (No limits) Bring your own Self Moderated Quantitative macOS / Windows App Native iOS / Android App
- 21. 21 : Choosing Tools : Qualitative Tools @adam_ux #DigitalGaggle Speed Recruitment Options What do users install? 2 hours (simple screener) Panel (Few frequency limits) Self Moderated macOS / Windows App Native iOS / Android App 2 days desktop 5 days mobile (simple screener) Panel (1 test / user / month) Bring your own Self Moderated macOS / Windows App Native iOS / Android App 1-2 hours (simple screener) 5 days (complex screener) Social Media Bespoke Bring your own Self Moderated Remotely Moderated Chrome Plugin Native iOS / Android App UserZoom Same day (simple screener) Multiple panels (No limits) Bring your own Self Moderated macOS / Windows App Native iOS / Android App Loop11 1-2 hours (simple screener) Multiple panels (No limits) Bring your own Self Moderated Quantitative macOS / Windows App Native iOS / Android App
- 22. 22 : Choosing Tools : Qualitative Tools @adam_ux #DigitalGaggle Speed Recruitment Options What do users install? 2 hours (simple screener) Panel (Few frequency limits) Self Moderated macOS / Windows App Native iOS / Android App 2 days desktop 5 days mobile (simple screener) Panel (1 test / user / month) Bring your own Self Moderated macOS / Windows App Native iOS / Android App 1-2 hours (simple screener) 5 days (complex screener) Social Media Bespoke Bring your own Self Moderated Remotely Moderated Chrome Plugin Native iOS / Android App UserZoom Same day (simple screener) Multiple panels (No limits) Bring your own Self Moderated macOS / Windows App Native iOS / Android App Loop11 1-2 hours (simple screener) Multiple panels (No limits) Bring your own Self Moderated Quantitative macOS / Windows App Native iOS / Android App
- 23. 23 : Choosing Tools : Qualitative Tools @adam_ux #DigitalGaggle Speed Recruitment Options What do users install? 2 hours (simple screener) Panel (Few frequency limits) Self Moderated macOS / Windows App Native iOS / Android App 2 days desktop 5 days mobile (simple screener) Panel (1 test / user / month) Bring your own Self Moderated macOS / Windows App Native iOS / Android App 1-2 hours (simple screener) 5 days (complex screener) Social Media Bespoke Bring your own Self Moderated Remotely Moderated Chrome Plugin Native iOS / Android App UserZoom Same day (simple screener) Multiple panels (No limits) Bring your own Self Moderated macOS / Windows App Native iOS / Android App Loop11 1-2 hours (simple screener) Multiple panels (No limits) Bring your own Self Moderated Quantitative macOS / Windows App Native iOS / Android App
- 24. 24 : Choosing Tools : Qualitative Tools @adam_ux #DigitalGaggle Speed Recruitment Options What do users install? 2 hours (simple screener) Panel (Few frequency limits) Self Moderated macOS / Windows App Native iOS / Android App 2 days desktop 5 days mobile (simple screener) Panel (1 test / user / month) Bring your own Self Moderated macOS / Windows App Native iOS / Android App 1-2 hours (simple screener) 5 days (complex screener) Social Media Bespoke Bring your own Self Moderated Remotely Moderated Chrome Plugin Native iOS / Android App UserZoom Same day (simple screener) Multiple panels (No limits) Bring your own Self Moderated macOS / Windows App Native iOS / Android App Loop11 1-2 hours (simple screener) Multiple panels (No limits) Bring your own Self Moderated Quantitative macOS / Windows App Native iOS / Android App
- 25. How to do it
- 26. First decide what you’re testing 26 : How to do it > Writing Tasks Writing tasks @adam_ux #DigitalGaggle
- 27. Be succinct 27 : How to do it > Writing Tasks Writing tasks @adam_ux #DigitalGaggle
- 28. Avoid ambiguity, you won’t be there to explain it 28 : How to do it > Writing Tasks Writing tasks @adam_ux #DigitalGaggle
- 29. Don’t use leading questions 29 : How to do it > Writing Tasks Writing tasks @adam_ux #DigitalGaggle
- 30. Establish a rhythm 30 : How to do it > Writing Tasks Writing tasks @adam_ux #DigitalGaggle
- 31. Poor screeners 31 : How to do it > Common mistakes Common mistakes @adam_ux #DigitalGaggle
- 32. Participants too familiar with the process 32 : How to do it > Common mistakes Common mistakes @adam_ux #DigitalGaggle
- 33. Not testing the test yourself 33 : How to do it > Common mistakes Common mistakes @adam_ux #DigitalGaggle
- 34. Screeners: Missing the “Country” filter 34 : How to do it > Common mistakes Common mistakes @adam_ux #DigitalGaggle
- 35. ● Use free trials ● Demonstrate the benefit ● Seek forgiveness not permission 35 : Conclusion > Getting permission Getting permission @adam_ux #DigitalGaggle
- 36. Too much to fit into this session ● Hold yourself to the same standards of proof ● Show your working out (including video evidence) ● Remember your research objectives 36 : Conclusion > Analysis Conducting analysis @adam_ux #DigitalGaggle
- 37. 1. Try it at least once, overcome preconceptions 1. Use the same budgets to do more rounds of research, don’t use this as an excuse to spend less 1. Ensure instructions are easily understood 1. Use the right tool for the job 1. Be rigorous in your analysis 37 : Conclusion > Takeaways Takeaways @adam_ux #DigitalGaggle
- 38. Any questions?
- 39. Adam Babajee-Pycroft adam@naturalinteraction.co.uk @adam_ux Please rate this workshop: bit.ly/abp-remote Thank you for your time
Notas do Editor
- I’m not going to go into the commercials as they tend to vary depending on your ability to negotiate. Validately primarily works on a subscription basis, WUD needs you to purchase credits per test and a minimum amount to do the “Bring Your Own”, UT make you buy a certain number of credits per year, UserZoom are more “enterprisey” in their pricing and I can never get a price out of them but a financial services client used to use them and in my opinion they were eye wateringly expensive. Loop11 are quite new but charge on business size or per project which means they’re either really good or really bad value depending on your perspective.
- I’m not going to go into the commercials as they tend to vary depending on your ability to negotiate. Validately primarily works on a subscription basis, WUD needs you to purchase credits per test and a minimum amount to do the “Bring Your Own”, UT make you buy a certain number of credits per year, UserZoom are more “enterprisey” in their pricing and I can never get a price out of them but a financial services client used to use them and in my opinion they were eye wateringly expensive. Loop11 are quite new but charge on business size or per project which means they’re either really good or really bad value depending on your perspective.
- I’m not going to go into the commercials as they tend to vary depending on your ability to negotiate. Validately primarily works on a subscription basis, WUD needs you to purchase credits per test and a minimum amount to do the “Bring Your Own”, UT make you buy a certain number of credits per year, UserZoom are more “enterprisey” in their pricing and I can never get a price out of them but a financial services client used to use them and in my opinion they were eye wateringly expensive. Loop11 are quite new but charge on business size or per project which means they’re either really good or really bad value depending on your perspective.
- I’m not going to go into the commercials as they tend to vary depending on your ability to negotiate. Validately primarily works on a subscription basis, WUD needs you to purchase credits per test and a minimum amount to do the “Bring Your Own”, UT make you buy a certain number of credits per year, UserZoom are more “enterprisey” in their pricing and I can never get a price out of them but a financial services client used to use them and in my opinion they were eye wateringly expensive. Loop11 are quite new but charge on business size or per project which means they’re either really good or really bad value depending on your perspective.
- I’m not going to go into the commercials as they tend to vary depending on your ability to negotiate. Validately primarily works on a subscription basis, WUD needs you to purchase credits per test and a minimum amount to do the “Bring Your Own”, UT make you buy a certain number of credits per year, UserZoom are more “enterprisey” in their pricing and I can never get a price out of them but a financial services client used to use them and in my opinion they were eye wateringly expensive. Loop11 are quite new but charge on business size or per project which means they’re either really good or really bad value depending on your perspective.
- I’m not going to go into the commercials as they tend to vary depending on your ability to negotiate. Validately primarily works on a subscription basis, WUD needs you to purchase credits per test and a minimum amount to do the “Bring Your Own”, UT make you buy a certain number of credits per year, UserZoom are more “enterprisey” in their pricing and I can never get a price out of them but a financial services client used to use them and in my opinion they were eye wateringly expensive. Loop11 are quite new but charge on business size or per project which means they’re either really good or really bad value depending on your perspective.
- Jared Spool: Years ago, we helped with a study of Ikea.com, looking at how people found products on the site. When we got there, they’d already started the testing process and were using tasks like “Find a bookcase.” Interestingly, every participant did exactly the same thing: they went to the search box and typed “bookcase”. Upon our suggestion, the team made a subtle change to the instructions they were giving their participants: “You have 200+ books in your fiction collection, currently in boxes strewn around your living room. Find a way to organize them.” We instantly saw a change in how the participants behaved with the design. Most clicked through the various categories, looking for some sort of storage solution. Few used Search, typing in phrases like “Shelves” and “Storage Systems”. And, nobody searched on “bookcase”.
- Wrong demographic, lies, too expert
- Wrong demographic, lies, too expert