1. Remote Testing
Adam Fendrych

2. snímek |datum |dokument | 2
Communication

3. snímek |datum |dokument |
Your visitors
3

4. snímek |datum |dokument |
Testing with Users
4

5. snímek |datum |dokument |
Why not?
5

6. snímek |datum |dokument |
Obstacles
• No need
• No time
• No money
• No know-how
6

7. snímek |datum |dokument |
No Need?
• User behavior assumptions
are 75% wrong
7

8. snímek |datum |dokument |
There Is No Such Thing as
Universal Design
8

9. snímek |datum |dokument | 99

10. snímek |datum |dokument |
No Need?
• Test early, fail early!
• Designing without testing is like driving
blindfolded
• If you say your design is perfect you are
not a good designer
10

11. snímek |datum |dokument |
No Time?
• Website analysis: 8 hours
• Recruiting 10 users: 8 hours
• Test scenarios: 6 hours
• Sessions: 20 hours
• Analysis: 16 hours
• Presentation: 4 hours
• Total: 62 hours
11

12. snímek |datum |dokument |
No Time?
• Grab 3 users: 1 hours
• Think of basic tasks: 1 hour
• 1/2hour sessions: 1,5 hours
• Analysis: 1,5 hours
• Total: 5 hours
12

13. snímek |datum |dokument |
No Money?
13
• Lab
• Eye Tracker
• Recruitment

14. snímek |datum |dokument |
No Money?
• 5 hours of your time
• Incentives: 240 zloty
14

15. snímek |datum |dokument |
And How About
• Recruit online
• Test anytime
• Test anywhere
• And even for free!
15
This is remote testing

16. snímek |datum |dokument |
And Where Is the Know-How?
16

17. snímek |datum |dokument |
The Basics
1. Have something to test
2. Get a few users
3. Watch them perform tasks
4. Analyze
5. Fix the most serious problems
6. Test again
17

18. snímek |datum |dokument |
Remote testing
• Moderated
• Unmoderated
18

19. snímek |datum |dokument |
Moderated
• Communicate with users in real time
• Qualitative data
• Ask questions
19

20. snímek |datum |dokument |
Moderated
20
• No eye contact
• Technical limitations
• No statistics

21. snímek |datum |dokument |
Technical Stuff
• Use conferencing software
» WebEx, Gotomeeting
• Tranfer voice and screen
» Skype, Mikogo
21

22. snímek |datum |dokument | 22

23. snímek |datum |dokument | 23

24. snímek |datum |dokument |
Some Tips
• Skype is fat
• Connection can be slow
• Record on your computer
» Morae, HypeCam
24

25. snímek |datum |dokument |
Unmoderated
25

26. snímek |datum |dokument |
How Does It Work
• Test a website or mockups
• Users provided, or get your own users
• Pay a monthly fee, or per user
• You get videos, or stats
• Plus some feedback
26

27. snímek |datum |dokument |
Usertesting.com
• You submit the website and your questions
• They provide users
• You get videos
27

28. snímek |datum |dokument |
OpenHallway.com
• Create the test
• Get the link to users – e-mail, Ethnio
• You get videos and feedback
28

29. snímek |datum |dokument |
Loop11.com
• Submit your website or mockups
• Create the test
• You get stats – success rates, navigation
path, click spots
• Speaks international
29

30. snímek |datum |dokument |
Navflow.com
• Test images only
• Free responses from community or link for
your users
• You see where they click
30

31. snímek |datum |dokument | 31

32. snímek |datum |dokument |
Remote testing
• Quick
• Less results
• Perfect for solving specific problems
• Lots of tools – why not build your own?
32

33. snímek |datum |dokument |
Questions?
adam.fendrych@dobryweb.cz
@adlo @fendrych
www.dobryweb.cz
33