This document provides guidance on conducting DIY usability studies for Asha apps. It discusses fundamentals of usability testing, how to optimize tests, preparation steps, running a test session, analyzing outcomes, and available UX resources. Key recommendations include testing early and often with 2-3 participants, focusing on the biggest usability issues, and remembering that usability is about improvement rather than proof. The document aims to make usability testing accessible for independent developers.

1. DIY Asha app usability studies
Jan Krebber @krebbixux
Senior User Experience Consultant

2. 2 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
• Fundamentals
• Usability optimised
• Test preparation
• Test session
• Test outcome
• UX offering
• Take home messages
Overview

3. 3 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
Fundamentals

4. Usability is an analysis of how to reach a goal.
4 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

5. Even your mom will give you more insights
than nobody.
5 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

6. Failing users are the most convincing
argument.
6 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

7. Everything else is simple – it is!
7 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

8. 8 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
Usability optimised

9. You want to improve – not prove.
9 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

10. It does not matter if you run the test in café
or in your premises.
10 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

11. Test early.
Test often.
Fail fast.
Fail cheap.
11 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

12. 2-3 participants are enough if you test
frequently.
12 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

13. 13 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
Test preparation

14. Get yourself a checklist for the entire test
and a timetable for the sessions.
14 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

15. Put participant's story and tasks on index
card and print all your tasks on paper.
15 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

16. Invite from the target audience if you can –
but do not get stuck with it.
16 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

17. Do not use previous participants in the same
project again.
17 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

18. Balsamiq™ Illustrator™
Prepare the prototype.
18 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

19. Run a pilot study.
19 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

20. 20 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
Test session

21. Test for 1 hour.
21 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
• 10 min: Welcome, introduction, sign agreement and warm-up
• 30 min: Tasks
• 10 min: Open issues, wrapping up and good-bye
• 10 min: Take additional notes and prepare the next session

22. Present each story and task on an index
card; one after another.
22 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

23. The participant talks – not you.
23 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

24. Ask for open issues after the tasks are done.
24 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

25. Reward your participants.
25 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

26. 26 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
Test outcome

27. Debrief with the team.
27 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

28. The biggest issue is the most urgent.
28 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

29. Take only as much as you can really work
on.
29 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

30. Concept – redesign.
Implemented app – try to tweak only.
30 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

31. 31 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

32. Test your tweak – a very simple test might
do the trick here.
32 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

33. 33 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
UX offering

34. You can find more UX considerations for
NokiaAsha and Nokia X from the UX library.
34 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

35. 35 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

36. Take home messages

37. Even your mom will give you more insights
than nobody.
37 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

38. 2-3 participants are enough if you test
frequently.
38 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

39. The biggest issue is the most urgent.
39 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux

40. Literature and links.
40 © Nokia 2014 DIY_Asha_app_usability_studies.pptx 2014-29-04 Jan Krebber @krebbixux
• Nokia Asha UI guidelines,
http://developer.nokia.com/resources/library/Asha_UI/index.html
• DVLUP, http://www.dvlup.com
• Rocket Surgery Made Easy: The Do-it-yourself Guide to Finding and
Fixing Usability Problems. Steve Krug (2009)
• Paper Prototyping: The Fast and Easy Way to Design and Refine
User Interfaces. Carolyn Snyder (2003).
• Handbook of Usability Testing: How to Plan, Design, and Conduct
Effective Tests. Jeffrey Rubin and Dana Chisnell (2008)
• Jacob Nielsen’s blog: http://www.useit.com

41. Thanks to:
- Maaike Beenen,
- Anne Kivimaa,
- Sanna Hiukka,
- Petri Kiukkonen.

42. Thanks. 
Jan Krebber
ext-jan.krebber@microsoft.com
@krebbixux