Presentation at Euro 2012, Rome, by Jim Kalbach and Carola Weller Topics such as “Agile Design“ and “Lean UX“ are all the rage these days. With these approaches, designers seek to prototype, test and revise their designs quickly and with little documentation. Rapid Iterative Testing and Evaluation, or RITE for short, is a specific method that fits into this canon. The key, we believe, is design collaboration—bringing stakeholders together. This does not just mean “design-by-committee,” where designers can easily get out-voted. On the contrary: putting designers, product managers and business stakeholders in the same room with the same stimuli gives designers a stronger voice in shaping the solution. Of course, there were also challenges to our approach. For instance, not all stakeholders from the various departments saw the need to attend or didn’t know what to expect at first. (But after several rounds of RITE, they didn’t want to be left out.) In this presentation, we shared the difficulties we encountered and how to overcome them. We also talked about our modifications to the methodology, which allowed us to move faster and cover more ground quickly.

1. RITE
Testing and a
Business Driver
Jim Kalbach
Carola Weller

2. TEST: Are you enjoying Euro IA in
Rome so far?
YES NO

3. 1. Do you consider yourself to be a
good IA or UX designer?
YES NO

4. 2. Do you think the web provides a
good UX most of the time?
YES NO

5. So...why are there so many bad
experiences out there?

6. We feel boxed in...
http://www.mimenta.com/Mimenta/DigitalArts/Wallpapers.html

7. ...and we cry about it.
http://starwars.wikia.com/wiki/File:Luke_whining.jpg

8. Great
UX Design ≠
= Great UX

9. Great
( UX Design + X) = Great UX

10. 3. Do you complain about stakeholder
decisions regarding UX design?
YES NO

11. 4. Do you know the main cause of poor
stakeholder decisions regarding UX?
YES NO

12. “They don’t get
it!”
http://www.thepoke.co.uk/2011/09/19/billionaire-lost-track-of-exact-fortune-some-time-ago/

13. We’re focused on products
http://mook23.files.wordpress.com/2011/06/scientist_in_lab.jpg

14. Needed: Engagement
https://picasaweb.google.com/lh/photo/ug22ef6HQ7HxdPGGZnWWOQ

15. ( Great
UX Design + Stakeholder
engagement )= Great UX

16. 5. Do you know how to consistently
get that engagement?
YES NO

17. RITE
Rapid Iterative Testing and Evaluation

18. Quick History of User Testing
Pre 1980s No established user testing
Since 1980s Getting some feedback from users
Since 1990s Standard Usabilit yTesting
Product development Launch
Standard Usability Testing
Design Run all Analysis and
Changes
Test interviews Report

19. Standard Usability Test
Product development Launch
Concept Designs Approval
RITE
Rapid Iterative Testing Evaluation
Design Run all
Make changes Analysis and Make
Make changes
Test interviews Sessions
Test Report Test Sessions changes
Test Sessions
Observation Observation Observation
Improved
De-Briefing De-Briefing De-Briefing product
with
Day 1 Day 2 Day 3 Day 4 Day 5 stakeholder
input
Day 6

20. Standard Usability Test vs. RITE Testing:
»A typical usability test focuses on the problems
identified.
»The RITE methodology is inherently about the
problems solved.

21. UXWho’s Who
Team Strategy
USER RESEARCH
MARKETING
DESIGN
HEAD OF CX BUSINESS
LEAD
CONTENT STRATEGY
PRODUCT MANAGEMENT
+ SENIOR
MANAGEMENT

22. Debriefings
DESIGNER
STAKEHOLDER
USER RESEARCHER

23. What has gone wrong…
• No RITE Testing in the beginning
• No prioritization of errors with colour coded post-its
• We assumed stakeholders would know who to invite/approach
• Resource planning with designers and updates between sessions
• Room too small and not enough room for workshoping the solution

24. Tips for engagement
• Round-Robin to get to know everyone
• Go out for Lunch
• Active analysis with post-its
• Systematic and recurring schedule
• Simultaneous interpreter in the observation room
• Regular debriefings
• No long report two weeks later

25. ( Great
UX Design + Stakeholder
engagement )= Great UX

26. But Wait – There’s More!

27. Mutual Benefits
1. Avoid blind veteos and misunderstanding
2. Improve collaboration and efficiency
3. Hierarchy and expertise leveling
4. Influence policy and business attitude

28. ( Great
+
UX Design )=(
Stakeholder
engagement
Great UX + )
Impact on
Business

29. Once you’ve gone RITE,
it’s hard to go back!
http://www.globetrotter-select.de/images/FallschirmSkyDive.jpg

30. 6. Will you use RITE on
your next projects?
YES NO

31. 7. Do you think there are other methods
for stakeholder engagement?
YES NO

32. By pushing for a collaborative,
cross-functional process UX
designers are becoming
grassroots strategic players ...
JEFF GOTHELF
The organizational perception of
the UX designer becomes more of
a design facilitator, a UX leader
and ultimately a company leader.
“Lean UX is Nothing New,” Johnny Holland: http://johnnyholland.org/2012/09/lean-ux-is-nothing-new/”

33. DANKE SCHÖN
Jim.Kalbach@gmail.com
Weller@Sirvaluse.de