You'll learn: - How to solve product problems and uncover UX opportunities - How to plan and track your experiments - How to supplement qualitative product feedback with quantitative data

1. LEAN
EXPERIMENTS
@alissadesigns
FOR
AGILE TEAMS

2. @alissadesigns
HEAD OF DESIGN
PLANGRID
ALISSA BRIGGS

3. @alissadesigns

4. @alissadesigns

5. @alissadesigns

6. @alissadesigns

7. @alissadesigns

8. @alissadesigns

9. WHY
EXPERIMENT?
@alissadesigns

10. @alissadesigns

11. @alissadesigns

12. @alissadesigns

13. @alissadesigns

14. @alissadesigns
1. RUN GOOD
EXPERIMENTS
2. TURN DATA
INTO DECISIONS
3. EXPERIMENT
EVERYWHERE
HOW TO

15. RUN GOOD
EXPERIMENTS
1
@alissadesigns

16. @alissadesigns
START WITH A
CHALLENGE

18. EXPERIMENT
GRID
@alissadesigns

19. @alissadesigns

20. 1. IDEA
Hire someone
who’s job is to
keep the coffee
pot full
Put a note
on the coffee
pot
Webcam
monitors for
coffee offenders
@alissadesigns
Smart coffee pot
that tweets when
empty

21. 2. ASSUMPTIONS
What assumptions have we made
about customers & their world?
@alissadesigns

22. 2. ASSUMPTIONS
@alissadesigns
People will refill the coffee pot
after seeing the note.

23. 3. HYPOTHESES
If we do _________,
then __% of people
will _____________
@alissadesigns

24. 3. HYPOTHESES
If I put a note on the coffee pot,
then 75% of people
will refill the coffee pot when it’s empty.
@alissadesigns

25. 4. EXPERIMENT
Cheapest + fastest way to
validate our hypothesis
@alissadesigns

26. CONCIERGE
WIZARD OF OZ
IMPOSTER JUDO
DRY WALLET
VIDEO TRAILER
A/B TEST
More at alissabriggs.com/experiment-grid
CHANNEL TEST
BLOG POST
HIGH HURDLE
@alissadesigns

27. 4. EXPERIMENT
Put a note on the coffee pot.
DESCRIPTION
% of people who refill the coffee pot
after finishing it
METRICS
@alissadesigns

28. @alissadesigns
passiveaggressivenotes.com

29. Put note on coffee pot
People will refill the coffee
pot after seeing the note.
If I put a note on the coffee pot,
then 75% of people
will refill the coffee pot when it’s empty.
Put a note on the
coffee pot.
% who refill coffee pot

30. TURN DATA
INTO
DECISIONS
2
@alissadesigns

31. LET’S MEASURE
@alissadesigns

32. @alissadesigns
passiveaggressivenotes.com

33. @alissadesigns
%whorefilledcoffee
0
25
50
75
100
Day 1 Day 2 Day 3 Day 4 Day 5
COFFEE EXPERIMENT DATA

34. Put note on coffee pot
People will refill the coffee
pot after seeing the note.
If I put a note on the coffee pot,
then 75% of people
will refill the coffee pot when it’s empty.
Put a note on the
coffee pot.
% who refill coffee pot
% who refilled
dropped below
75% after day 2

35. BE HONEST
@alissadesigns

36. ASK “WHY?”
BE HONEST
@alissadesigns

37. MAKE A DECISION
ASK “WHY?”
BE HONEST
@alissadesigns

38. Put note on coffee pot
People will refill the coffee
pot after seeing the note.
If I put a note on the coffee pot,
then 75% of people
will refill the coffee pot when it’s empty.
Put a note on the
coffee pot.
% who refill coffee pot
% who refilled
dropped below
75% after day 2
interview users
& iterate

39. Put non-snarky note on coffee pot
People will refill the coffee
pot if there’s a non-snarky
note.
If I put a non-snarky note on the coffee
pot, then 75% of people
will refill the coffee pot when it’s empty.
Put a non-snarky
note on the coffee pot.
% who refill coffee pot

40. @alissadesigns

41. AGILE
@alissadesigns
EXPERIMENTS
+

42. From: http://www.itinfo.am/eng/agile-project-management/

43. Align on goal
Experiment
#1
Experiment
#2
Experiment
#3
Experiment
#4
Experiment
#n
Lean Experiment
From: http://www.itinfo.am/eng/agile-project-management/

44. @alissadesigns
GOAL: INCREASE FIRST SESSION DURATION
SPRINT 1 SPRINT 2 SPRINT 3
+ Measure sample project + Measure video demo
Sample Project Video Demo Setup Wizard

45. @alissadesigns
EXPERIMENTS
BETTER DECISIONS
=

46. EXPERIMENT
EVERYWHERE
3
@alissadesigns

47. @alissadesigns
START WITH A
CHALLENGE

48. @alissadesigns
HOW MIGHT WE GET
DESIGN INVOLVED
EARLIER?

49. @alissadesigns

50. @alissadesigns

51. @alissadesigns
EXPERIMENT
EVERYWHERE

52. 1. RUN GOOD
EXPERIMENTS
2. TURN DATA
INTO DECISIONS
3. EXPERIMENT
EVERYWHERE
EXPERIMENT YOUR
WAY TO SUCCESS
@alissadesigns

53. EXPERIMENT
WITH
EXPERIMENTS
@alissadesigns

54. @alissadesigns
alissabriggs.com/experiment-grid
EXPERIMENT GRID
plangrid.com/jobs
EXPERIMENT WITH US

55. @alissadesigns