Optimizely Workshop: Mobile Walkthrough

1. Mobile Walkthrough: From 0 to Experiment Pamela Ongchin Mobile Solutions Architect An Optimizely Online Workshop

2. A few tips: This webinar will be recorded. We strongly encourage you to take notes! Feel free to ask questions at any time. There will be a live Q&A at the end of this session.

3. 1. What are the biggest challenges in mobile app development? How can I address these with experiments? 2. How do I set up an Optimizely mobile experiment? 3. How does A/B testing integrate with my development process? 4. What are best practices when designing experiments? After today’s workshop, you should be able to answer the following questions

4. But ﬁrst, tell us a little more about you!

5. What department do you work in? Marketing Engineering Product poll

6. What is the most challenging issue that you face in your mobile app? question

7. On average, apps lose 80% of their new users Source: Andrew Chen’s blog, http://andrewchen.co/

8. Some of the top apps in 2014

9. The top apps follow the same pattern Source: Andrew Chen’s blog, http://andrewchen.co/

10. It’s difﬁcult to keep users engaged 80% of new users drop off validate new features It’s difﬁcult to be agile … high technical demands slow release process one-star reviews Common pain points:

11. • Measure the effectiveness of new features. • Make data-driven decisions on what to build next based on test results. • Develop experiences that retain users and extend lifetime value. A/B testing can help you become more agile

13. The stylist and customer were 43% more likely to connect and ship a trunk of clothing, a key step in Trunk Club’s customer conversion funnel Due to higher quality of leads from the app, stylist productivity improved 90% No credit card required Credit card required

14. Okay, so A/B testing can help me be more agile. What should I test?

15. What is the one key business metric that matters most for your app? Revenue Signups Engagement poll

16. Key Metrics for Mobile Apps

17. Key Metrics for Mobile Apps Opportunities to A/B test

18. 1. Onboarding 2. Product detail screens  3. Promotions and upsell  4. Homescreen  5. Registration flow and checkout flow Top 5 areas Optimizely mobile customers are testing

19. 1. Onboarding (show value, engagement)  2. Product detail screens  3. Promotions and upsell  4. Homescreen  5. Registration flow and checkout flow Top 5 areas Optimizely mobile customers are testing

21. Secret Escapes Optimizes Acquisition • Goal: Looking to optimize LTV, sign up rates, and justify mobile ad spend • Experiment: Should the app require users to sign up in order to view travel deals?

22. Experiment Setup Version 1 Version 2 Sign up gate with mandatory sign in on ﬁrst user experience Sign up not required, added a “skip” button to close the sign up form

23. Results • Defying all expectations, a mandatory signup gate was by far the optimal experience  • Sign up rates increased 200%, LTV average increased, and LTV:CAC ratio was positive

25. Add to cart (or bag)

27. In-app message: Upsell

29. Facebook layout test

31. Checkout Flow

32. 1. Onboarding (first value, engagement)  2. Product detail screens  3. Promotions and upsell  4. Homescreen  5. Registration flow and checkout flow Top 5 areas Optimizely mobile customers are testing

34. Now, let’s create a mobile experiment.

35. Make the Variations What to test? Set Audiences Who sees the experiment? Set Traffic Allocation How many visitors are included? How are they split? 1 2 3 Set Goals Why are you testing? How will you measure success? 4 Preview & Test Does it work the way you want to? 4 5 Key Steps 5

54. Make the Variations What to test? Set Audiences Who sees the experiment? Set Traffic Allocation How many visitors are included? How are they split? 1 2 3 Set Goals Why are you testing? How will you measure success? 4 Preview & Test Does it work the way you want to? 5 5 Key Steps

69. A/B Testing Timeline

70. Brainstorm A/B Testing Timeline

71. Brainstorm Prioritize & Design A/B Testing Timeline

72. Brainstorm Prioritize & Design A/B Testing Timeline Implement

73. Brainstorm Prioritize & Design QA & Approve A/B Testing Timeline Implement

74. Brainstorm Prioritize & Design QA & Approve Run A/B Testing Timeline Implement

75. Brainstorm Prioritize & Design QA & Approve Run Analyze & Review A/B Testing Timeline Implement

76. A/B Testing Timeline

78. • Know what tests you want to run at the beginning of your sprint.  • Have a developer involved in the process.  • Use phased rollouts for new features.  • Use live variables and code blocks.  • Integrate Optimizely with your analytics platforms. Best Practices

79. Pop Quiz!

80. If the Optimizely SDK is installed, you can make visual changes to your app in between releases without additional code. True False poll

81. If the Optimizely SDK is installed, you can make visual changes to your app in between releases without additional code. True poll

82. If I want to test an entirely new feature in my app, I need to get my developer involved. True False poll

83. If I want to test an entirely new feature in my app, I need to get my developer involved. True poll

84. Use A/B to validate new features. A/B testing is a huge opportunity to improve metrics in your app. Once your SDK is installed (by your developer), you’ll be able to make visual changes without additional code. Testing new features requires developer involvement. Final Takeaways

85. Q&A Have a question? Type it into the chat box!

Optimizely Workshop: Mobile Walkthrough

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (7)

Semelhante a Optimizely Workshop: Mobile Walkthrough

Semelhante a Optimizely Workshop: Mobile Walkthrough (20)

Mais de Optimizely

Mais de Optimizely (20)

Optimizely Workshop: Mobile Walkthrough