The Best A/B Test Idea You Haven’t Thought Of
The problem Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much The real problem One month Winner! Two months Three months Four months Five months Six months Seven months Eight months Nine months 1 winner per year QUOTE FROM ELON MUSK BIOGRAPHY “ He would place this urgency that he expected the revenue in ten years to be ten million dollars a day and that every day we were slower to achieve our goals was a day of missing out on that money. We’re missing out on this But…why? TOO MANY IDEAS! 170 ideas in 3 minutes Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price Er. We need a process Find out what’s stopping folks from converting… …fix it. Thanks I’ll be here all night Step 1: Take these ideas… Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price …and throw them away. Step 2: Listen to your customers and prospects Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price These ideas are good. They just might not be for you. Gut Your gut is good. It just knows too much. Curse of knowledge USER TESTING Send 3 users through your funnel Send 3 users to your competition Send 3 users to a HUGE company in your space PEEK QUALAROO CHAT TRANSCRIPTS SALES PEOPLE AND SUPPORT Step 3: Use a framework to make decisions Test summary Test objective Hypothesis Opportunity size Time to test Likely scenarios Next steps What worked? What didn’t work? HTTP://BIT.LY/ABTEST-FRAMEWORK The problem Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much The problem opportunity Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much Winner! Not so much Not so much Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Winner! Not so much Not so much Winner! Not so much Not so much Winner!
Recomendados
Recomendados
Mais conteúdo relacionado
Mais procurados
Mais procurados (20)
Destaque
Destaque (20)
Semelhante a The Best A/B Test Idea You Haven’t Thought Of
Semelhante a The Best A/B Test Idea You Haven’t Thought Of (20)
Mais de Kissmetrics on SlideShare
Mais de Kissmetrics on SlideShare (20)
Último
Último (20)
The Best A/B Test Idea You Haven’t Thought Of
- 1. The best A/B test idea you haven’t thought of PHIL SHARP
- 3. Thue is the Kissmetrics Webinar Wizard and Marketing Ops Manager. Before joining forces with Kissmetrics, he was a Lyft driver in SF, which is also how he ended up as a KISSmetrics marketer. Whenever Thue is not trying to automate everything around him, you can find him hiking in the Sierras. THUE MADSEN Marketing Operations Manager, Kissmetrics @ThueLMadsen Phil leads the UserTesting marketing team in helping companies discover the importance of user experience and usability testing. PHIL SHARP VP of Marketing, UserTesting @iamphilsharp
- 5. WATCH WEBINAR RECORDING NOW
- 6. The problem
- 7. Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
- 10. 1 winner per year
- 12. QUOTE FROM ELON MUSK BIOGRAPHY “ He would place this urgency that he expected the revenue in ten years to be ten million dollars a day and that every day we were slower to achieve our goals was a day of missing out on that money.
- 13. $10,000,000 days
- 14. We’re missing out on this
- 15. But…why?
- 16. We’re smart
- 17. And hard working
- 18. And nice :)
- 19. And know our products
- 20. Why?
- 21. TOO MANY IDEAS!
- 27. 170 ideas in 3 minutes
- 28. Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price
- 29. Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price
- 30. Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price
- 31. Er.
- 32. We need a process
- 33. Process = Sleepy time
- 34. Process = More revenue
- 36. The core of our process…
- 37. Find out what’s stopping folks from converting…
- 38. …fix it.
- 39. Thanks
- 40. I’ll be here all night
- 41. Three Steps
- 42. Step 1: Take these ideas…
- 43. Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price
- 44. …and throw them away.
- 45. Step 2: Listen to your customers and prospects
- 46. Find out what’s stopping folks from converting…
- 47. …fix it.
- 48. Step 2: Listen to your customers and prospects
- 49. Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price These ideas are good. They just might not be for you.
- 50. Gut Your gut is good. It just knows too much.
- 52. How to listen
- 53. QUALAROO
- 54. QUALAROO - USERTESTING EXAMPLE
- 55. QUALAROO Is anything preventing you from signing up?
- 56. QUALAROO “Trying to work out a password that meets your criteria — it’s taking me a while.”
- 57. QUALAROO “A 10 character minimum for a password! Seriously? That’s insane.”
- 58. QUALAROO “10 characters for the password? That’s way too many. This isn’t a bank site or something…”
- 59. CHAT TRANSCRIPTS
- 60. SALES PEOPLE AND SUPPORT
- 61. USER TESTING
- 62. Send 3 users through your funnel
- 63. USER TESTING
- 64. USER TESTING
- 65. Send 3 users to your competition
- 66. Send 3 users to a HUGE company in your space
- 67. PEEK
- 68. Step 3: Use a framework to make decisions
- 69. Test summary Test objective Hypothesis Opportunity size Time to test Likely scenarios Next steps What worked? What didn’t work? HTTP://BIT.LY/ABTEST-FRAMEWORK
- 70. Test Objective In 1-2 sentences, why are we running this test?
- 71. Hypothesis If X, then Y because Z
- 72. Opportunity Size If this test works, what’s the total impact we could expect to see over a year?
- 73. Time to Test How long will it take to run this test?
- 74. Likely Scenarios Write out your assumptions and 3 of the most likely scenarios.
- 75. Next Steps Now that you know the results, what will you do? If the campaign worked, how can you expand it? What can you test that is similar?
- 76. What worked? What didn’t? What did you learn?
- 77. The problem
- 78. Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
- 80. Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
- 81. Not so much Winner! Not so much Not so much Not so much Winner! Not so much Not so much Not so much Not so much
- 82. Not so much Not so much Not so much Winner! Not so much Not so much Winner! Not so much Not so much Winner!
- 86. LOG IN WITH GOOGLE Start Your Free KISSmetrics Trial
- 87. PHIL SHARP VP of Marketing, UserTesting @iamphilsharp phil@usertesting.com THUE MADSEN Marketing Operations Manager, Kissmetrics @ThueLMadsen tmadsen@kissmetrics.com Questions?