SlideShare uma empresa Scribd logo
1 de 26
Case Study:
avast! – Million $ Button
Optimization Michal Parizek
avast!
Senior E-Commerce Specialist
#TLE2014The Live Event@parezem
London
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
1988
Founded
in Czech Republic
Switched to
Freemium
2001 2014
Users: 219,000,000
Valued: $1,000,000,000
in 1988 AVAST was founded in Czech Republic by two researches Eduard Kucera and Pavel Baudis. It had good early 90s, but then the
competition got fiercer. A major decision to switch to a freemium model saved the business. Since 2001 the business has been
growing and nowadays AVAST protects more than 219M users and it is valued as a $1B company.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Paid
version
Trial
version
Website
Other
Free
version
Breakdown
of sales
We can see two main streams of revenue for AVAST: sales which come from the Free version (customers who decide to switch to a
premium protection) and sales which come from the Paid version (subscription renewals and further monetization). My focus is on
the retention business (=Paid version).
Breakdown
of retention
sales
RENEW NOW
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
If we look at the retention sales in more detail we could see the key sales elements. The most of the sales is done by an expiration
messaging (small and big pop-ups & expiration email). The other element is the “Renew now” button which makes around 25% of all
consumer retention sales. This button is a center point of this case study.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
RENEW NOW
The “Renew now” button sits in the program GUI. It appears once a customer is in an expiration period (starting 30 days before an
expiration date) and stays there until a customer renews her protection.
Champion
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Challenger
RENEW NOW RENEW NOW
In the autumn of 2013 we tried a different approach in the “Renew now” button sales flow. Champion (default) version meant the
button opened a standard expiration big pop-up which a customer knew very well. The challenger version meant a new landing page
which contained a clear comparison table of all three consumer products.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
RENEW NOW RENEW NOW
Sales per View:
+ 13.4%
Champion Challenger
The challenger worked much better. We could see that customers who clicked on the “Renew now” button preferred to do a more
informed decision – to see where their current solution stands and to see all the features of all options available. The champion
version contained only different length of subscription period.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
There is the comparison landing page in more detail. A customer can see all the features and the prices of all options. This entire new
landing page which was responsible for around 25% of sales was a starting point of a 4-month long optimization project which in fact
still continues (in the time presenting the case study).
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
William Poundstone
Priceless: The Myth of Fair Value
http://bit.ly/price-less-book
I’d like to start the optimization part with an experiment William Poundstone describes in his book Priceless. They’ve approached
students with two beers: $1.80 & $2.50. 80% of students picked the more expensive beer. Later they’ve approached students again
and this time the menu contained also $1.60 beer. Facing those 3 options 80% of students picked the $1.80 beer..
Champion
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Challenger
2% 77% 21%
Once we read the experiment we just had to try it! Our new landing page looked like the second round of that experiment. Almost
80% chose the middle option – Internet Security. We hoped that by removing the cheapest options the majority could also pick the
most expensive option – Premier.
Champion
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Challenger
2% 77% 21% 75% 25%
Sales per View:
- 1.2%
Well, it did not happen.. We could see a slight increase of Premier’s share, but there was a decrease of a conversion rate. We believe
there were three main reasons why it failed: 1) The prices are higher than in the beer experiment, more than 10x. 2) Don’t forget, it
is retention business, customers had at least a 1-year experience with the middle product. 3) Decoy effect of the cheapest option.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
William Poundstone
Priceless: The Myth of Fair Value
http://bit.ly/price-less-book
Anyway, the Poundstone’s experiment continued. They’ve approached the students for the third time – to the main two beers
they’ve added a super premium beer – a $3.40 one. 10% of students picked it and the share of $2.50 beer also increased.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
2% 77% 21%
Champion Challenger
We had to try this one as well. However we had a crucial issue – we did not have a super premium product.. So we made it up. We
bundled our premium product (Premier) with one of our attached products SecureLine VPN. And we called an Ultimate Security Pack!
(I know sounds cheesy)
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
2% 77% 21% 73% 18% 9%
Champion Challenger
Sales per View:
- 1.7%
And it failed again. We persuaded almost 10% of customers to pick the super premium product. But! The share of Premier did not
increased and again we could see a drop in a conversion rate.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
We moved our attention from the landing page to the sales flow behind it. Important thing to say is that customers can buy a 1-year
subscription from landing page. What we wanted to try was to implement an interstitial element which offers customers a good deal
of 2-year subscription. The message was simple: “Two are better than one!”
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
Sales per View:
+ 20.9%
And the interstitial element worked fantastically! We could see a 21% increase in Sales per View. A lot of customers agreed to the
2-year subscription. It is interesting that this upsell did not work in our pop-up expiration flow in the past. It seems to be working
only when the sales element is opened on a customer’s intention. Then they are happy to consider also other options.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
Then we tested the interstitial element itself. Champion version is the more straight forward message – “Take it or leave it”. The
challenger version provides more options (also the 3-year is available) and it is also more transparent – you can see all prices. Plus
there is a recap of your choice with key features listed.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
Sales per View:
- 9.8%
The more transparent version failed..
In USA.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
Sales per View:
+ 10.2%
But it succeeded in the rest of the world. It is not the first time a more straightforward and simpler design works great in the USA. On
the other hand a different design (more transparent, more information) usually works better in Europe and our other key markets.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
In the more transparent version we felt pre-selecting a 2-year option will be better for sales. Obviously we were not sure so we A/B
tested it.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
Sales per View:
- 13,3%
And it proved to be really better. When we pre-select certain option in a sales dialog we can see that more customers actually pick
this option. And the pre-selection in our case does-not have an impact on a conversion rate.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
Last thing what we’ve tested so far was a 1PC/3PC switcher. We have already managed to successfully upsell customers to 2-year
subscriptions. Now we wanted to upsell them to a 3PC version which they can use to secure more PCs.
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Champion Challenger
Sales per View:
+ 13.6%
We have results only from France so far but is seems to be working very well. It has a positive impact not only to AOV but also on a
conversion rate as they seem to appreciate more options (like in the case of the interstitial element).
Total Optimization Score
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Incremental monthly sales
+ $200k2013M12 2014M01 2014M02 2014M03
“Renew now” Button LP - Sales per View
In those 4 months of a continual optimization we could get 18% lift in Sales per View (“Renew now” landing page) – it is across all
markets and all consumer paid products. It resulted in a massive lift of sales. Monthly retention sales increased by $200k
incrementally.
• If a sales element is opened on customers’ intention
there is a higher chance to upsell
• Always test your hypothesizes, don’t just trust case
studies
• Decoy product effect works
• Pre-selection influences purchase behavior
• US/Europe purchase behavior differences
#TLE2014The Live Event@parezem
©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved.
Takeaways
To wrap it up there are few key takeaways we’ve learned.
Contact Info
Michal Parizek
avast!
Senior E-Commerce Specialist
+420 604 927 816
parizek.michal@gmail.com
#TLE2014The Live Event@parezem
London

Mais conteúdo relacionado

Destaque

Utility Renewals Limited Presentation-1
Utility Renewals  Limited Presentation-1Utility Renewals  Limited Presentation-1
Utility Renewals Limited Presentation-1
Andy Gray
 
ALA MidWinter 2013 - Electronic Resources Management Interest Group meeting -...
ALA MidWinter 2013 - Electronic Resources Management Interest Group meeting -...ALA MidWinter 2013 - Electronic Resources Management Interest Group meeting -...
ALA MidWinter 2013 - Electronic Resources Management Interest Group meeting -...
dwestbrook
 
2009 open world chooing the right subscription contract
2009 open world chooing the right subscription contract2009 open world chooing the right subscription contract
2009 open world chooing the right subscription contract
DZee Solutions
 
Matrix partners, David Skok
Matrix partners, David SkokMatrix partners, David Skok
Matrix partners, David Skok
MassTLC
 

Destaque (20)

James Glassman - Global Renewal Presentation
James Glassman - Global Renewal PresentationJames Glassman - Global Renewal Presentation
James Glassman - Global Renewal Presentation
 
How to use Customer Success to Prep for and Drive Contract Renewals
How to use Customer Success to Prep for and Drive Contract RenewalsHow to use Customer Success to Prep for and Drive Contract Renewals
How to use Customer Success to Prep for and Drive Contract Renewals
 
Metody optimalizace E-commerce
Metody optimalizace E-commerceMetody optimalizace E-commerce
Metody optimalizace E-commerce
 
IT Renewal: A Business Transformation
IT Renewal: A Business TransformationIT Renewal: A Business Transformation
IT Renewal: A Business Transformation
 
Territory & Quota: Collaborative, Quick & Data-Driven (Anaplan HUB2014)
Territory & Quota: Collaborative, Quick & Data-Driven (Anaplan HUB2014)Territory & Quota: Collaborative, Quick & Data-Driven (Anaplan HUB2014)
Territory & Quota: Collaborative, Quick & Data-Driven (Anaplan HUB2014)
 
What happens during the renewal process
What happens during the renewal processWhat happens during the renewal process
What happens during the renewal process
 
Utility Renewals Limited Presentation-1
Utility Renewals  Limited Presentation-1Utility Renewals  Limited Presentation-1
Utility Renewals Limited Presentation-1
 
ALA MidWinter 2013 - Electronic Resources Management Interest Group meeting -...
ALA MidWinter 2013 - Electronic Resources Management Interest Group meeting -...ALA MidWinter 2013 - Electronic Resources Management Interest Group meeting -...
ALA MidWinter 2013 - Electronic Resources Management Interest Group meeting -...
 
2012-13 Cal Men's Basketball Renewal Process
2012-13 Cal Men's Basketball Renewal Process2012-13 Cal Men's Basketball Renewal Process
2012-13 Cal Men's Basketball Renewal Process
 
B2B Content: Driving More Sales, Renewals, and Repeat Purchase from Your Exi...
	B2B Content: Driving More Sales, Renewals, and Repeat Purchase from Your Exi...	B2B Content: Driving More Sales, Renewals, and Repeat Purchase from Your Exi...
B2B Content: Driving More Sales, Renewals, and Repeat Purchase from Your Exi...
 
How to Drive Top-Line Growth with Customer Success Management Metrics
How to Drive Top-Line Growth with Customer Success Management MetricsHow to Drive Top-Line Growth with Customer Success Management Metrics
How to Drive Top-Line Growth with Customer Success Management Metrics
 
Hub16: Equifax: Quota and territory planning: The challenges and opportunitie...
Hub16: Equifax: Quota and territory planning: The challenges and opportunitie...Hub16: Equifax: Quota and territory planning: The challenges and opportunitie...
Hub16: Equifax: Quota and territory planning: The challenges and opportunitie...
 
2009 open world chooing the right subscription contract
2009 open world chooing the right subscription contract2009 open world chooing the right subscription contract
2009 open world chooing the right subscription contract
 
THE ANATOMY OF A CONTRACT RENEWAL
THE ANATOMY OF A CONTRACT RENEWALTHE ANATOMY OF A CONTRACT RENEWAL
THE ANATOMY OF A CONTRACT RENEWAL
 
Empowering Your Renewal Teams (ServiceSource and IDC Webinar, March 18, 2013)
Empowering Your Renewal Teams (ServiceSource and IDC Webinar, March 18, 2013)Empowering Your Renewal Teams (ServiceSource and IDC Webinar, March 18, 2013)
Empowering Your Renewal Teams (ServiceSource and IDC Webinar, March 18, 2013)
 
Renewal Capability For Sustainable Growth V7
Renewal Capability For Sustainable Growth V7Renewal Capability For Sustainable Growth V7
Renewal Capability For Sustainable Growth V7
 
Business Development & Renewal Process
Business Development & Renewal ProcessBusiness Development & Renewal Process
Business Development & Renewal Process
 
Higher Revenue with Renewals for Sales VPs
Higher Revenue with Renewals for Sales VPsHigher Revenue with Renewals for Sales VPs
Higher Revenue with Renewals for Sales VPs
 
Matrix partners, David Skok
Matrix partners, David SkokMatrix partners, David Skok
Matrix partners, David Skok
 
The Definitive Guide to Customer Success 2017
The Definitive Guide to Customer Success 2017The Definitive Guide to Customer Success 2017
The Definitive Guide to Customer Success 2017
 

Semelhante a Million $ Button Optimization - Which Test Won TLE 2014

Zuberance - Paid Vs Earned Media
Zuberance - Paid Vs Earned MediaZuberance - Paid Vs Earned Media
Zuberance - Paid Vs Earned Media
Zuberance
 
Obedience v Compliance : Getting Sales & Marketing Talking the Same Language
Obedience v Compliance : Getting Sales & Marketing Talking the Same LanguageObedience v Compliance : Getting Sales & Marketing Talking the Same Language
Obedience v Compliance : Getting Sales & Marketing Talking the Same Language
John Watton
 
To our shareownersA dreamy business offering has at l.docx
To our shareownersA dreamy business offering has at l.docxTo our shareownersA dreamy business offering has at l.docx
To our shareownersA dreamy business offering has at l.docx
turveycharlyn
 
Jan Van den Bergh - The Recommender Revolution
Jan Van den Bergh - The Recommender RevolutionJan Van den Bergh - The Recommender Revolution
Jan Van den Bergh - The Recommender Revolution
Sanoma Belgium
 
Intuit at DES: How DMPs are Enabling the New Digital Enterprise
Intuit at DES: How DMPs are Enabling the New Digital EnterpriseIntuit at DES: How DMPs are Enabling the New Digital Enterprise
Intuit at DES: How DMPs are Enabling the New Digital Enterprise
Digiday
 
WTW TLE 2015 Powerpoint_Hua_Charles-final
WTW TLE 2015 Powerpoint_Hua_Charles-finalWTW TLE 2015 Powerpoint_Hua_Charles-final
WTW TLE 2015 Powerpoint_Hua_Charles-final
Charles Hua
 

Semelhante a Million $ Button Optimization - Which Test Won TLE 2014 (20)

Tests with knock out results - Justin Rondeau #ab40
Tests with knock out results - Justin Rondeau #ab40Tests with knock out results - Justin Rondeau #ab40
Tests with knock out results - Justin Rondeau #ab40
 
How to price your mobile app
How to price your mobile appHow to price your mobile app
How to price your mobile app
 
2015 stima holaba
2015 stima holaba2015 stima holaba
2015 stima holaba
 
2015 stima holaba
2015 stima holaba2015 stima holaba
2015 stima holaba
 
2015 Stima holaba @ Palm
2015 Stima holaba @ Palm 2015 Stima holaba @ Palm
2015 Stima holaba @ Palm
 
A Playbook for Achieving Product-Market Fit
A Playbook for Achieving Product-Market FitA Playbook for Achieving Product-Market Fit
A Playbook for Achieving Product-Market Fit
 
Zuberance - Paid Vs Earned Media
Zuberance - Paid Vs Earned MediaZuberance - Paid Vs Earned Media
Zuberance - Paid Vs Earned Media
 
Obedience v Compliance : Getting Sales & Marketing Talking the Same Language
Obedience v Compliance : Getting Sales & Marketing Talking the Same LanguageObedience v Compliance : Getting Sales & Marketing Talking the Same Language
Obedience v Compliance : Getting Sales & Marketing Talking the Same Language
 
The Lean Product Playbook with Dan Olsen
The Lean Product Playbook with Dan OlsenThe Lean Product Playbook with Dan Olsen
The Lean Product Playbook with Dan Olsen
 
2015 Marketing Trends
2015 Marketing Trends2015 Marketing Trends
2015 Marketing Trends
 
Mobile Game Asia 2015 Ho Chi Minh City: Predictive monetization
Mobile Game Asia 2015 Ho Chi Minh City: Predictive monetizationMobile Game Asia 2015 Ho Chi Minh City: Predictive monetization
Mobile Game Asia 2015 Ho Chi Minh City: Predictive monetization
 
Mobile Game Asia 2015 Ho Chi Minh City: Predictive monetization
Mobile Game Asia 2015 Ho Chi Minh City: Predictive monetizationMobile Game Asia 2015 Ho Chi Minh City: Predictive monetization
Mobile Game Asia 2015 Ho Chi Minh City: Predictive monetization
 
Predictive Monetization
Predictive MonetizationPredictive Monetization
Predictive Monetization
 
To our shareownersA dreamy business offering has at l.docx
To our shareownersA dreamy business offering has at l.docxTo our shareownersA dreamy business offering has at l.docx
To our shareownersA dreamy business offering has at l.docx
 
Jan Van den Bergh - The Recommender Revolution
Jan Van den Bergh - The Recommender RevolutionJan Van den Bergh - The Recommender Revolution
Jan Van den Bergh - The Recommender Revolution
 
Intuit at DES: How DMPs are Enabling the New Digital Enterprise
Intuit at DES: How DMPs are Enabling the New Digital EnterpriseIntuit at DES: How DMPs are Enabling the New Digital Enterprise
Intuit at DES: How DMPs are Enabling the New Digital Enterprise
 
eMarketer Webinar: Six Guidelines for Measuring Real-Time Marketing Success
eMarketer Webinar: Six Guidelines for Measuring Real-Time Marketing SuccesseMarketer Webinar: Six Guidelines for Measuring Real-Time Marketing Success
eMarketer Webinar: Six Guidelines for Measuring Real-Time Marketing Success
 
Loyalty management more than earning and spending points
Loyalty management  more than earning and spending pointsLoyalty management  more than earning and spending points
Loyalty management more than earning and spending points
 
WTW TLE 2015 Powerpoint_Hua_Charles-final
WTW TLE 2015 Powerpoint_Hua_Charles-finalWTW TLE 2015 Powerpoint_Hua_Charles-final
WTW TLE 2015 Powerpoint_Hua_Charles-final
 
5 Myths About Breaking Into the Streaming Space, Debunked
5 Myths About Breaking Into the Streaming Space, Debunked5 Myths About Breaking Into the Streaming Space, Debunked
5 Myths About Breaking Into the Streaming Space, Debunked
 

Último

Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
gajnagarg
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
ranjankumarbehera14
 
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
Health
 
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
 
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
vexqp
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
nirzagarg
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
 
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Bertram Ludäscher
 

Último (20)

Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
 
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
 
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
Nirala Nagar / Cheap Call Girls In Lucknow Phone No 9548273370 Elite Escort S...
 
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
 
Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...
Top Call Girls in Balaghat  9332606886Call Girls Advance Cash On Delivery Ser...Top Call Girls in Balaghat  9332606886Call Girls Advance Cash On Delivery Ser...
Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...
 
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
 
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
 
Kings of Saudi Arabia, information about them
Kings of Saudi Arabia, information about themKings of Saudi Arabia, information about them
Kings of Saudi Arabia, information about them
 
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
 
Ranking and Scoring Exercises for Research
Ranking and Scoring Exercises for ResearchRanking and Scoring Exercises for Research
Ranking and Scoring Exercises for Research
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Purnia [ 7014168258 ] Call Me For Genuine Models We...
 
Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...
Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...
Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...
 
20240412-SmartCityIndex-2024-Full-Report.pdf
20240412-SmartCityIndex-2024-Full-Report.pdf20240412-SmartCityIndex-2024-Full-Report.pdf
20240412-SmartCityIndex-2024-Full-Report.pdf
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
 
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
 
Statistics notes ,it includes mean to index numbers
Statistics notes ,it includes mean to index numbersStatistics notes ,it includes mean to index numbers
Statistics notes ,it includes mean to index numbers
 

Million $ Button Optimization - Which Test Won TLE 2014

  • 1. Case Study: avast! – Million $ Button Optimization Michal Parizek avast! Senior E-Commerce Specialist #TLE2014The Live Event@parezem London
  • 2. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. 1988 Founded in Czech Republic Switched to Freemium 2001 2014 Users: 219,000,000 Valued: $1,000,000,000 in 1988 AVAST was founded in Czech Republic by two researches Eduard Kucera and Pavel Baudis. It had good early 90s, but then the competition got fiercer. A major decision to switch to a freemium model saved the business. Since 2001 the business has been growing and nowadays AVAST protects more than 219M users and it is valued as a $1B company.
  • 3. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Paid version Trial version Website Other Free version Breakdown of sales We can see two main streams of revenue for AVAST: sales which come from the Free version (customers who decide to switch to a premium protection) and sales which come from the Paid version (subscription renewals and further monetization). My focus is on the retention business (=Paid version).
  • 4. Breakdown of retention sales RENEW NOW #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. If we look at the retention sales in more detail we could see the key sales elements. The most of the sales is done by an expiration messaging (small and big pop-ups & expiration email). The other element is the “Renew now” button which makes around 25% of all consumer retention sales. This button is a center point of this case study.
  • 5. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. RENEW NOW The “Renew now” button sits in the program GUI. It appears once a customer is in an expiration period (starting 30 days before an expiration date) and stays there until a customer renews her protection.
  • 6. Champion #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Challenger RENEW NOW RENEW NOW In the autumn of 2013 we tried a different approach in the “Renew now” button sales flow. Champion (default) version meant the button opened a standard expiration big pop-up which a customer knew very well. The challenger version meant a new landing page which contained a clear comparison table of all three consumer products.
  • 7. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. RENEW NOW RENEW NOW Sales per View: + 13.4% Champion Challenger The challenger worked much better. We could see that customers who clicked on the “Renew now” button preferred to do a more informed decision – to see where their current solution stands and to see all the features of all options available. The champion version contained only different length of subscription period.
  • 8. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. There is the comparison landing page in more detail. A customer can see all the features and the prices of all options. This entire new landing page which was responsible for around 25% of sales was a starting point of a 4-month long optimization project which in fact still continues (in the time presenting the case study).
  • 9. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. William Poundstone Priceless: The Myth of Fair Value http://bit.ly/price-less-book I’d like to start the optimization part with an experiment William Poundstone describes in his book Priceless. They’ve approached students with two beers: $1.80 & $2.50. 80% of students picked the more expensive beer. Later they’ve approached students again and this time the menu contained also $1.60 beer. Facing those 3 options 80% of students picked the $1.80 beer..
  • 10. Champion #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Challenger 2% 77% 21% Once we read the experiment we just had to try it! Our new landing page looked like the second round of that experiment. Almost 80% chose the middle option – Internet Security. We hoped that by removing the cheapest options the majority could also pick the most expensive option – Premier.
  • 11. Champion #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Challenger 2% 77% 21% 75% 25% Sales per View: - 1.2% Well, it did not happen.. We could see a slight increase of Premier’s share, but there was a decrease of a conversion rate. We believe there were three main reasons why it failed: 1) The prices are higher than in the beer experiment, more than 10x. 2) Don’t forget, it is retention business, customers had at least a 1-year experience with the middle product. 3) Decoy effect of the cheapest option.
  • 12. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. William Poundstone Priceless: The Myth of Fair Value http://bit.ly/price-less-book Anyway, the Poundstone’s experiment continued. They’ve approached the students for the third time – to the main two beers they’ve added a super premium beer – a $3.40 one. 10% of students picked it and the share of $2.50 beer also increased.
  • 13. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. 2% 77% 21% Champion Challenger We had to try this one as well. However we had a crucial issue – we did not have a super premium product.. So we made it up. We bundled our premium product (Premier) with one of our attached products SecureLine VPN. And we called an Ultimate Security Pack! (I know sounds cheesy)
  • 14. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. 2% 77% 21% 73% 18% 9% Champion Challenger Sales per View: - 1.7% And it failed again. We persuaded almost 10% of customers to pick the super premium product. But! The share of Premier did not increased and again we could see a drop in a conversion rate.
  • 15. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger We moved our attention from the landing page to the sales flow behind it. Important thing to say is that customers can buy a 1-year subscription from landing page. What we wanted to try was to implement an interstitial element which offers customers a good deal of 2-year subscription. The message was simple: “Two are better than one!”
  • 16. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger Sales per View: + 20.9% And the interstitial element worked fantastically! We could see a 21% increase in Sales per View. A lot of customers agreed to the 2-year subscription. It is interesting that this upsell did not work in our pop-up expiration flow in the past. It seems to be working only when the sales element is opened on a customer’s intention. Then they are happy to consider also other options.
  • 17. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger Then we tested the interstitial element itself. Champion version is the more straight forward message – “Take it or leave it”. The challenger version provides more options (also the 3-year is available) and it is also more transparent – you can see all prices. Plus there is a recap of your choice with key features listed.
  • 18. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger Sales per View: - 9.8% The more transparent version failed.. In USA.
  • 19. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger Sales per View: + 10.2% But it succeeded in the rest of the world. It is not the first time a more straightforward and simpler design works great in the USA. On the other hand a different design (more transparent, more information) usually works better in Europe and our other key markets.
  • 20. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger In the more transparent version we felt pre-selecting a 2-year option will be better for sales. Obviously we were not sure so we A/B tested it.
  • 21. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger Sales per View: - 13,3% And it proved to be really better. When we pre-select certain option in a sales dialog we can see that more customers actually pick this option. And the pre-selection in our case does-not have an impact on a conversion rate.
  • 22. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger Last thing what we’ve tested so far was a 1PC/3PC switcher. We have already managed to successfully upsell customers to 2-year subscriptions. Now we wanted to upsell them to a 3PC version which they can use to secure more PCs.
  • 23. #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Champion Challenger Sales per View: + 13.6% We have results only from France so far but is seems to be working very well. It has a positive impact not only to AOV but also on a conversion rate as they seem to appreciate more options (like in the case of the interstitial element).
  • 24. Total Optimization Score #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Incremental monthly sales + $200k2013M12 2014M01 2014M02 2014M03 “Renew now” Button LP - Sales per View In those 4 months of a continual optimization we could get 18% lift in Sales per View (“Renew now” landing page) – it is across all markets and all consumer paid products. It resulted in a massive lift of sales. Monthly retention sales increased by $200k incrementally.
  • 25. • If a sales element is opened on customers’ intention there is a higher chance to upsell • Always test your hypothesizes, don’t just trust case studies • Decoy product effect works • Pre-selection influences purchase behavior • US/Europe purchase behavior differences #TLE2014The Live Event@parezem ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. Takeaways To wrap it up there are few key takeaways we’ve learned.
  • 26. Contact Info Michal Parizek avast! Senior E-Commerce Specialist +420 604 927 816 parizek.michal@gmail.com #TLE2014The Live Event@parezem London

Notas do Editor

  1. My CRO focus is on RETENTION
  2. It displays 30 days to expiration in avast! GUI
  3. If customers want to renew and click on the button “Renew now” comparison table works better. These customers want to make more informed decisions. Compare products, see features..