SlideShare a Scribd company logo
1 of 32
Download to read offline
Online Testing – the 
O li T i          h
 light in the tunnel
 light in the tunnel

 October, 2010
AGENDA

•   What is Online Testing?
    What is Online Testing?
•   How is it working?
•   Variables of Success
       i bl    fS
•   Case Studies
•   Conversion Optimization Consulting
What is Online Testing?

Online Testing (OL) Definition:
Online Testing (OL) Definition:
  In a nutshell, online testing 
  involves testing one or more 
                  g
  variable from a webpage to 
  identify which ones can create a 
  positive difference in the 
  conversion. 
  The winning variable then 
    h                bl h
  becomes the control, or bench 
  mark, which future ones are 
  mark which future ones are
  measured against.
Online Testing Steps

Scientific testing involves the following steps:
1) Determining which element(s) of a page you want to test. 
2) Creating the test / the test page
3) Setting up the tool use for the testing
3) Setting up the tool use for the testing
4) Keeping good, accurate test records.
5) Running the test campaign.
6) Tracking and comparing results to determine which test variable is the 
6)     ki      d         i        l    d      i   hi h        i bl i h
    winner. (100 conversions)
7) Repeating the cycle, constantly attempting to beat your existing control
Categories of Online Testing

• A/B test, Split test
   /      , p                     • MVT ‐Multivariable test
 Page 1: Control (the original)      Page 1: Control (the original)

                                                         SUBSCRIBE 
                                                         SUBSCRIBE
                                                           NOW
        SEND ME THE FREE 
           GUIDE NOW



 Page 2: Test page                   Page 2: Test page

                                                          SEND ME 
        SEND ME THE FREE                                  THE INFO
           GUIDE NOW
           GUIDE NOW
Time needed for testing?

                        LONGER Test Period    SHORTER Test Period
# of Alternatives /     More (MVT)            Less (A/B)
Variables
Difference in Results   Lesser                Greater
Traffic Volume          Less                  More
Confidence Level        Higher > 90%          Lower < 90%




                                        100 conversions
Case Study 1 – Relevancy 




ORIGINAL                 TEST
Partial results
Relevant? 



NOT YET !
NOT YET !
Risks? What Risks?

• All Test Types are not
  All Test Types are not 
  Equal

• Comparing & Contrasting 
  A/B and MVT
  A/B d MVT

• The Risk of the Endless 
  Test
KEY principles for online tests

Test Methodology
     – Is A Process !
     – Single Variable Test Formula
         • The most important tool for performing a useful experiment
           The most important tool for performing a useful experiment. 
     – The (relevant) Academic Vocabulary
         • There are Concepts, Terminology, Differences between Variable
         • Understand and Use them Properly
              d       d d        h            l
     – Test Protocol
         • Use proper tool organizes each stage of the test process and 
           automatically calculates all of the key equations.
KEY principles for online tests

Test Validity
            y
• Understanding of validity principles, so that you can be 
   confident in the results of your test.
    – The Threats to Test Validity
       • "history effect", 
       • "instrumentation error"
          "instrumentation error"
       • "sample distortion”
    – The Sample Size Validity
      The Sample Size Validity
       • The key mathematical equations for determining test 
          size.
    – The Validity Formula
KEY principles for online tests
Test Planning
• Which variables to test? 
     – Knowing what to test is as important as knowing how to test. 
     – The Optimization Formula
         • Prioritize your testing goals
           Prioritize your testing goals. 
         • More revenue = right order.
     – The Test ROI Calculation Tool
         • Calculates the compounding ROI on a given series of tests. 
         • Saves time and money as it helps you determine the impact of each 
           test on your marketing budget.
     – Radical Redesigns
         • How to capture multi‐variable test results with single variable testing 
           techniques
                  q
What’s the big deal about Online 
                                      Testing?

• Online Testing:
  Online Testing:
  – Motivation
  – Value proposition
    Value proposition
  – Incentive
  –A i t
    Anxiety
  – Friction 



        C = 4m + 3v + 2(i f) -2a ©
                      2(i-f) 2a
When?
• How would you Know WHEN need TO APPLY
  this strategy?
   hi          ?

• The right answer: 

    • ALL THE TIME there is an
      ALL THE TIME there is an 
            Opportunity
             pp       y
• Amazon – case study: 
    200 live online tests running every day
    200 li     li t t         i         d
Case Study 2‐ The Formula!




816% Growth in
New Subscribers

ORIGINAL                TEST
Case Study 3 – Prove It!
Case Study 3‐ Treatment
 100% Money BacK Guarantee – Eliminating anxietY




  Call to Actions highlighting the benefits
Let’s compare …




ORIGINAL      TREATMENT
Case Study 4: Is It Worth it?

Professional Photographer
                  g p
• Status:
   –   New site
   –   Artistic / flash
                /
   –   Minimum content
   –   No commercial aspect
• Goals:
   – To get New Clients
• Strategies:
   – They decided to do PPC
   – Adding some wedding pictures on the actual site
     Adding some wedding pictures on the actual site
Case Study 4 – cont.

• Our proposal:
  Our proposal:
  – Landing Page
           g g
• Reaction:
  – Fighting
• Agreement:
  – Online Testing 
Case Study 4 – cont.

• Results:
  – Our page performed better: 71.6% improvement 
    in conversion (contacts)
    in conversion (contacts)
• The client got 4 wedding contracts, with an 
  online marketing budget of 3.5% spent
  online marketing budget of 3 5% spent
Oak Photography LP




Differences
Oak Photography LP




       Differences
ATTENTION


• Controversy about Best Practices
  Controversy about Best Practices

• Example: Video on AutoStart or 
  Press Play
         l
Case Study 5 ‐ controversy

           Video Play Not Play
           Vid – Pl or N t Pl ?




           63% improvement
           in conversion with
           Video on autoplay
CONCLUSIONS
• Do not go Blind with 
  your marketing 
  your marketing

• Focus your money and 
  resources where it 
  counts

• Get confirmation you 
  are on the right track
               g
Conversion Optimization
            Eworks WSI Cyprus:
•   Consulting Services
    Consulting Services
•   Landing Page / Website / Email 
    Marketing
    M k ti
•   Report (14‐20 variables analyzed)
•   100% Money Back Guarantee 
    (certain conditions apply)
•   Our Clients Implement 95‐100 % 
    of our recommendations
    of our recommendations
EworksWSI Cyprus
SERVICES:
- Webdesign               - Interactive Content
                          ( g
                          (digital p
                                   publishing)
                                            g)
- Landing Pages Design
                          -Digital Marketing
- Website Conversion
Optimization
Optimi ation              - Flash Content

- Landing Pages           - Print Design
Conversion Optimization
             p
                          - Logo Design
- Email Marketing
Conversion Optimization                           CONTACT INFO: 
                                                  info@eworkswsi.com.cy
                                                  i f @    k i
                                                  +35799‐555747
                                                  www.EworksWSI.com.cy
                                                  www EworksWSI com cy
PROMO !

ONLY for our clients:
ONLY for our clients:
‐ Until Dec 31, 2010
‐ O li
  Online testing discounted f
             i di         d from €500 to €300
                                 € 00 €300




‐ A d hi i
  And this is not all ……
                   ll
PROMO !

Package 1:          Package 2:          Package 3:
1 sample design     2 sample design     2 sample design
Cost Package:       Cost Package:       1 Online Testing
€450 
€450                €600 
                    €600                Cost Package: 
                                        Cost Package:
(Information        (Information        €685
Architecture Doc 
Architecture Doc    Architecture Doc 
                    Architecture Doc    (Information 
                                        (Information
completed)          completed)          Architecture Doc 
                                        completed)
Contact  Eworks WSI Cyprus

Contact us for more info
Contact us for more info

   Eworks WSI Cyprus
       k S C

 info@eworkswsi.com.cy
 www.eworkswsi.com.cy
 www eworkswsi com cy
    Tel: +357‐99555747

More Related Content

Similar to Eworks WSI Cyprus online testing oct 2010

How to design powerful experiments - Ying Zhang
How to design powerful experiments - Ying ZhangHow to design powerful experiments - Ying Zhang
How to design powerful experiments - Ying ZhangProduct Anonymous
 
Cro webinar what you're doing wrong in your cro program (sharable version)
Cro webinar   what you're doing wrong in your cro program (sharable version)Cro webinar   what you're doing wrong in your cro program (sharable version)
Cro webinar what you're doing wrong in your cro program (sharable version)VWO
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMProduct School
 
Can I Test More Than One Variable at a Time? Statisticians answer some of th...
Can I Test More Than One Variable at a  Time? Statisticians answer some of th...Can I Test More Than One Variable at a  Time? Statisticians answer some of th...
Can I Test More Than One Variable at a Time? Statisticians answer some of th...MarketingExperiments
 
Conversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Conversion Rate Optimisation: The Science Behind Turning Visitors Into CustomersConversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Conversion Rate Optimisation: The Science Behind Turning Visitors Into CustomersWeb Marketing ROI
 
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB testsCraig Sullivan
 
Materials And Information Flow Map
Materials And Information Flow MapMaterials And Information Flow Map
Materials And Information Flow MapMichael E. Parker
 
John Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test WellJohn Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test WellTEST Huddle
 
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...Optimizely
 
Meta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsMeta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsVWO
 
Data-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PMData-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PMProduct School
 
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeBrighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeCraig Sullivan
 
What is the true ROI on your technology investments?
What is the true ROI on your technology investments?What is the true ROI on your technology investments?
What is the true ROI on your technology investments?Qubit
 
4 ie 2015 rapid research
4   ie 2015 rapid research4   ie 2015 rapid research
4 ie 2015 rapid researchMaggie Nichols
 
Metrics and Analytics, Guest Lecture, UCLA
Metrics and Analytics, Guest Lecture, UCLAMetrics and Analytics, Guest Lecture, UCLA
Metrics and Analytics, Guest Lecture, UCLADarren Levy
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B TestingJanessa Lantz
 

Similar to Eworks WSI Cyprus online testing oct 2010 (20)

How to design powerful experiments - Ying Zhang
How to design powerful experiments - Ying ZhangHow to design powerful experiments - Ying Zhang
How to design powerful experiments - Ying Zhang
 
Cro webinar what you're doing wrong in your cro program (sharable version)
Cro webinar   what you're doing wrong in your cro program (sharable version)Cro webinar   what you're doing wrong in your cro program (sharable version)
Cro webinar what you're doing wrong in your cro program (sharable version)
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
 
Can I Test More Than One Variable at a Time? Statisticians answer some of th...
Can I Test More Than One Variable at a  Time? Statisticians answer some of th...Can I Test More Than One Variable at a  Time? Statisticians answer some of th...
Can I Test More Than One Variable at a Time? Statisticians answer some of th...
 
Conversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Conversion Rate Optimisation: The Science Behind Turning Visitors Into CustomersConversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Conversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
 
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests#Measurefest : 20 Simple Ways to Fuck Up your AB tests
#Measurefest : 20 Simple Ways to Fuck Up your AB tests
 
Materials And Information Flow Map
Materials And Information Flow MapMaterials And Information Flow Map
Materials And Information Flow Map
 
John Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test WellJohn Fodeh - Spend Wisely, Test Well
John Fodeh - Spend Wisely, Test Well
 
See the Research in Action
See the Research in ActionSee the Research in Action
See the Research in Action
 
Pricing strategies 2017 nz
Pricing strategies 2017 nzPricing strategies 2017 nz
Pricing strategies 2017 nz
 
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
 
Meta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and HowsMeta-Analyses in Experimentation: The Whats and Hows
Meta-Analyses in Experimentation: The Whats and Hows
 
Data-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PMData-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PM
 
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeBrighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to Me
 
Brooks Bell Interactive Tama Presentation
Brooks Bell Interactive Tama PresentationBrooks Bell Interactive Tama Presentation
Brooks Bell Interactive Tama Presentation
 
What is the true ROI on your technology investments?
What is the true ROI on your technology investments?What is the true ROI on your technology investments?
What is the true ROI on your technology investments?
 
4 ie 2015 rapid research
4   ie 2015 rapid research4   ie 2015 rapid research
4 ie 2015 rapid research
 
Lean Startup 301
Lean Startup 301Lean Startup 301
Lean Startup 301
 
Metrics and Analytics, Guest Lecture, UCLA
Metrics and Analytics, Guest Lecture, UCLAMetrics and Analytics, Guest Lecture, UCLA
Metrics and Analytics, Guest Lecture, UCLA
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing
 

More from EworksWSI Cyprus

EworksWSI Cyprus 2016 Content Marketing Whitepaper
EworksWSI Cyprus 2016 Content Marketing WhitepaperEworksWSI Cyprus 2016 Content Marketing Whitepaper
EworksWSI Cyprus 2016 Content Marketing WhitepaperEworksWSI Cyprus
 
WSI Video Marketing Packages 2016
WSI Video Marketing Packages 2016WSI Video Marketing Packages 2016
WSI Video Marketing Packages 2016EworksWSI Cyprus
 
Eworks WSI Cyprus Digital Marketing Services Overview 2016
Eworks WSI Cyprus Digital Marketing Services Overview 2016Eworks WSI Cyprus Digital Marketing Services Overview 2016
Eworks WSI Cyprus Digital Marketing Services Overview 2016EworksWSI Cyprus
 
EworksWSI Productsheet Mobilemarketing
EworksWSI Productsheet MobilemarketingEworksWSI Productsheet Mobilemarketing
EworksWSI Productsheet MobilemarketingEworksWSI Cyprus
 
Eworks WSI Cyprus Productsheet Email Marketing
Eworks WSI Cyprus Productsheet Email MarketingEworks WSI Cyprus Productsheet Email Marketing
Eworks WSI Cyprus Productsheet Email MarketingEworksWSI Cyprus
 
Nov2014 whitepaper digitallandscape2015
Nov2014 whitepaper digitallandscape2015Nov2014 whitepaper digitallandscape2015
Nov2014 whitepaper digitallandscape2015EworksWSI Cyprus
 
2013 EworksWSI Social media tactical plan
2013 EworksWSI Social media tactical plan2013 EworksWSI Social media tactical plan
2013 EworksWSI Social media tactical planEworksWSI Cyprus
 
Eworks WSI Cyprus bulk SMS platform User Guide
Eworks WSI Cyprus bulk SMS platform User GuideEworks WSI Cyprus bulk SMS platform User Guide
Eworks WSI Cyprus bulk SMS platform User GuideEworksWSI Cyprus
 
Eworks WSI Cyprus 2012 Mobilemarketing simplified
Eworks WSI Cyprus 2012 Mobilemarketing simplifiedEworks WSI Cyprus 2012 Mobilemarketing simplified
Eworks WSI Cyprus 2012 Mobilemarketing simplifiedEworksWSI Cyprus
 
Social media in travel & tourism best practices
Social media in travel & tourism  best practicesSocial media in travel & tourism  best practices
Social media in travel & tourism best practicesEworksWSI Cyprus
 
Eworks WSI Cyprus: Online reputation Mangement
Eworks WSI Cyprus: Online reputation MangementEworks WSI Cyprus: Online reputation Mangement
Eworks WSI Cyprus: Online reputation MangementEworksWSI Cyprus
 
Converting visitors into customers
Converting visitors into customersConverting visitors into customers
Converting visitors into customersEworksWSI Cyprus
 
3 fifty7 Music Agency Presentation by EworksWSI
3 fifty7   Music Agency Presentation by EworksWSI3 fifty7   Music Agency Presentation by EworksWSI
3 fifty7 Music Agency Presentation by EworksWSIEworksWSI Cyprus
 
Eworks wsi cyprus wsi google adwords
Eworks wsi cyprus wsi google adwordsEworks wsi cyprus wsi google adwords
Eworks wsi cyprus wsi google adwordsEworksWSI Cyprus
 

More from EworksWSI Cyprus (14)

EworksWSI Cyprus 2016 Content Marketing Whitepaper
EworksWSI Cyprus 2016 Content Marketing WhitepaperEworksWSI Cyprus 2016 Content Marketing Whitepaper
EworksWSI Cyprus 2016 Content Marketing Whitepaper
 
WSI Video Marketing Packages 2016
WSI Video Marketing Packages 2016WSI Video Marketing Packages 2016
WSI Video Marketing Packages 2016
 
Eworks WSI Cyprus Digital Marketing Services Overview 2016
Eworks WSI Cyprus Digital Marketing Services Overview 2016Eworks WSI Cyprus Digital Marketing Services Overview 2016
Eworks WSI Cyprus Digital Marketing Services Overview 2016
 
EworksWSI Productsheet Mobilemarketing
EworksWSI Productsheet MobilemarketingEworksWSI Productsheet Mobilemarketing
EworksWSI Productsheet Mobilemarketing
 
Eworks WSI Cyprus Productsheet Email Marketing
Eworks WSI Cyprus Productsheet Email MarketingEworks WSI Cyprus Productsheet Email Marketing
Eworks WSI Cyprus Productsheet Email Marketing
 
Nov2014 whitepaper digitallandscape2015
Nov2014 whitepaper digitallandscape2015Nov2014 whitepaper digitallandscape2015
Nov2014 whitepaper digitallandscape2015
 
2013 EworksWSI Social media tactical plan
2013 EworksWSI Social media tactical plan2013 EworksWSI Social media tactical plan
2013 EworksWSI Social media tactical plan
 
Eworks WSI Cyprus bulk SMS platform User Guide
Eworks WSI Cyprus bulk SMS platform User GuideEworks WSI Cyprus bulk SMS platform User Guide
Eworks WSI Cyprus bulk SMS platform User Guide
 
Eworks WSI Cyprus 2012 Mobilemarketing simplified
Eworks WSI Cyprus 2012 Mobilemarketing simplifiedEworks WSI Cyprus 2012 Mobilemarketing simplified
Eworks WSI Cyprus 2012 Mobilemarketing simplified
 
Social media in travel & tourism best practices
Social media in travel & tourism  best practicesSocial media in travel & tourism  best practices
Social media in travel & tourism best practices
 
Eworks WSI Cyprus: Online reputation Mangement
Eworks WSI Cyprus: Online reputation MangementEworks WSI Cyprus: Online reputation Mangement
Eworks WSI Cyprus: Online reputation Mangement
 
Converting visitors into customers
Converting visitors into customersConverting visitors into customers
Converting visitors into customers
 
3 fifty7 Music Agency Presentation by EworksWSI
3 fifty7   Music Agency Presentation by EworksWSI3 fifty7   Music Agency Presentation by EworksWSI
3 fifty7 Music Agency Presentation by EworksWSI
 
Eworks wsi cyprus wsi google adwords
Eworks wsi cyprus wsi google adwordsEworks wsi cyprus wsi google adwords
Eworks wsi cyprus wsi google adwords
 

Recently uploaded

Arti Languages Pre Seed Teaser Deck 2024.pdf
Arti Languages Pre Seed Teaser Deck 2024.pdfArti Languages Pre Seed Teaser Deck 2024.pdf
Arti Languages Pre Seed Teaser Deck 2024.pdfwill854175
 
Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024Marel
 
Rice Manufacturers in India | Shree Krishna Exports
Rice Manufacturers in India | Shree Krishna ExportsRice Manufacturers in India | Shree Krishna Exports
Rice Manufacturers in India | Shree Krishna ExportsShree Krishna Exports
 
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai KuwaitThe Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwaitdaisycvs
 
Uneak White's Personal Brand Exploration Presentation
Uneak White's Personal Brand Exploration PresentationUneak White's Personal Brand Exploration Presentation
Uneak White's Personal Brand Exploration Presentationuneakwhite
 
Call 7737669865 Vadodara Call Girls Service at your Door Step Available All Time
Call 7737669865 Vadodara Call Girls Service at your Door Step Available All TimeCall 7737669865 Vadodara Call Girls Service at your Door Step Available All Time
Call 7737669865 Vadodara Call Girls Service at your Door Step Available All Timegargpaaro
 
Falcon Invoice Discounting: Tailored Financial Wings
Falcon Invoice Discounting: Tailored Financial WingsFalcon Invoice Discounting: Tailored Financial Wings
Falcon Invoice Discounting: Tailored Financial WingsFalcon Invoice Discounting
 
joint cost.pptx COST ACCOUNTING Sixteenth Edition ...
joint cost.pptx  COST ACCOUNTING  Sixteenth Edition                          ...joint cost.pptx  COST ACCOUNTING  Sixteenth Edition                          ...
joint cost.pptx COST ACCOUNTING Sixteenth Edition ...NadhimTaha
 
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...ssuserf63bd7
 
Mckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for ViewingMckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for ViewingNauman Safdar
 
Structuring and Writing DRL Mckinsey (1).pdf
Structuring and Writing DRL Mckinsey (1).pdfStructuring and Writing DRL Mckinsey (1).pdf
Structuring and Writing DRL Mckinsey (1).pdflaloo_007
 
Falcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investorsFalcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investorsFalcon Invoice Discounting
 
How to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League CityHow to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League CityEric T. Tung
 
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...meghakumariji156
 
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in OmanMifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Omaninstagramfab782445
 
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdfDr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdfAdmir Softic
 
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al MizharAl Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizharallensay1
 

Recently uploaded (20)

Arti Languages Pre Seed Teaser Deck 2024.pdf
Arti Languages Pre Seed Teaser Deck 2024.pdfArti Languages Pre Seed Teaser Deck 2024.pdf
Arti Languages Pre Seed Teaser Deck 2024.pdf
 
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabiunwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
 
Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024
 
Rice Manufacturers in India | Shree Krishna Exports
Rice Manufacturers in India | Shree Krishna ExportsRice Manufacturers in India | Shree Krishna Exports
Rice Manufacturers in India | Shree Krishna Exports
 
!~+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUD...
!~+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUD...!~+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUD...
!~+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUD...
 
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai KuwaitThe Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
 
Uneak White's Personal Brand Exploration Presentation
Uneak White's Personal Brand Exploration PresentationUneak White's Personal Brand Exploration Presentation
Uneak White's Personal Brand Exploration Presentation
 
Call 7737669865 Vadodara Call Girls Service at your Door Step Available All Time
Call 7737669865 Vadodara Call Girls Service at your Door Step Available All TimeCall 7737669865 Vadodara Call Girls Service at your Door Step Available All Time
Call 7737669865 Vadodara Call Girls Service at your Door Step Available All Time
 
Falcon Invoice Discounting: Tailored Financial Wings
Falcon Invoice Discounting: Tailored Financial WingsFalcon Invoice Discounting: Tailored Financial Wings
Falcon Invoice Discounting: Tailored Financial Wings
 
joint cost.pptx COST ACCOUNTING Sixteenth Edition ...
joint cost.pptx  COST ACCOUNTING  Sixteenth Edition                          ...joint cost.pptx  COST ACCOUNTING  Sixteenth Edition                          ...
joint cost.pptx COST ACCOUNTING Sixteenth Edition ...
 
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...
Horngren’s Cost Accounting A Managerial Emphasis, Canadian 9th edition soluti...
 
Mckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for ViewingMckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for Viewing
 
Structuring and Writing DRL Mckinsey (1).pdf
Structuring and Writing DRL Mckinsey (1).pdfStructuring and Writing DRL Mckinsey (1).pdf
Structuring and Writing DRL Mckinsey (1).pdf
 
Falcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investorsFalcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investors
 
How to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League CityHow to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League City
 
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
 
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in OmanMifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
Mifepristone Available in Muscat +918761049707^^ €€ Buy Abortion Pills in Oman
 
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdfDr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
 
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al MizharAl Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
 
Buy gmail accounts.pdf buy Old Gmail Accounts
Buy gmail accounts.pdf buy Old Gmail AccountsBuy gmail accounts.pdf buy Old Gmail Accounts
Buy gmail accounts.pdf buy Old Gmail Accounts
 

Eworks WSI Cyprus online testing oct 2010

  • 1. Online Testing – the  O li T i h light in the tunnel light in the tunnel October, 2010
  • 2. AGENDA • What is Online Testing? What is Online Testing? • How is it working? • Variables of Success i bl fS • Case Studies • Conversion Optimization Consulting
  • 3. What is Online Testing? Online Testing (OL) Definition: Online Testing (OL) Definition: In a nutshell, online testing  involves testing one or more  g variable from a webpage to  identify which ones can create a  positive difference in the  conversion.  The winning variable then  h bl h becomes the control, or bench  mark, which future ones are  mark which future ones are measured against.
  • 4. Online Testing Steps Scientific testing involves the following steps: 1) Determining which element(s) of a page you want to test.  2) Creating the test / the test page 3) Setting up the tool use for the testing 3) Setting up the tool use for the testing 4) Keeping good, accurate test records. 5) Running the test campaign. 6) Tracking and comparing results to determine which test variable is the  6) ki d i l d i hi h i bl i h winner. (100 conversions) 7) Repeating the cycle, constantly attempting to beat your existing control
  • 5. Categories of Online Testing • A/B test, Split test / , p • MVT ‐Multivariable test Page 1: Control (the original) Page 1: Control (the original) SUBSCRIBE  SUBSCRIBE NOW SEND ME THE FREE  GUIDE NOW Page 2: Test page Page 2: Test page SEND ME  SEND ME THE FREE  THE INFO GUIDE NOW GUIDE NOW
  • 6. Time needed for testing? LONGER Test Period SHORTER Test Period # of Alternatives /  More (MVT) Less (A/B) Variables Difference in Results Lesser Greater Traffic Volume Less More Confidence Level Higher > 90% Lower < 90% 100 conversions
  • 10. Risks? What Risks? • All Test Types are not All Test Types are not  Equal • Comparing & Contrasting  A/B and MVT A/B d MVT • The Risk of the Endless  Test
  • 11. KEY principles for online tests Test Methodology – Is A Process ! – Single Variable Test Formula • The most important tool for performing a useful experiment The most important tool for performing a useful experiment.  – The (relevant) Academic Vocabulary • There are Concepts, Terminology, Differences between Variable • Understand and Use them Properly d d d h l – Test Protocol • Use proper tool organizes each stage of the test process and  automatically calculates all of the key equations.
  • 12. KEY principles for online tests Test Validity y • Understanding of validity principles, so that you can be  confident in the results of your test. – The Threats to Test Validity • "history effect",  • "instrumentation error" "instrumentation error" • "sample distortion” – The Sample Size Validity The Sample Size Validity • The key mathematical equations for determining test  size. – The Validity Formula
  • 13. KEY principles for online tests Test Planning • Which variables to test?  – Knowing what to test is as important as knowing how to test.  – The Optimization Formula • Prioritize your testing goals Prioritize your testing goals.  • More revenue = right order. – The Test ROI Calculation Tool • Calculates the compounding ROI on a given series of tests.  • Saves time and money as it helps you determine the impact of each  test on your marketing budget. – Radical Redesigns • How to capture multi‐variable test results with single variable testing  techniques q
  • 14. What’s the big deal about Online  Testing? • Online Testing: Online Testing: – Motivation – Value proposition Value proposition – Incentive –A i t Anxiety – Friction  C = 4m + 3v + 2(i f) -2a © 2(i-f) 2a
  • 15. When? • How would you Know WHEN need TO APPLY this strategy? hi ? • The right answer:  • ALL THE TIME there is an ALL THE TIME there is an  Opportunity pp y • Amazon – case study:  200 live online tests running every day 200 li li t t i d
  • 16. Case Study 2‐ The Formula! 816% Growth in New Subscribers ORIGINAL TEST
  • 18. Case Study 3‐ Treatment 100% Money BacK Guarantee – Eliminating anxietY Call to Actions highlighting the benefits
  • 20. Case Study 4: Is It Worth it? Professional Photographer g p • Status: – New site – Artistic / flash / – Minimum content – No commercial aspect • Goals: – To get New Clients • Strategies: – They decided to do PPC – Adding some wedding pictures on the actual site Adding some wedding pictures on the actual site
  • 21. Case Study 4 – cont. • Our proposal: Our proposal: – Landing Page g g • Reaction: – Fighting • Agreement: – Online Testing 
  • 22. Case Study 4 – cont. • Results: – Our page performed better: 71.6% improvement  in conversion (contacts) in conversion (contacts) • The client got 4 wedding contracts, with an  online marketing budget of 3.5% spent online marketing budget of 3 5% spent
  • 24. Oak Photography LP Differences
  • 25. ATTENTION • Controversy about Best Practices Controversy about Best Practices • Example: Video on AutoStart or  Press Play l
  • 26. Case Study 5 ‐ controversy Video Play Not Play Vid – Pl or N t Pl ? 63% improvement in conversion with Video on autoplay
  • 27. CONCLUSIONS • Do not go Blind with  your marketing  your marketing • Focus your money and  resources where it  counts • Get confirmation you  are on the right track g
  • 28. Conversion Optimization Eworks WSI Cyprus: • Consulting Services Consulting Services • Landing Page / Website / Email  Marketing M k ti • Report (14‐20 variables analyzed) • 100% Money Back Guarantee  (certain conditions apply) • Our Clients Implement 95‐100 %  of our recommendations of our recommendations
  • 29. EworksWSI Cyprus SERVICES: - Webdesign - Interactive Content ( g (digital p publishing) g) - Landing Pages Design -Digital Marketing - Website Conversion Optimization Optimi ation - Flash Content - Landing Pages - Print Design Conversion Optimization p - Logo Design - Email Marketing Conversion Optimization CONTACT INFO:  info@eworkswsi.com.cy i f @ k i +35799‐555747 www.EworksWSI.com.cy www EworksWSI com cy
  • 30. PROMO ! ONLY for our clients: ONLY for our clients: ‐ Until Dec 31, 2010 ‐ O li Online testing discounted f i di d from €500 to €300 € 00 €300 ‐ A d hi i And this is not all …… ll
  • 31. PROMO ! Package 1: Package 2: Package 3: 1 sample design 2 sample design 2 sample design Cost Package: Cost Package: 1 Online Testing €450  €450 €600  €600 Cost Package:  Cost Package: (Information  (Information  €685 Architecture Doc  Architecture Doc Architecture Doc  Architecture Doc (Information  (Information completed) completed) Architecture Doc  completed)
  • 32. Contact  Eworks WSI Cyprus Contact us for more info Contact us for more info Eworks WSI Cyprus k S C info@eworkswsi.com.cy www.eworkswsi.com.cy www eworkswsi com cy Tel: +357‐99555747