SlideShare uma empresa Scribd logo
1 de 25
Baixar para ler offline
OPTIMIZELY: A/B
TESTING MADE EASY
Chris Castiglione
@castig
OPTIMIZELY: A/B TESTING MADE EASY


VOCABULARY
OPTIMIZING LANDING PAGES FOR CONVERSION


VOCABULARY
A/B Test

Call to Action (CTA)

Experiment

Control (or “The Original)

Multivariate Test
OPTIMIZELY: A/B TESTING MADE EASY


WHY A/B TESTING?
A/B TEST
HYPOTHESIS #1: LONGER PAGE
HYPOTHESIS #1: LONGER PAGE
HYPOTHESIS #2: PERSON
HYPOTHESIS #3: LONG PAGE + PERSON
HYPOTHESIS #3: LONG PAGE + PERSON
HYPOTHESIS #4: CHANGING PEOPLE
HYPOTHESIS #4: CHANGING PEOPLE
OPTIMIZING LANDING PAGES FOR CONVERSION


CONCLUSION
Page length is an important variable

Big photos of smiling customers work
OPTIMIZELY: A/B TESTING MADE EASY


SETTING UP AN
OPTIMIZELY
EXPERIMENT
OPTIMIZELY: A/B TESTING MADE EASY


IMPLEMENTING THE
PROJECT CODE
Q&A
Q:   What should I test?
WHAT TO TEST
Short page vs. Long Page

Headline Text

Buttons

Form fields
Q:   Is it possible to target
     specific users?
TARGETING
Language

Browser

Visitor Type (new vs. returning)

IP

Referrer

Custom Events
Q:   Can I specify the
     amount of traffic that
     comes to my
     experiment?
SPECIFY THE AMOUNT OF TRAFFIC
OPTIONS -> Traffic Allocation
Q:   What effect does the
     JavaScript project
     code have on page
     performance?
PAGE PERFORMANCE
Around 35-40kb (very small!)

The code run from Optimizely’s CDN

Mais conteúdo relacionado

Semelhante a A/B Testing Made Easy with Optimizely

How to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel PersonalizationHow to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel PersonalizationCXL
 
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...Manuel Da Costa
 
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...Optimizely
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Optimizely
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Optimizely
 
Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!SQALab
 
Optimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testingOptimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testingJavid Jamae
 
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean ProjectsA Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean ProjectsRod King, Ph.D.
 
Ilasi-Engineer-Resume
Ilasi-Engineer-ResumeIlasi-Engineer-Resume
Ilasi-Engineer-ResumeMichael Ilasi
 
Michael D. Rapp Csm, Oshp2
Michael D. Rapp  Csm, Oshp2Michael D. Rapp  Csm, Oshp2
Michael D. Rapp Csm, Oshp2Michael D. Rapp
 
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...Internet Marketing Software - WordStream
 
Improve your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B TestingImprove your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B Testingintrotodigital
 
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management [Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management Optimizely
 
Transforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley HunsbergerTransforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley HunsbergerSauce Labs
 

Semelhante a A/B Testing Made Easy with Optimizely (16)

How to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel PersonalizationHow to Execute and A/B Test Cross-Channel Personalization
How to Execute and A/B Test Cross-Channel Personalization
 
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
The sensationalisation of A/B Testing & Why it doesn't work for you - Measure...
 
8520687 product
8520687 product8520687 product
8520687 product
 
Growth for Early Stage Startups
Growth for Early Stage StartupsGrowth for Early Stage Startups
Growth for Early Stage Startups
 
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them
 
Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!Test Cases are dead, long live Checklists!
Test Cases are dead, long live Checklists!
 
Optimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testingOptimizing website conversions through A/B split testing
Optimizing website conversions through A/B split testing
 
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean ProjectsA Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
A Simple Metric for Designing, Evaluating, and Managing Blue Ocean Projects
 
Ilasi-Engineer-Resume
Ilasi-Engineer-ResumeIlasi-Engineer-Resume
Ilasi-Engineer-Resume
 
Michael D. Rapp Csm, Oshp2
Michael D. Rapp  Csm, Oshp2Michael D. Rapp  Csm, Oshp2
Michael D. Rapp Csm, Oshp2
 
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
A WordStream & KISSmetrics Webinar: A/B Testing; You’re Most Likely Doing It ...
 
Improve your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B TestingImprove your content: The What, Why, Where and How about A/B Testing
Improve your content: The What, Why, Where and How about A/B Testing
 
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management [Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
 
Transforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley HunsbergerTransforming Culture Using DevOps Principles by Ashley Hunsberger
Transforming Culture Using DevOps Principles by Ashley Hunsberger
 

Mais de Chris Castiglione

Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...Chris Castiglione
 
Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo Chris Castiglione
 
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015Chris Castiglione
 
Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015Chris Castiglione
 
Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013Chris Castiglione
 

Mais de Chris Castiglione (9)

Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
Bitcoin, Ethereum, and Blockchain - Digital Literacy @ Columbia University Bu...
 
Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo Food is confusing: Plant vs. Paleo
Food is confusing: Plant vs. Paleo
 
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
The China study and Plant Based Protein - NYC Vegetarian Food Festival 2015
 
Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015Programming For Non-Programmers Social Media Week 2015
Programming For Non-Programmers Social Media Week 2015
 
Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013Programming For Non-Programmers: 2013
Programming For Non-Programmers: 2013
 
Wordpress
WordpressWordpress
Wordpress
 
Up & Running Web Hosting
Up & Running Web HostingUp & Running Web Hosting
Up & Running Web Hosting
 
PHP vs. Ruby on Rails
PHP vs. Ruby on RailsPHP vs. Ruby on Rails
PHP vs. Ruby on Rails
 
Ids classes-floats
Ids classes-floatsIds classes-floats
Ids classes-floats
 

Último

Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 

Último (20)

Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 

A/B Testing Made Easy with Optimizely