SlideShare uma empresa Scribd logo
1 de 13
Baixar para ler offline
How To Interpret Your A/B Testing Results
For Actionable Insights
Utkarsh Rai
Product Marketer, VWO
Anshul Gurbaxani
Product Manager, VWO
Ashwin Gupta
Growth, VWO
Ask Questions on Twitter
#AskVWO
Ashwin @ashwin_gupta
Utkarsh @rutkarsh
Anshul @anshulgurbaxani
What are we covering today?
01 How To Read Your A/B Testing Report
02 The Art of Conducting Post Test Analysis
03 Things to avoid while evaluating your reports
Reading Your Test Report
How To Interpret Your A/B Testing Results For Actionable Insights
Get a quick look at test
results and recommended
action from Smart
Notifications.
Post Test Analysis #1
How To Interpret Your A/B Testing Results For Actionable Insights
Talent Recruitment
Website
Talent Recruitment Website - The Case Study
How To Interpret Your A/B Testing Results For Actionable Insights
Increase in recruiters signups
Talent Recruitment Website - The Case Study
How To Interpret Your A/B Testing Results For Actionable Insights
Drop in number of students reaching the second step of the form
Talent Recruitment Website - The Case Study
How To Interpret Your A/B Testing Results For Actionable Insights
Drastic drop in overall from submits
Post Test Analysis #2
How To Interpret Your A/B Testing Results For Actionable Insights
The Ecommerce store
Online Store - The Case Study
How To Interpret Your A/B Testing Results For Actionable Insights
Overall positive improvement in purchases
Online Store - The Case Study
How To Interpret Your A/B Testing Results For Actionable Insights
Even greater improvement when segmented by new visitors
Things To Avoid While Evaluating A/B Test Report
How To Interpret Your A/B Testing Results For Actionable Insights
● Minimum number of visitors and conversions in the test
● If you segment your results - beware of the meaningless segments
● Don’t call you tests too early
● Multiple tests can overlap!
Titleofyourpresentation-Appcues.com
Thank You!
Q&A
Use #AskVWO To Ask Questions on Twitter

Mais conteúdo relacionado

Mais de VWO

Mais de VWO (20)

Unifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfUnifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdf
 
Run more experiments with fewer resources
Run more experiments with fewer resourcesRun more experiments with fewer resources
Run more experiments with fewer resources
 
Crafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing PagesCrafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing Pages
 
Diseñando según la regulación actual de cookies para lograr más conversión
Diseñando según la regulación actual de cookies para lograr más conversiónDiseñando según la regulación actual de cookies para lograr más conversión
Diseñando según la regulación actual de cookies para lograr más conversión
 
VWO - Mark de Winter - Run more experiments with fewer resources.pdf
VWO - Mark de Winter - Run more experiments with fewer resources.pdfVWO - Mark de Winter - Run more experiments with fewer resources.pdf
VWO - Mark de Winter - Run more experiments with fewer resources.pdf
 
Turn Website Visits into Conversions (2).pdf
Turn Website Visits into Conversions (2).pdfTurn Website Visits into Conversions (2).pdf
Turn Website Visits into Conversions (2).pdf
 
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...Principales obstáculos de la experimentación y cómo abordarlos en StartUps...
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...
 
Understand user struggles. Optimize mobile app UX.
Understand user struggles. Optimize mobile app UX.Understand user struggles. Optimize mobile app UX.
Understand user struggles. Optimize mobile app UX.
 
Turn Website Visits into Conversions (1).pdf
Turn Website Visits into Conversions (1).pdfTurn Website Visits into Conversions (1).pdf
Turn Website Visits into Conversions (1).pdf
 
Converting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CROConverting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CRO
 
Optimizing Mobile App UX for better engagement & conversions.pptx
Optimizing Mobile App UX for better engagement & conversions.pptxOptimizing Mobile App UX for better engagement & conversions.pptx
Optimizing Mobile App UX for better engagement & conversions.pptx
 
Optimizing Mobile App UX for better engagement & conversions.pdf
Optimizing Mobile App UX for better engagement & conversions.pdfOptimizing Mobile App UX for better engagement & conversions.pdf
Optimizing Mobile App UX for better engagement & conversions.pdf
 
7 puntos clave y prácticos en todo proyecto de CRO
7 puntos clave y prácticos en todo proyecto de CRO7 puntos clave y prácticos en todo proyecto de CRO
7 puntos clave y prácticos en todo proyecto de CRO
 
Tackling Conversion Problems with Personalization | VWO Webinars
Tackling Conversion Problems with Personalization | VWO WebinarsTackling Conversion Problems with Personalization | VWO Webinars
Tackling Conversion Problems with Personalization | VWO Webinars
 
Turning Business Challenges into Testable Ideas - 29 Nov '23.pdf
Turning Business Challenges into Testable Ideas - 29 Nov '23.pdfTurning Business Challenges into Testable Ideas - 29 Nov '23.pdf
Turning Business Challenges into Testable Ideas - 29 Nov '23.pdf
 
First 30 days of Your CRO Program
First 30 days of Your CRO ProgramFirst 30 days of Your CRO Program
First 30 days of Your CRO Program
 
How to Embed Emotions in Experimental Design
How to Embed Emotions in Experimental DesignHow to Embed Emotions in Experimental Design
How to Embed Emotions in Experimental Design
 
El arte de generar ideas de experimentación que impulsen resultados
El arte de generar ideas de experimentación que impulsen resultadosEl arte de generar ideas de experimentación que impulsen resultados
El arte de generar ideas de experimentación que impulsen resultados
 
Estrategias de CRO más allá de la conversión: evolución de la experiencia de ...
Estrategias de CRO más allá de la conversión: evolución de la experiencia de ...Estrategias de CRO más allá de la conversión: evolución de la experiencia de ...
Estrategias de CRO más allá de la conversión: evolución de la experiencia de ...
 
Webinar_ Demystifying A_B Testing_ Simplified Success for Your Campaigns (1).pdf
Webinar_ Demystifying A_B Testing_ Simplified Success for Your Campaigns (1).pdfWebinar_ Demystifying A_B Testing_ Simplified Success for Your Campaigns (1).pdf
Webinar_ Demystifying A_B Testing_ Simplified Success for Your Campaigns (1).pdf
 

Último

Brand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdfBrand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdf
tbatkhuu1
 
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
dollysharma2066
 
Brand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdfBrand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdf
tbatkhuu1
 

Último (20)

Labour Day Celebrating Workers and Their Contributions.pptx
Labour Day Celebrating Workers and Their Contributions.pptxLabour Day Celebrating Workers and Their Contributions.pptx
Labour Day Celebrating Workers and Their Contributions.pptx
 
Podcast Marketing Master Class - Roger Nairn
Podcast Marketing Master Class - Roger NairnPodcast Marketing Master Class - Roger Nairn
Podcast Marketing Master Class - Roger Nairn
 
How to utilize calculated properties in your HubSpot setups
How to utilize calculated properties in your HubSpot setupsHow to utilize calculated properties in your HubSpot setups
How to utilize calculated properties in your HubSpot setups
 
personal branding kit for music business
personal branding kit for music businesspersonal branding kit for music business
personal branding kit for music business
 
Brand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdfBrand experience Dream Center Peoria Presentation.pdf
Brand experience Dream Center Peoria Presentation.pdf
 
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Majnu.Ka.Tilla Delhi Contact Us 8377877756
 
Instant Digital Issuance: An Overview With Critical First Touch Best Practices
Instant Digital Issuance: An Overview With Critical First Touch Best PracticesInstant Digital Issuance: An Overview With Critical First Touch Best Practices
Instant Digital Issuance: An Overview With Critical First Touch Best Practices
 
Cash payment girl 9257726604 Hand ✋ to Hand over girl
Cash payment girl 9257726604 Hand ✋ to Hand over girlCash payment girl 9257726604 Hand ✋ to Hand over girl
Cash payment girl 9257726604 Hand ✋ to Hand over girl
 
BDSM⚡Call Girls in Sector 150 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 150 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 150 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 150 Noida Escorts >༒8448380779 Escort Service
 
Unraveling the Mystery of the Hinterkaifeck Murders.pptx
Unraveling the Mystery of the Hinterkaifeck Murders.pptxUnraveling the Mystery of the Hinterkaifeck Murders.pptx
Unraveling the Mystery of the Hinterkaifeck Murders.pptx
 
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
 
Generative AI Master Class - Generative AI, Unleash Creative Opportunity - Pe...
Generative AI Master Class - Generative AI, Unleash Creative Opportunity - Pe...Generative AI Master Class - Generative AI, Unleash Creative Opportunity - Pe...
Generative AI Master Class - Generative AI, Unleash Creative Opportunity - Pe...
 
BDSM⚡Call Girls in Sector 128 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 128 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 128 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 128 Noida Escorts >༒8448380779 Escort Service
 
No Cookies No Problem - Steve Krull, Be Found Online
No Cookies No Problem - Steve Krull, Be Found OnlineNo Cookies No Problem - Steve Krull, Be Found Online
No Cookies No Problem - Steve Krull, Be Found Online
 
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO Success
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO SuccessBrighton SEO April 2024 - The Good, the Bad & the Ugly of SEO Success
Brighton SEO April 2024 - The Good, the Bad & the Ugly of SEO Success
 
Netflix Ads The Game Changer in Video Ads – Who Needs YouTube.pptx (Chester Y...
Netflix Ads The Game Changer in Video Ads – Who Needs YouTube.pptx (Chester Y...Netflix Ads The Game Changer in Video Ads – Who Needs YouTube.pptx (Chester Y...
Netflix Ads The Game Changer in Video Ads – Who Needs YouTube.pptx (Chester Y...
 
Situation Analysis | Management Company.
Situation Analysis | Management Company.Situation Analysis | Management Company.
Situation Analysis | Management Company.
 
Defining Marketing for the 21st Century,kotler
Defining Marketing for the 21st Century,kotlerDefining Marketing for the 21st Century,kotler
Defining Marketing for the 21st Century,kotler
 
Social Media Marketing PPT-Includes Paid media
Social Media Marketing PPT-Includes Paid mediaSocial Media Marketing PPT-Includes Paid media
Social Media Marketing PPT-Includes Paid media
 
Brand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdfBrand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdf
 

[Webinar] how to interpret your a b testing results for actionable insights

  • 1. How To Interpret Your A/B Testing Results For Actionable Insights Utkarsh Rai Product Marketer, VWO Anshul Gurbaxani Product Manager, VWO Ashwin Gupta Growth, VWO
  • 2. Ask Questions on Twitter #AskVWO Ashwin @ashwin_gupta Utkarsh @rutkarsh Anshul @anshulgurbaxani
  • 3. What are we covering today? 01 How To Read Your A/B Testing Report 02 The Art of Conducting Post Test Analysis 03 Things to avoid while evaluating your reports
  • 4. Reading Your Test Report How To Interpret Your A/B Testing Results For Actionable Insights Get a quick look at test results and recommended action from Smart Notifications.
  • 5. Post Test Analysis #1 How To Interpret Your A/B Testing Results For Actionable Insights Talent Recruitment Website
  • 6. Talent Recruitment Website - The Case Study How To Interpret Your A/B Testing Results For Actionable Insights Increase in recruiters signups
  • 7. Talent Recruitment Website - The Case Study How To Interpret Your A/B Testing Results For Actionable Insights Drop in number of students reaching the second step of the form
  • 8. Talent Recruitment Website - The Case Study How To Interpret Your A/B Testing Results For Actionable Insights Drastic drop in overall from submits
  • 9. Post Test Analysis #2 How To Interpret Your A/B Testing Results For Actionable Insights The Ecommerce store
  • 10. Online Store - The Case Study How To Interpret Your A/B Testing Results For Actionable Insights Overall positive improvement in purchases
  • 11. Online Store - The Case Study How To Interpret Your A/B Testing Results For Actionable Insights Even greater improvement when segmented by new visitors
  • 12. Things To Avoid While Evaluating A/B Test Report How To Interpret Your A/B Testing Results For Actionable Insights ● Minimum number of visitors and conversions in the test ● If you segment your results - beware of the meaningless segments ● Don’t call you tests too early ● Multiple tests can overlap!