Enviar pesquisa
Carregar
A/B Testing - In data we trust
•
0 gostou
•
1,011 visualizações
Pedro Marques
Seguir
Talk/Workshop at the CI&T Digital Day 2015 in Belo Horizonte
Leia menos
Leia mais
Dados e análise
Vista de apresentação de diapositivos
Denunciar
Compartilhar
Vista de apresentação de diapositivos
Denunciar
Compartilhar
1 de 46
Baixar agora
Baixar para ler offline
Recomendados
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conver...
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conver...
Maria Lígia Klokner
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing
Janessa Lantz
Booking.com - Data science and experimentation at Booking.com: a data-driven ...
Booking.com - Data science and experimentation at Booking.com: a data-driven ...
BigDataExpo
Taming The HiPPO
Taming The HiPPO
Google A/NZ
The Top 5 Ecommerce Tests You Should Run Right Now
The Top 5 Ecommerce Tests You Should Run Right Now
Optimizely
Ab testing 101
Ab testing 101
Ashish Dua
It Worked for Ustream
It Worked for Ustream
Balázs Kereskényi
How to convert visitors to customers
How to convert visitors to customers
Experiments
Recomendados
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conver...
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conver...
Maria Lígia Klokner
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing
Janessa Lantz
Booking.com - Data science and experimentation at Booking.com: a data-driven ...
Booking.com - Data science and experimentation at Booking.com: a data-driven ...
BigDataExpo
Taming The HiPPO
Taming The HiPPO
Google A/NZ
The Top 5 Ecommerce Tests You Should Run Right Now
The Top 5 Ecommerce Tests You Should Run Right Now
Optimizely
Ab testing 101
Ab testing 101
Ashish Dua
It Worked for Ustream
It Worked for Ustream
Balázs Kereskényi
How to convert visitors to customers
How to convert visitors to customers
Experiments
Conversion Optimization in Practice: BaconBiz 2013
Conversion Optimization in Practice: BaconBiz 2013
Patrick McKenzie
Goodtests
Goodtests
fxsperling
Ecommerce Test Ideation: What to Optimize and Why
Ecommerce Test Ideation: What to Optimize and Why
Optimizely
Trial engineering moving parts
Trial engineering moving parts
SV.CO
How to Innovate for Profit - insideinnovation.co
How to Innovate for Profit - insideinnovation.co
Leslie Barry
Opticon 2015-Early Lessons in Personalization Strategy
Opticon 2015-Early Lessons in Personalization Strategy
Optimizely
Opticon 2015-Optimization at Optimizely
Opticon 2015-Optimization at Optimizely
Optimizely
Agile India: Working without Product Owner
Agile India: Working without Product Owner
Maaret Pyhäjärvi
The persuasive architecture of 7jaargarantie.be – 7ansdegarantie.be
The persuasive architecture of 7jaargarantie.be – 7ansdegarantie.be
Peter Coopmans
AGRS2019: Breaking illusions with Testing
AGRS2019: Breaking illusions with Testing
Maaret Pyhäjärvi
MEMSI June: DE2 - What can you do for your customer?
MEMSI June: DE2 - What can you do for your customer?
Elaine Chen
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
Optimizely
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Future Insights
Opticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to Champion
Optimizely
LeanStartup Challenge Presentation
LeanStartup Challenge Presentation
Elizabeth Yin
Get Going Workshop - Web 2.0 Expo
Get Going Workshop - Web 2.0 Expo
Elizabeth Yin
Top Ten Conversion Optimization Tips for Marketing Success
Top Ten Conversion Optimization Tips for Marketing Success
Chris Goward
Developer Night - Opticon18
Developer Night - Opticon18
Optimizely
Crafting Software Products
Crafting Software Products
Sarah Allen
The making of rapid prototype a web love story
The making of rapid prototype a web love story
Anil Kumar Krishnashetty
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
Product School
Flip Conference at E-Commerce Stockholm 2015
Flip Conference at E-Commerce Stockholm 2015
Thomas TONDER
Mais conteúdo relacionado
Mais procurados
Conversion Optimization in Practice: BaconBiz 2013
Conversion Optimization in Practice: BaconBiz 2013
Patrick McKenzie
Goodtests
Goodtests
fxsperling
Ecommerce Test Ideation: What to Optimize and Why
Ecommerce Test Ideation: What to Optimize and Why
Optimizely
Trial engineering moving parts
Trial engineering moving parts
SV.CO
How to Innovate for Profit - insideinnovation.co
How to Innovate for Profit - insideinnovation.co
Leslie Barry
Opticon 2015-Early Lessons in Personalization Strategy
Opticon 2015-Early Lessons in Personalization Strategy
Optimizely
Opticon 2015-Optimization at Optimizely
Opticon 2015-Optimization at Optimizely
Optimizely
Agile India: Working without Product Owner
Agile India: Working without Product Owner
Maaret Pyhäjärvi
The persuasive architecture of 7jaargarantie.be – 7ansdegarantie.be
The persuasive architecture of 7jaargarantie.be – 7ansdegarantie.be
Peter Coopmans
AGRS2019: Breaking illusions with Testing
AGRS2019: Breaking illusions with Testing
Maaret Pyhäjärvi
MEMSI June: DE2 - What can you do for your customer?
MEMSI June: DE2 - What can you do for your customer?
Elaine Chen
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
Optimizely
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Future Insights
Opticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to Champion
Optimizely
LeanStartup Challenge Presentation
LeanStartup Challenge Presentation
Elizabeth Yin
Get Going Workshop - Web 2.0 Expo
Get Going Workshop - Web 2.0 Expo
Elizabeth Yin
Top Ten Conversion Optimization Tips for Marketing Success
Top Ten Conversion Optimization Tips for Marketing Success
Chris Goward
Developer Night - Opticon18
Developer Night - Opticon18
Optimizely
Mais procurados
(18)
Conversion Optimization in Practice: BaconBiz 2013
Conversion Optimization in Practice: BaconBiz 2013
Goodtests
Goodtests
Ecommerce Test Ideation: What to Optimize and Why
Ecommerce Test Ideation: What to Optimize and Why
Trial engineering moving parts
Trial engineering moving parts
How to Innovate for Profit - insideinnovation.co
How to Innovate for Profit - insideinnovation.co
Opticon 2015-Early Lessons in Personalization Strategy
Opticon 2015-Early Lessons in Personalization Strategy
Opticon 2015-Optimization at Optimizely
Opticon 2015-Optimization at Optimizely
Agile India: Working without Product Owner
Agile India: Working without Product Owner
The persuasive architecture of 7jaargarantie.be – 7ansdegarantie.be
The persuasive architecture of 7jaargarantie.be – 7ansdegarantie.be
AGRS2019: Breaking illusions with Testing
AGRS2019: Breaking illusions with Testing
MEMSI June: DE2 - What can you do for your customer?
MEMSI June: DE2 - What can you do for your customer?
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Opticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to Champion
LeanStartup Challenge Presentation
LeanStartup Challenge Presentation
Get Going Workshop - Web 2.0 Expo
Get Going Workshop - Web 2.0 Expo
Top Ten Conversion Optimization Tips for Marketing Success
Top Ten Conversion Optimization Tips for Marketing Success
Developer Night - Opticon18
Developer Night - Opticon18
Semelhante a A/B Testing - In data we trust
Crafting Software Products
Crafting Software Products
Sarah Allen
The making of rapid prototype a web love story
The making of rapid prototype a web love story
Anil Kumar Krishnashetty
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
Product School
Flip Conference at E-Commerce Stockholm 2015
Flip Conference at E-Commerce Stockholm 2015
Thomas TONDER
Exploring Design in Mobile: Testing with 3D Printed Prototypes
Exploring Design in Mobile: Testing with 3D Printed Prototypes
Niiu Digital Inc.
Intensive Workshop:Building Apps -Idea to Release- for Non-Techie Entrepreneurs
Intensive Workshop:Building Apps -Idea to Release- for Non-Techie Entrepreneurs
ideatoipo
Hypothesis focused SEO - Tom Anthony
Hypothesis focused SEO - Tom Anthony
Eventz.Digital
SEO by Hypothesis
SEO by Hypothesis
Tom Anthony
ASP.NET 5 & Unit Testing
ASP.NET 5 & Unit Testing
Shahed Chowdhuri
Design + Development + Devices: The 3 Ds of 3-D Products
Design + Development + Devices: The 3 Ds of 3-D Products
Courtney Hemphill
Lean/Agile/DevOps 2016 part 2
Lean/Agile/DevOps 2016 part 2
Diego Pacheco
How to Test Your Product Ideas by SoulCycle VP of Product
How to Test Your Product Ideas by SoulCycle VP of Product
Product School
Supercharge Your Testing Program
Supercharge Your Testing Program
Optimizely
Analytics in Action: How to Build Data-Informed Products
Analytics in Action: How to Build Data-Informed Products
Aggregage
Analytics in Action: How to Build Data-Informed Products
Analytics in Action: How to Build Data-Informed Products
Hannah Flynn
EBMS Social Media Part 2
EBMS Social Media Part 2
McKee-Pownall Equine Services
Driving Value Creation with A/B Testing & OKR
Driving Value Creation with A/B Testing & OKR
Product School
What are Examples of Product Fallacies by PayPal Principal PM
What are Examples of Product Fallacies by PayPal Principal PM
Product School
{PubCon Vegas 2019} The Business Value of Tech SEO
{PubCon Vegas 2019} The Business Value of Tech SEO
Jennifer Hoffman
Mobile conversion optimization - Lightspeed Connect Event 2017
Mobile conversion optimization - Lightspeed Connect Event 2017
valantic NL
Semelhante a A/B Testing - In data we trust
(20)
Crafting Software Products
Crafting Software Products
The making of rapid prototype a web love story
The making of rapid prototype a web love story
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
Flip Conference at E-Commerce Stockholm 2015
Flip Conference at E-Commerce Stockholm 2015
Exploring Design in Mobile: Testing with 3D Printed Prototypes
Exploring Design in Mobile: Testing with 3D Printed Prototypes
Intensive Workshop:Building Apps -Idea to Release- for Non-Techie Entrepreneurs
Intensive Workshop:Building Apps -Idea to Release- for Non-Techie Entrepreneurs
Hypothesis focused SEO - Tom Anthony
Hypothesis focused SEO - Tom Anthony
SEO by Hypothesis
SEO by Hypothesis
ASP.NET 5 & Unit Testing
ASP.NET 5 & Unit Testing
Design + Development + Devices: The 3 Ds of 3-D Products
Design + Development + Devices: The 3 Ds of 3-D Products
Lean/Agile/DevOps 2016 part 2
Lean/Agile/DevOps 2016 part 2
How to Test Your Product Ideas by SoulCycle VP of Product
How to Test Your Product Ideas by SoulCycle VP of Product
Supercharge Your Testing Program
Supercharge Your Testing Program
Analytics in Action: How to Build Data-Informed Products
Analytics in Action: How to Build Data-Informed Products
Analytics in Action: How to Build Data-Informed Products
Analytics in Action: How to Build Data-Informed Products
EBMS Social Media Part 2
EBMS Social Media Part 2
Driving Value Creation with A/B Testing & OKR
Driving Value Creation with A/B Testing & OKR
What are Examples of Product Fallacies by PayPal Principal PM
What are Examples of Product Fallacies by PayPal Principal PM
{PubCon Vegas 2019} The Business Value of Tech SEO
{PubCon Vegas 2019} The Business Value of Tech SEO
Mobile conversion optimization - Lightspeed Connect Event 2017
Mobile conversion optimization - Lightspeed Connect Event 2017
Último
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
vexqp
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
gajnagarg
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
gajnagarg
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt
ibrahimabdi22
PLE-statistics document for primary schs
PLE-statistics document for primary schs
cnajjemba
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
Timothy Spann
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
Elaine Werffeli
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
vexqp
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
wsppdmt
Digital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham Ware
Graham Ware
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Valters Lauzums
Dubai Call Girls Peeing O525547819 Call Girls Dubai
Dubai Call Girls Peeing O525547819 Call Girls Dubai
kojalkojal131
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
GovindSinghDasila
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
LakpaYanziSherpa
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
nirzagarg
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
ranjankumarbehera14
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
ahmedjiabur940
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
EfruzAsilolu
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
gajnagarg
Último
(20)
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In bhavnagar [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt
PLE-statistics document for primary schs
PLE-statistics document for primary schs
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
Digital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham Ware
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Dubai Call Girls Peeing O525547819 Call Girls Dubai
Dubai Call Girls Peeing O525547819 Call Girls Dubai
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
A/B Testing - In data we trust
1.
A/B TESTING In data
we trust! Pedro Marques CI&T Digital Day
2.
PEDRO MARQUES UX Designer
@ booking.com @pmarquees
3.
700k Properties 135 Offices 207 Countries 42 Languages 74 Currencies 8.5k Employees 8k Servers perl + html
templates Core 3º MAIOR e-commerce do mundo
4.
5.
A/B Testing WTF?
6.
Emojiana
7.
Emojiana Hippo
8.
50% 50% 11% 2%
9.
Born at Google Early
00’s
10.
Pharmaceutical To test new
drugs
11.
But why A/B
Test?
12.
No Regression
13.
But bear in
mind:
14.
A/B Test will prove
you wrong
15.
Data never lies
16.
Define your KPI’s
17.
Correlation does NOT imply
causation
18.
Conver$ion
19.
User performs a given
action
20.
Define your KPI's
21.
What should I
test?
22.
23.
Test all your
hypothesis
24.
Assumption is the mother
of all fuck ups
25.
Framing Effect
26.
A/B Testing Kills creativity
27.
Junior designers X Sr.
Designes https://medium.com/the-year-of-the-looking-glass/junior-designers-vs-senior-designers-fbe483d3b51e
28.
29.
30.
Would like fries
with that? http://blog.booking.com/hamburger-menu.html
31.
32.
No significant impact. At
all.
33.
NICE! But how do
I do that?
34.
Coin flip
35.
https://www.optimizely.com
36.
Now what? Data analysis
is the key
37.
Some advices These are
mine, test and see if it works for you =)
38.
Shit X Shit Nope,
a big nope.
39.
Ask questions Even before
starting the experiment
40.
Dont trust the
gurus This is science, not religion
41.
Flip the coin
properly Calculate the amount of time and sample that you need https://vwo.com/ab-split-test-duration/
42.
A/B Testing is
a big subject
43.
44.
Link
45.
46.
Thank you folks!
<3 hey@pedromarques.io @pmarquees
Baixar agora