SlideShare uma empresa Scribd logo
1 de 67
opticon2017
Kimberly Kaufman
Director, Digital Marketing Optimization
SHOWTIME
Peter Gray
Director, Optimization
Dow Jones
Hooked: How to
Succeed in the
Subscription
Economy
SITE PRIORITIES
Drive deeper engagement to retain
subscribers
Drive consumption of SHOWTIME
programming
Drive subscriptions
1
2
3
WAYS TO SUBSCRIBE & WATCH
Cable Providers
SUBSCRIPTION LEADS AS KPI
CASE STUDY NO.1
ORDER TRAY
ORIGINAL VARIATION
+10
%
ORIGINAL VARIATION 1 VARIATION 2
+57
%
STREAMING MODALCASE STUDY NO.2
vs.
+18
2%
+16
1%
vs.
+7%
vs.
+7%
HARE OF ORDER CLICKS WITHIN STREAMING MOD
2016-2017
PERSONALIZATIONCASE STUDY NO.3
+10
%
+14
%
opticon2017
KEY TAKEAWAYS
• Using device detection to enhance user experience is a
valuable way to impact KPIs
• A significant increase in one metric might have a negative
impact on other metrics on the page
• Never stop iterating – meaningful growth can be seen over
time through testing
• Validating ideas through testing is a great way to gain insight
into what to test next
opticon2017
THANK YOU
Peter Gray
24 Months of Optimization at WSJ
NET GROWTH OPTIMIZATION
The most powerful product development discipline on
earth?
What do we do?
Before we dive in . . .
Here’s Why
=
A
B
In my experience
+
NET GROWTH OPTIMIZATION
THE NON-AGENDA
WHAT WOULD BE MOST USEFUL TO
YOU.
HIGH LEVEL RECIPE FOR OUR
SUCCESS
GETTING CREDIT
WHEN PERSONALIZATION?
NOT SKIPPING THE LOW HANGING
FRUIT
NET GROWTH OPTIMIZATION
Taking Stock
Letting the optimization beat build
Metric 1st 6 Months Since
Tests 3 216
Tests/Month .5 9.8
Team 1 5
Standalone team formed summer 2015 as part of
subscription business unit.
Sole starting KPI: Acquisition
Optimization is Spreading
The Nobel Prize
for Clever Mind
Games Goes to…
Optimization
Center for
Excellence
What’s Our Recipe
A great partner agency
Evangelism
Velocity
Ruthless prioritization
$ value for our work
NET GROWTH OPTIMIZATION
How To Get Credit
Getting Credit
What about the fat cats? The big dogs?
Do you know your own ROI?
37% LIFT
Why Not
A: 50%
B: 50%
The only path to proper respect: a validated numerical value
100%
So what did we do
The Back Test
The Back Test
Jan 2016
Shop + Checkout Combined
June 2017
Shop Checkout
The Back Test
51% TOPLINE
ORDER LIFT
The Back Test
The Model
Optimization Order
Calcs
2016 2016 2016 2016 2016 2016 2016 2016 2016 2016 2016 2016 2017 2017 2017 2017 2017 2017
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun
Total WSJ Orders 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Optimization Orders 2.8 5.7 8.5 11.3 14.2 17.0 19.8 22.7 25.5 28.3 31.2 34.0 36.8 39.7 42.5 45.3 48.2 51.0
Cumulative Uplift 2.8% 5.7% 8.5% 11.3% 14.2% 17.0% 19.8% 22.7% 25.5% 28.3% 31.2% 34.0% 36.8% 39.7% 42.5% 45.3% 48.2% 51.0%
Incremental Uplift
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8% 2.8%
2.8% 2.8% 2.8%
2.8% 2.8%
2.8%
The Back Test
The Final Calculation
51% Lift
18 Months
2.8% Lift/Month
1,800 Total Orders
26.9% % of Total Orders
$1 NPV of a WSJ Order
485 Optimization Orders
$485 Optimization WSJ Acquisition Benefit
NET GROWTH OPTIMIZATION
WHEN PERSONALIZATION?
Define P-E-R-S-O-N-A-L-I-Z-A-T-I-O-N
A fluid display
because of things we know about
the individual user on the other side
of the screen.
in which each component, in each
digital moment,
is what it is
ALGORITHMIC CONTENT
DISPLAY
There is only one way to get there
Testing, Testing, Testing One size fits all
Segment-based
experiences
1:1 Personalization
Making experiences for segments
and then individuals is extremely
expensive.
Each new specialized treatment
needs to beat the one-size-fits-all
experience to justify itself.
Many one-size-fits-all learnings will
always win.
Skipping the Low Hanging Fruit
One size fits all
Segment-based
experiences: segment-
based content display
1:1 Personalization:
algorithmic content display
Basic Nav
Evergreen copy that always
wins
Basic design
NET GROWTH OPTIMIZATION
DON’T BELIEVE ME?
LET ME SHOW YOU WHAT YOU’LL MISS.
A QUOTE FROM A DREAMER
“SMALL EMOTIONS ARE THE GREAT CAPTAINS OF
OUR LIVES.”
NET GROWTH OPTIMIZATION
LOW HANGING FRUIT: ACQUISITION
CUT THE FAT.
ADD A LITTLE COLOR.
TELL THEM WHAT YOU THOUGHT THEY
ALREADY KNEW.
TIME AND PLACE
THE EYE IS A MUSCLE.
CUT THE FAT
23% Order Uplift
ADD A LITTLE COLOR
110% Order Uplift
TELL THEM WHAT YOU THOUGHT THEY ALREADY
KNEW
+37% Order Uplift
TIME AND PLACE
+18% Order Uplift
THE EYE IS A MUSCLE
+21% Order Uplift
NET GROWTH OPTIMIZATION
LOW HANGING FRUIT: ENGAGEMENT
THE HAND IS A MUSCLE.
CONNECT THE PIPES.
Valuing Engagement and Product Testing
Onboarding Action
Newsletter + iOS Log In
Logs Into iOS App
Subscribes to a Newsletter
The only engagement metric that matters:
If a member does X, did they stay longer?
$ Value/Instance
$40
$34
$30
Churn
Reduction
-35%
-29%
-26%
Churn Impact of Customer Actions
THE HAND IS A MUSCLE
WSJ.comCheckout
THE HAND IS A MUSCLE
+ 78% Newsletter Signups
+ 117% App Downloads
CONNECT THE PIPES
+975% App Downloads
?
THE PRINCIPLES
TEST EVERYTHING.
PRIORITIZE.
DEFINE YOUR VALUE.
GO BIG.
DON’T SKIP THE LOW HANGING FRUIT.
NET GROWTH OPTIMIZATION
THANK YOU.
PETER.GRAY@DOWJONES.COM
646.483.7438
@pgdeepthoughts
opticon2017
Q&A
opticon2017
THANK YOU
Reminder: Don’t forget to join us for our Opticon Party
from 6:30PM-9:30PM at Brooklyn Bowl
Last But Not Least…
• Wifi info: Username: Opticon / Password: opticon17
• Download the Opticon mobile app
• Get social using #opticon2017
• Rate each session within the mobile app agenda by clicking on “take
survey”
• Take the maturity model assessment at optimizely.com/maturity-model
• Slides will be available after the event

Mais conteúdo relacionado

Mais procurados

Opticon 2017 From CRO to Experience
Opticon 2017 From CRO to ExperienceOpticon 2017 From CRO to Experience
Opticon 2017 From CRO to ExperienceOptimizely
 
Opticon 2017 Driving Bottom Line Impact
Opticon 2017 Driving Bottom Line ImpactOpticon 2017 Driving Bottom Line Impact
Opticon 2017 Driving Bottom Line ImpactOptimizely
 
Opticon 2017 Day in the Life of a Modern Experimenter
Opticon 2017 Day in the Life of a Modern ExperimenterOpticon 2017 Day in the Life of a Modern Experimenter
Opticon 2017 Day in the Life of a Modern ExperimenterOptimizely
 
Opticon 2017 Experimenting in Modern Web Applications
Opticon 2017 Experimenting in Modern Web ApplicationsOpticon 2017 Experimenting in Modern Web Applications
Opticon 2017 Experimenting in Modern Web ApplicationsOptimizely
 
Opticon 2017 Bend the B2B Curve
Opticon 2017 Bend the B2B CurveOpticon 2017 Bend the B2B Curve
Opticon 2017 Bend the B2B CurveOptimizely
 
Opticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOpticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOptimizely
 
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...Optimizely
 
Getting Started with Server-Side Testing
Getting Started with Server-Side TestingGetting Started with Server-Side Testing
Getting Started with Server-Side TestingOptimizely
 
Opticon 2017 How Developers Can Take Experimentation
Opticon 2017 How Developers Can Take ExperimentationOpticon 2017 How Developers Can Take Experimentation
Opticon 2017 How Developers Can Take ExperimentationOptimizely
 
A/B Testing for WordPress & Drupal
A/B Testing for WordPress & DrupalA/B Testing for WordPress & Drupal
A/B Testing for WordPress & DrupalOptimizely
 
World Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesWorld Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesOptimizely
 
A/B Mythbusters: Common Optimization Objections Debunked
A/B Mythbusters: Common Optimization Objections DebunkedA/B Mythbusters: Common Optimization Objections Debunked
A/B Mythbusters: Common Optimization Objections DebunkedOptimizely
 
Successful Testing with a Lean Team
Successful Testing with a Lean TeamSuccessful Testing with a Lean Team
Successful Testing with a Lean TeamOptimizely
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8Optimizely
 
Optimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - AtlassianOptimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - AtlassianOptimizely
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New WinningOptimizely
 
Optimizely Workshop 1: Prioritize your roadmap
Optimizely Workshop 1: Prioritize your roadmapOptimizely Workshop 1: Prioritize your roadmap
Optimizely Workshop 1: Prioritize your roadmapOptimizely
 
The Art of the Start --Success in the first 100 Days
The Art of the Start --Success in the first 100 DaysThe Art of the Start --Success in the first 100 Days
The Art of the Start --Success in the first 100 DaysOptimizely
 
Optimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely
 
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
[Elite Camp 2016] Peep Laja - Fresh Out Of the OvenCXL
 

Mais procurados (20)

Opticon 2017 From CRO to Experience
Opticon 2017 From CRO to ExperienceOpticon 2017 From CRO to Experience
Opticon 2017 From CRO to Experience
 
Opticon 2017 Driving Bottom Line Impact
Opticon 2017 Driving Bottom Line ImpactOpticon 2017 Driving Bottom Line Impact
Opticon 2017 Driving Bottom Line Impact
 
Opticon 2017 Day in the Life of a Modern Experimenter
Opticon 2017 Day in the Life of a Modern ExperimenterOpticon 2017 Day in the Life of a Modern Experimenter
Opticon 2017 Day in the Life of a Modern Experimenter
 
Opticon 2017 Experimenting in Modern Web Applications
Opticon 2017 Experimenting in Modern Web ApplicationsOpticon 2017 Experimenting in Modern Web Applications
Opticon 2017 Experimenting in Modern Web Applications
 
Opticon 2017 Bend the B2B Curve
Opticon 2017 Bend the B2B CurveOpticon 2017 Bend the B2B Curve
Opticon 2017 Bend the B2B Curve
 
Opticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOpticon 2017 Decisions at Scale
Opticon 2017 Decisions at Scale
 
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
 
Getting Started with Server-Side Testing
Getting Started with Server-Side TestingGetting Started with Server-Side Testing
Getting Started with Server-Side Testing
 
Opticon 2017 How Developers Can Take Experimentation
Opticon 2017 How Developers Can Take ExperimentationOpticon 2017 How Developers Can Take Experimentation
Opticon 2017 How Developers Can Take Experimentation
 
A/B Testing for WordPress & Drupal
A/B Testing for WordPress & DrupalA/B Testing for WordPress & Drupal
A/B Testing for WordPress & Drupal
 
World Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesWorld Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ Companies
 
A/B Mythbusters: Common Optimization Objections Debunked
A/B Mythbusters: Common Optimization Objections DebunkedA/B Mythbusters: Common Optimization Objections Debunked
A/B Mythbusters: Common Optimization Objections Debunked
 
Successful Testing with a Lean Team
Successful Testing with a Lean TeamSuccessful Testing with a Lean Team
Successful Testing with a Lean Team
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
 
Optimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - AtlassianOptimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - Atlassian
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
 
Optimizely Workshop 1: Prioritize your roadmap
Optimizely Workshop 1: Prioritize your roadmapOptimizely Workshop 1: Prioritize your roadmap
Optimizely Workshop 1: Prioritize your roadmap
 
The Art of the Start --Success in the first 100 Days
The Art of the Start --Success in the first 100 DaysThe Art of the Start --Success in the first 100 Days
The Art of the Start --Success in the first 100 Days
 
Optimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar Slides
 
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
[Elite Camp 2016] Peep Laja - Fresh Out Of the Oven
 

Semelhante a Opticon 2017 Hooked: How to Succeed

The Ultimate Guide to Facebook Data Activation
The Ultimate Guide to Facebook Data ActivationThe Ultimate Guide to Facebook Data Activation
The Ultimate Guide to Facebook Data ActivationKatana Media
 
dgm | Online Retailer Expo Sydney 2012 | Chris Garner
dgm | Online Retailer Expo Sydney 2012 | Chris Garnerdgm | Online Retailer Expo Sydney 2012 | Chris Garner
dgm | Online Retailer Expo Sydney 2012 | Chris GarnerChris Garner
 
Entering the Data Analytics industry
Entering the Data Analytics industryEntering the Data Analytics industry
Entering the Data Analytics industryGramener
 
Winning in the SaaS Economy
Winning in the SaaS EconomyWinning in the SaaS Economy
Winning in the SaaS EconomySaaStock
 
How to Enter the Data Analytics Industry?
How to Enter the Data Analytics Industry?How to Enter the Data Analytics Industry?
How to Enter the Data Analytics Industry?Ganes Kesari
 
Data Insight Leaders Summit Barcelona 2017
Data Insight Leaders Summit Barcelona 2017Data Insight Leaders Summit Barcelona 2017
Data Insight Leaders Summit Barcelona 2017Harvinder Atwal
 
Patrick Campbell — Our Fundamental Strategy of Building a Business is Broken ...
Patrick Campbell — Our Fundamental Strategy of Building a Business is Broken ...Patrick Campbell — Our Fundamental Strategy of Building a Business is Broken ...
Patrick Campbell — Our Fundamental Strategy of Building a Business is Broken ...Turing Fest
 
20170313 sauc roth conference presentation final
20170313 sauc roth conference presentation final20170313 sauc roth conference presentation final
20170313 sauc roth conference presentation finaldrhincorporated
 
Weis Markets' People-First Data Strategy
Weis Markets' People-First Data Strategy Weis Markets' People-First Data Strategy
Weis Markets' People-First Data Strategy MediaPost
 
Identifying and Forecasting Opportunities for CRO with Analytics at Conversio...
Identifying and Forecasting Opportunities for CRO with Analytics at Conversio...Identifying and Forecasting Opportunities for CRO with Analytics at Conversio...
Identifying and Forecasting Opportunities for CRO with Analytics at Conversio...Anna Lewis
 
Ardyssbizoppp
ArdyssbizopppArdyssbizoppp
Ardyssbizopppcrenski
 
Digital Marketing ROI at Blogworld NYC
Digital Marketing ROI at Blogworld NYCDigital Marketing ROI at Blogworld NYC
Digital Marketing ROI at Blogworld NYCChristopher Penn
 
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROI
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROIIncrease AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROI
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROIMarketo
 
Cashrewards delivers 1% of all Australian retail
Cashrewards delivers 1% of all Australian retailCashrewards delivers 1% of all Australian retail
Cashrewards delivers 1% of all Australian retailCashrewardsAU
 
Business Review PowerPoint Templates | Business Review PPT Slide Designs | Sl...
Business Review PowerPoint Templates | Business Review PPT Slide Designs | Sl...Business Review PowerPoint Templates | Business Review PPT Slide Designs | Sl...
Business Review PowerPoint Templates | Business Review PPT Slide Designs | Sl...SlideUpLift
 
Principles of Modern Marketing at NetSuite - Rob Israch (TOPO Demand Generati...
Principles of Modern Marketing at NetSuite - Rob Israch (TOPO Demand Generati...Principles of Modern Marketing at NetSuite - Rob Israch (TOPO Demand Generati...
Principles of Modern Marketing at NetSuite - Rob Israch (TOPO Demand Generati...TOPO
 
Benchpress report 2016
Benchpress report 2016Benchpress report 2016
Benchpress report 2016MailNinja
 
You Clicked On This Link For A Reason... Here's Why?
You Clicked On This Link For A Reason... Here's Why?You Clicked On This Link For A Reason... Here's Why?
You Clicked On This Link For A Reason... Here's Why?jbarnes6420
 
Matas Pocius - Lietuvos el. pašto rinkodaros tyrimas 2018. Vis dar trypčiojame?
Matas Pocius - Lietuvos el. pašto rinkodaros tyrimas 2018. Vis dar trypčiojame?Matas Pocius - Lietuvos el. pašto rinkodaros tyrimas 2018. Vis dar trypčiojame?
Matas Pocius - Lietuvos el. pašto rinkodaros tyrimas 2018. Vis dar trypčiojame?Vladas Sapranavicius
 
Ibm advanced analytics platform for m&e
Ibm advanced analytics platform for m&eIbm advanced analytics platform for m&e
Ibm advanced analytics platform for m&eUnited Partners
 

Semelhante a Opticon 2017 Hooked: How to Succeed (20)

The Ultimate Guide to Facebook Data Activation
The Ultimate Guide to Facebook Data ActivationThe Ultimate Guide to Facebook Data Activation
The Ultimate Guide to Facebook Data Activation
 
dgm | Online Retailer Expo Sydney 2012 | Chris Garner
dgm | Online Retailer Expo Sydney 2012 | Chris Garnerdgm | Online Retailer Expo Sydney 2012 | Chris Garner
dgm | Online Retailer Expo Sydney 2012 | Chris Garner
 
Entering the Data Analytics industry
Entering the Data Analytics industryEntering the Data Analytics industry
Entering the Data Analytics industry
 
Winning in the SaaS Economy
Winning in the SaaS EconomyWinning in the SaaS Economy
Winning in the SaaS Economy
 
How to Enter the Data Analytics Industry?
How to Enter the Data Analytics Industry?How to Enter the Data Analytics Industry?
How to Enter the Data Analytics Industry?
 
Data Insight Leaders Summit Barcelona 2017
Data Insight Leaders Summit Barcelona 2017Data Insight Leaders Summit Barcelona 2017
Data Insight Leaders Summit Barcelona 2017
 
Patrick Campbell — Our Fundamental Strategy of Building a Business is Broken ...
Patrick Campbell — Our Fundamental Strategy of Building a Business is Broken ...Patrick Campbell — Our Fundamental Strategy of Building a Business is Broken ...
Patrick Campbell — Our Fundamental Strategy of Building a Business is Broken ...
 
20170313 sauc roth conference presentation final
20170313 sauc roth conference presentation final20170313 sauc roth conference presentation final
20170313 sauc roth conference presentation final
 
Weis Markets' People-First Data Strategy
Weis Markets' People-First Data Strategy Weis Markets' People-First Data Strategy
Weis Markets' People-First Data Strategy
 
Identifying and Forecasting Opportunities for CRO with Analytics at Conversio...
Identifying and Forecasting Opportunities for CRO with Analytics at Conversio...Identifying and Forecasting Opportunities for CRO with Analytics at Conversio...
Identifying and Forecasting Opportunities for CRO with Analytics at Conversio...
 
Ardyssbizoppp
ArdyssbizopppArdyssbizoppp
Ardyssbizoppp
 
Digital Marketing ROI at Blogworld NYC
Digital Marketing ROI at Blogworld NYCDigital Marketing ROI at Blogworld NYC
Digital Marketing ROI at Blogworld NYC
 
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROI
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROIIncrease AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROI
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROI
 
Cashrewards delivers 1% of all Australian retail
Cashrewards delivers 1% of all Australian retailCashrewards delivers 1% of all Australian retail
Cashrewards delivers 1% of all Australian retail
 
Business Review PowerPoint Templates | Business Review PPT Slide Designs | Sl...
Business Review PowerPoint Templates | Business Review PPT Slide Designs | Sl...Business Review PowerPoint Templates | Business Review PPT Slide Designs | Sl...
Business Review PowerPoint Templates | Business Review PPT Slide Designs | Sl...
 
Principles of Modern Marketing at NetSuite - Rob Israch (TOPO Demand Generati...
Principles of Modern Marketing at NetSuite - Rob Israch (TOPO Demand Generati...Principles of Modern Marketing at NetSuite - Rob Israch (TOPO Demand Generati...
Principles of Modern Marketing at NetSuite - Rob Israch (TOPO Demand Generati...
 
Benchpress report 2016
Benchpress report 2016Benchpress report 2016
Benchpress report 2016
 
You Clicked On This Link For A Reason... Here's Why?
You Clicked On This Link For A Reason... Here's Why?You Clicked On This Link For A Reason... Here's Why?
You Clicked On This Link For A Reason... Here's Why?
 
Matas Pocius - Lietuvos el. pašto rinkodaros tyrimas 2018. Vis dar trypčiojame?
Matas Pocius - Lietuvos el. pašto rinkodaros tyrimas 2018. Vis dar trypčiojame?Matas Pocius - Lietuvos el. pašto rinkodaros tyrimas 2018. Vis dar trypčiojame?
Matas Pocius - Lietuvos el. pašto rinkodaros tyrimas 2018. Vis dar trypčiojame?
 
Ibm advanced analytics platform for m&e
Ibm advanced analytics platform for m&eIbm advanced analytics platform for m&e
Ibm advanced analytics platform for m&e
 

Mais de Optimizely

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationOptimizely
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Optimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing RightOptimizely
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleOptimizely
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Optimizely
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueOptimizely
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsOptimizely
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Optimizely
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Optimizely
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingOptimizely
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideOptimizely
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentOptimizely
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOptimizely
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...Optimizely
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyOptimizely
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueOptimizely
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' EyesOptimizely
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubOptimizely
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationOptimizely
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely
 

Mais de Optimizely (20)

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product Development
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' Eyes
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with Experimentation
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
 

Último

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Bhuvaneswari Subramani
 

Último (20)

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 

Opticon 2017 Hooked: How to Succeed

  • 1. opticon2017 Kimberly Kaufman Director, Digital Marketing Optimization SHOWTIME Peter Gray Director, Optimization Dow Jones Hooked: How to Succeed in the Subscription Economy
  • 2.
  • 3.
  • 4. SITE PRIORITIES Drive deeper engagement to retain subscribers Drive consumption of SHOWTIME programming Drive subscriptions 1 2 3
  • 6.
  • 7.
  • 8.
  • 12. ORIGINAL VARIATION 1 VARIATION 2 +57 %
  • 14.
  • 15.
  • 16.
  • 20. +7%
  • 21. HARE OF ORDER CLICKS WITHIN STREAMING MOD 2016-2017
  • 23.
  • 24.
  • 25.
  • 27. opticon2017 KEY TAKEAWAYS • Using device detection to enhance user experience is a valuable way to impact KPIs • A significant increase in one metric might have a negative impact on other metrics on the page • Never stop iterating – meaningful growth can be seen over time through testing • Validating ideas through testing is a great way to gain insight into what to test next
  • 29. Peter Gray 24 Months of Optimization at WSJ
  • 30. NET GROWTH OPTIMIZATION The most powerful product development discipline on earth? What do we do? Before we dive in . . .
  • 33. NET GROWTH OPTIMIZATION THE NON-AGENDA WHAT WOULD BE MOST USEFUL TO YOU. HIGH LEVEL RECIPE FOR OUR SUCCESS GETTING CREDIT WHEN PERSONALIZATION? NOT SKIPPING THE LOW HANGING FRUIT
  • 35. Letting the optimization beat build Metric 1st 6 Months Since Tests 3 216 Tests/Month .5 9.8 Team 1 5 Standalone team formed summer 2015 as part of subscription business unit. Sole starting KPI: Acquisition
  • 36. Optimization is Spreading The Nobel Prize for Clever Mind Games Goes to… Optimization Center for Excellence
  • 37. What’s Our Recipe A great partner agency Evangelism Velocity Ruthless prioritization $ value for our work
  • 39. Getting Credit What about the fat cats? The big dogs? Do you know your own ROI?
  • 40. 37% LIFT Why Not A: 50% B: 50% The only path to proper respect: a validated numerical value 100%
  • 41. So what did we do The Back Test
  • 42. The Back Test Jan 2016 Shop + Checkout Combined June 2017 Shop Checkout
  • 43. The Back Test 51% TOPLINE ORDER LIFT
  • 44. The Back Test The Model Optimization Order Calcs 2016 2016 2016 2016 2016 2016 2016 2016 2016 2016 2016 2016 2017 2017 2017 2017 2017 2017 Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Total WSJ Orders 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 Optimization Orders 2.8 5.7 8.5 11.3 14.2 17.0 19.8 22.7 25.5 28.3 31.2 34.0 36.8 39.7 42.5 45.3 48.2 51.0 Cumulative Uplift 2.8% 5.7% 8.5% 11.3% 14.2% 17.0% 19.8% 22.7% 25.5% 28.3% 31.2% 34.0% 36.8% 39.7% 42.5% 45.3% 48.2% 51.0% Incremental Uplift 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8% 2.8%
  • 45. The Back Test The Final Calculation 51% Lift 18 Months 2.8% Lift/Month 1,800 Total Orders 26.9% % of Total Orders $1 NPV of a WSJ Order 485 Optimization Orders $485 Optimization WSJ Acquisition Benefit
  • 46. NET GROWTH OPTIMIZATION WHEN PERSONALIZATION?
  • 47. Define P-E-R-S-O-N-A-L-I-Z-A-T-I-O-N A fluid display because of things we know about the individual user on the other side of the screen. in which each component, in each digital moment, is what it is ALGORITHMIC CONTENT DISPLAY
  • 48. There is only one way to get there Testing, Testing, Testing One size fits all Segment-based experiences 1:1 Personalization Making experiences for segments and then individuals is extremely expensive. Each new specialized treatment needs to beat the one-size-fits-all experience to justify itself. Many one-size-fits-all learnings will always win.
  • 49. Skipping the Low Hanging Fruit One size fits all Segment-based experiences: segment- based content display 1:1 Personalization: algorithmic content display Basic Nav Evergreen copy that always wins Basic design
  • 50. NET GROWTH OPTIMIZATION DON’T BELIEVE ME? LET ME SHOW YOU WHAT YOU’LL MISS.
  • 51. A QUOTE FROM A DREAMER “SMALL EMOTIONS ARE THE GREAT CAPTAINS OF OUR LIVES.”
  • 52. NET GROWTH OPTIMIZATION LOW HANGING FRUIT: ACQUISITION CUT THE FAT. ADD A LITTLE COLOR. TELL THEM WHAT YOU THOUGHT THEY ALREADY KNEW. TIME AND PLACE THE EYE IS A MUSCLE.
  • 53. CUT THE FAT 23% Order Uplift
  • 54. ADD A LITTLE COLOR 110% Order Uplift
  • 55. TELL THEM WHAT YOU THOUGHT THEY ALREADY KNEW +37% Order Uplift
  • 56. TIME AND PLACE +18% Order Uplift
  • 57. THE EYE IS A MUSCLE +21% Order Uplift
  • 58. NET GROWTH OPTIMIZATION LOW HANGING FRUIT: ENGAGEMENT THE HAND IS A MUSCLE. CONNECT THE PIPES.
  • 59. Valuing Engagement and Product Testing Onboarding Action Newsletter + iOS Log In Logs Into iOS App Subscribes to a Newsletter The only engagement metric that matters: If a member does X, did they stay longer? $ Value/Instance $40 $34 $30 Churn Reduction -35% -29% -26% Churn Impact of Customer Actions
  • 60. THE HAND IS A MUSCLE WSJ.comCheckout
  • 61. THE HAND IS A MUSCLE + 78% Newsletter Signups + 117% App Downloads
  • 62. CONNECT THE PIPES +975% App Downloads ?
  • 63. THE PRINCIPLES TEST EVERYTHING. PRIORITIZE. DEFINE YOUR VALUE. GO BIG. DON’T SKIP THE LOW HANGING FRUIT.
  • 64. NET GROWTH OPTIMIZATION THANK YOU. PETER.GRAY@DOWJONES.COM 646.483.7438 @pgdeepthoughts
  • 67. Reminder: Don’t forget to join us for our Opticon Party from 6:30PM-9:30PM at Brooklyn Bowl Last But Not Least… • Wifi info: Username: Opticon / Password: opticon17 • Download the Opticon mobile app • Get social using #opticon2017 • Rate each session within the mobile app agenda by clicking on “take survey” • Take the maturity model assessment at optimizely.com/maturity-model • Slides will be available after the event