The document discusses essential tactics for A/B testing, including targeting, multi-page experiments, redirect tests, goal setting, and segmentation. Real-world examples are provided to illustrate how each tactic can be applied, such as targeting customers based on student status, running multi-page experiments across product pages like a theme park ride, and using segmentation to test different experiences for mobile vs desktop users. The document encourages testing ideas to improve customer experiences and measure business goals.
3. #abtestingessentials @Optimizely
What we’ve covered so far.
How to avoid pitfalls
that can arise when
testing.
Recordings on optimizely.com/ecommerce-ab-testing and SlideShare
A framework for
prioritizing what to
test.
1 2
3
How to use a testing
platform to execute
these ideas.
Thursday, August 29, 13
6. #abtestingessentials @Optimizely
It’s all part of a bigger picture.
Understand our website visitors...
...and translate our understanding
into better experiences for those
visitors.
Thursday, August 29, 13
27. #abtestingessentials @Optimizely
Who and where are
you testing?
New features
URL Query Parameters
Marketing campaigns
Adwords
Browser Type
Mobile vs. Non-mobile
Location
Targeting IRL Online Optimizely
Thursday, August 29, 13
50. #abtestingessentials @Optimizely
Categorize your visitors to
filter your results
• Browser
• Campaign
• Mobile vs. Non-mobile
• Source Type
• Custom Segment (aka
anything else!)
Segmentation IRL Online Optimizely
Thursday, August 29, 13
51. #abtestingessentials @Optimizely
5 Testing Tactics to Know
and Use
Targeting
Multi-page Experiments
Redirect Tests
Goal Setting
Segmentation
1
2
3
4
5
Thursday, August 29, 13
what we ’ ve covered in other webinars, that content livesves and exists here...all part of a bigger picture, how well do u understand your visitors, how good at your systems at capturing this, how well do you understand your tesitng platform ’ s capabilities to react accordingly and listen to your visitors.
...all part of a bigger picture, how well do u understand your visitors, how good at your systems at capturing this, how well do you understand your testing platform ’ s capabilities to react accordingly and listen to your visitors. understand your website platform ’ s capabilities well enough to execute and iterate quickly
How are you addressing specific visitor populations? real life redirect test... pilot new store layouts. compare real life shoppig experience to what optimizely enables you to do with all of these features. what we ’ ve learned in real life are all things we can apply to digital world. whether or not you ’ ve worked in brick and mortar retail, you ’ ve experienced it. targeting--tell him DJ KoolAid sent you. mention my name. when ’ s the last time someone remembered you at walmart or target? we can take a huge volume experience and help you remember who has been there and what they like.
so what are some things we can target by? think of areas of your business that would be really nice for targeting. explore where your visitor population is identifing themselves as a group to be targeted.
theme park ride. in line, advertising a picture, take your picture on the ride, a huge flash goes off, then they strategically place the gift shop right there. then the food with a gimmick from the ride is right next to it. all aligned and coordinated so you will be more likely to buy. multiple places you can optimize so the end goal (RPV) is accomplished
theme park ride. in line, advertising a picture, take your picture on the ride, a huge flash goes off, then they strategically place the gift shop right there. then the food with a gimmick from the ride is right next to it. all aligned and coordinated so you will be more likely to buy. multiple places you can optimize so the end goal (RPV) is accomplished
spinoff airport kiosk mimic of a brand name stoire, think we can do business in another place, but not sure we can. bose airport kiosk started with factorty stores which were in outlet malls, ok this works well maybe we can compe up with new concept that were showcase stores, smaller, then they tried that in malls and expanded in places where they saw it worked. then they tried airport kiosks, try to redirect some of our sales to a different location and see how they react.
spinoff airport kiosk mimic of a brand name stoire, think we can do business in another place, but not sure we can. bose airport kiosk started with factorty stores which were in outlet malls, ok this works well maybe we can compe up with new concept that were showcase stores, smaller, then they tried that in malls and expanded in places where they saw it worked. then they tried airport kiosks, try to redirect some of our sales to a different location and see how they react.
Online: One URL and redirecting to another
How to do redirects in optimizely platform
Bose theater before and after reveal. they had to measure number of people in each theater and number of people who subsequently made a purchase.
1800 dentist - lesson in goals [jodie] bigstock is a good one end of the day, we care about rpv, but also adds to cart, and finding image in the first place it ’ s not just about your end goal, it ’ s about multiple goals along the way.
1800 dentist - lesson in goals [jodie] bigstock is a good one end of the day, we care about rpv, but also adds to cart, and finding image in the first place it ’ s not just about your end goal, it ’ s about multiple goals along the way.
Definition of success Revenue (its not the only thing that matters!) Pageviews Use your analytics to find the bottleneck Track intermediate goals on checkout funnel Clicks Add to Cart Product Detail Page engagement
all of your different groups, credit card, cash, gift card, groupon, living social, segmentation is saying how did each group perform? how many of them have come back as repeat customers. getting an understanding of how you can improve your performance. different crowd and you have a change to target each of them differently. if i see a huge part of my crowd is using CC, should i invest more in an APPle style store where eveyrone walks around with ipads for charging my card?