SlideShare a Scribd company logo
1 of 22
Introducing Targeted Rollouts
Managing your release with audience targeting
Kris McKee
Senior Product Manager
Optimizely
• Turn on your system’s sound to hear the streaming presentation
• Questions? Submit them to the presenters at anytime on the #test-and-learn
Slack
• Technical problems? Click “Help” or submit a question for assistance
• This presentation will be available on-demand
• A copy of the slide deck is available within your viewing console
Housekeeping
Separate code deployment from feature enablement to drive rapid
iteration on digital products
Feature management enables control over releases
Benefits of a robust feature management system
Innovate faster
by releasing new features
to customers more
frequently, getting
feedback, and iterating
Scale experimentation
by integrating feature
management natively with
experiments and making
every release an
experiment
Mitigate launch risk
by increasing control and
flexibility for every team
member
Feature Flagging
Create Features in Optimizely to enable
feature release without a code deploy
everybody
Feature Rollouts
Gradually roll out a feature for a
specified audience to monitor
impact on performance and
business metrics
Feature Flagging
for an Audience
Create Features in Optimizely to enable
feature release for a specified audience
without a code deploy
Targeted Rollouts
Gradually roll out a feature for
several different audiences to
differing rollout percentages to
monitor impact on performance and
business metrics
Feature
Configuration
Instrument features with variables,
or parameters that can be
configured remotely, and without a
code deploy
Feature Configuration
by Audience, by
Environment
Instrument features with variables
that can be configured per
audience or environment and
without a code deploy
Trunk-based development
Develop features concurrently by
implementing flags set to “off”. Deploy to
master at any time while avoiding merge
conflicts.
Canary Releases
Use a flag to send a small percentage of traffic
to a new build of your application to discovery
any unforeseen issues prior to rolling out to all
users.
Beta or Exclusive Access
Give business users the power to grant
exclusive access to new features or beta
programs for your best customers or
prospects in a sales cycle.
Kill Switch
With feature flags, you can quickly turn off
problem features without rolling back an entire
release.
Dark Launches
Deploy features behind “off” flags, then give
marketers or PMs the ability to turn on the
feature independent of a new deploy.
Remote Configuration
Add parameterized variables to feature flags to
update features in real time, without a code
push or app update. Variables can also be
used to A/B test variations of features.
Use Cases for Feature Management with Optimizely
Ultimate control during complex
beta releases
Want to run several rounds of beta launches to
gather feedback from different types of
customers? Targeted Rollouts supports as many
beta audience groups as needed for complete
control during the most complex releases
Offer different experiences for
multiple end-user properties
Do you have multiple customer sites that you
would like to manage with one release? Use our
environment capability to control audience-specific
rollouts by environment or property
User variables by audience or
environment
Add parameterized variables to feature flags by
audience and by environment, to update features
in real time, without a code push or app update.
This provides the ultimate control of priority
variables
Launch feature by customer tiers
or permission level
Provide a different experience for your premier or
corporate customers and manage roll out by tier
independently, all without a code redeploy
Additional Use Cases for Feature Management with
Targeted Rollouts
Use Case #1: Managing a complex beta process
● An international B2B SaaS company,
ingrained into the tech stacks of
hundreds of customers
● Releasing a foundational new release
that requires data migration for each
customer
● To manage migration complications,
customers will be migrated one-by-one
initially, then by group
Use Case #1: Managing a
complex beta process
Ultimate control during complex beta
releases
Want to run several rounds of beta launches to gather
feedback from different types of customers? Targeted
Rollouts supports as many beta audience groups as needed
for complete control during the most complex releases
Use Case #2: Multiple end-user properties
● An international clothing retailer
with several brands targeting
different price points and
demographics
● Managing a rollout to the
homepage of all of their sites
with one release
● Ongoing updates to be
managed by PM, without a code
redeploy
Use Case #2: Multiple end-user
properties
Offer different experiences for multiple
end-user properties
Do you have multiple customer sites that you would like to
manage with one release? Use our environment capability to
control audience-specific rollouts by environment or property
● An international bike share
company, with presence in 10+ US
markets, and five international cities
● Managing response to COVID-19
requires awareness of constantly
changing local regulations
● Latest release pushes reminders to
customers of requirements in their
local market
● Ongoing updates to be managed by
PM, without a code redeploy
Use Case #3: Single release
regulatory updates, by market
Use Case #3: Single release
regulatory updates, by market
User variables by audience or
environment
Add parameterized variables to feature flags by audience
and by environment, to update features in real time, without
a code push or app update. This provides the ultimate
control of priority variables
Use Case #4: Product release to multiple customer
pricing tiers
● An international cloud-based
B2B software company offering
CRM solutions
● Launching an upgraded
analytics feature that will have a
different experience by market
and for each customer tier
● Ongoing updates to be
managed by PM, without a
code redeploy
Launch feature by customer tiers or
permission level
Provide a different experience for your premier or corporate
customers and manage roll out by tier independently, all
without a code redeploy
Use Case #4: Progressively release
to multiple customer pricing tiers
So, when can you get your hands on
Targeted Rollouts?
Questions?
Give me a ping at @kris.mckee on Slack or
kris.mckee@optimizely.com
All newly created Rollouts accounts from today onward will benefit from
Targeted Rollouts starting today!
👉 Sign-up for Rollouts account by clicking the banner on the right
We will be rolling Targeted Rollouts out to existing accounts over the next
several weeks
optimize.ly/dev-community
Thank you.
Please join us to continue this
conversation in the Slack Channel:
Optimizely.com/slack-community

More Related Content

What's hot

Enterprise Release Management for DevOps & Continuous Delivery/ From Spreadsh...
Enterprise Release Management for DevOps & Continuous Delivery/ From Spreadsh...Enterprise Release Management for DevOps & Continuous Delivery/ From Spreadsh...
Enterprise Release Management for DevOps & Continuous Delivery/ From Spreadsh...XebiaLabs
 
Essentials of a digital experience platform
Essentials of a digital experience platform Essentials of a digital experience platform
Essentials of a digital experience platform DrupalGeeks
 
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld
 
VMworld Europe 2014: Insider Threat and the Cloud (Security)
VMworld Europe 2014: Insider Threat and the Cloud (Security)VMworld Europe 2014: Insider Threat and the Cloud (Security)
VMworld Europe 2014: Insider Threat and the Cloud (Security)VMworld
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementMicrosoft Developer Norway
 
Reduced Costs by 75%: Kana Software Case Study
Reduced Costs by 75%: Kana Software Case StudyReduced Costs by 75%: Kana Software Case Study
Reduced Costs by 75%: Kana Software Case StudyWaveMaker, Inc.
 
Solução para clientes SAP
Solução para clientes SAPSolução para clientes SAP
Solução para clientes SAPMosán Santos
 
Meet The Welkin Suite IDE: Product Overview
Meet The Welkin Suite IDE: Product OverviewMeet The Welkin Suite IDE: Product Overview
Meet The Welkin Suite IDE: Product OverviewSalesforce Developers
 

What's hot (11)

Best practices in release management
Best  practices in release managementBest  practices in release management
Best practices in release management
 
Enterprise Release Management for DevOps & Continuous Delivery/ From Spreadsh...
Enterprise Release Management for DevOps & Continuous Delivery/ From Spreadsh...Enterprise Release Management for DevOps & Continuous Delivery/ From Spreadsh...
Enterprise Release Management for DevOps & Continuous Delivery/ From Spreadsh...
 
Essentials of a digital experience platform
Essentials of a digital experience platform Essentials of a digital experience platform
Essentials of a digital experience platform
 
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
 
VMworld Europe 2014: Insider Threat and the Cloud (Security)
VMworld Europe 2014: Insider Threat and the Cloud (Security)VMworld Europe 2014: Insider Threat and the Cloud (Security)
VMworld Europe 2014: Insider Threat and the Cloud (Security)
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release management
 
Reduced Costs by 75%: Kana Software Case Study
Reduced Costs by 75%: Kana Software Case StudyReduced Costs by 75%: Kana Software Case Study
Reduced Costs by 75%: Kana Software Case Study
 
Solução para clientes SAP
Solução para clientes SAPSolução para clientes SAP
Solução para clientes SAP
 
Meet The Welkin Suite IDE: Product Overview
Meet The Welkin Suite IDE: Product OverviewMeet The Welkin Suite IDE: Product Overview
Meet The Welkin Suite IDE: Product Overview
 
Chapter2
Chapter2Chapter2
Chapter2
 
Demystifying the Cloud for Microsoft Dynamics GP 2013
Demystifying the Cloud for Microsoft Dynamics GP 2013Demystifying the Cloud for Microsoft Dynamics GP 2013
Demystifying the Cloud for Microsoft Dynamics GP 2013
 

Similar to Targeted Rollouts: How to Release Features to Multiple Audiences

Unifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfUnifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfVWO
 
Extend Your Commercial Force.com App - Dreamforce 2012 - 9/19
Extend Your Commercial Force.com App - Dreamforce 2012 - 9/19Extend Your Commercial Force.com App - Dreamforce 2012 - 9/19
Extend Your Commercial Force.com App - Dreamforce 2012 - 9/19Salesforce Partners
 
JourneyToLowCode_3of4.pdf
JourneyToLowCode_3of4.pdfJourneyToLowCode_3of4.pdf
JourneyToLowCode_3of4.pdfVaibhavVaidya30
 
Failure is an Option: Scaling Resilient Feature Delivery
Failure is an Option: Scaling Resilient Feature DeliveryFailure is an Option: Scaling Resilient Feature Delivery
Failure is an Option: Scaling Resilient Feature DeliveryOptimizely
 
How To Sell Into Insurance with Perfecto
How To Sell Into Insurance with PerfectoHow To Sell Into Insurance with Perfecto
How To Sell Into Insurance with PerfectoLizzy Guido (she/her)
 
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments.pdf
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments.pdfThe Ultimate Guide to Performance Testing in Low-Code, No-Code Environments.pdf
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments.pdfkalichargn70th171
 
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...kalichargn70th171
 
QA & Testing Capabilities - Sigma Infosolutions
QA & Testing Capabilities - Sigma InfosolutionsQA & Testing Capabilities - Sigma Infosolutions
QA & Testing Capabilities - Sigma InfosolutionsSigma Infosolutions, LLC
 
SWM_WP_MaturityModel_July15
SWM_WP_MaturityModel_July15SWM_WP_MaturityModel_July15
SWM_WP_MaturityModel_July15Mike Lemons
 
The Bespoke Software Product Factory (2007)
The Bespoke Software Product Factory (2007)The Bespoke Software Product Factory (2007)
The Bespoke Software Product Factory (2007)Peter Antman
 
Adform webinar: New Features
Adform webinar: New FeaturesAdform webinar: New Features
Adform webinar: New FeaturesAdformMarketing
 
Build vs. Buy: Designing an Effective Software Update Delivery Solution
Build vs. Buy: Designing an Effective Software Update Delivery SolutionBuild vs. Buy: Designing an Effective Software Update Delivery Solution
Build vs. Buy: Designing an Effective Software Update Delivery SolutionFlexera
 
Spring '20 Jordan's Presentation
Spring '20 Jordan's PresentationSpring '20 Jordan's Presentation
Spring '20 Jordan's PresentationBetina Meyer Pflug
 
Sandboxes: The Future of App Development by Evan Barnet & Pam Barnet
Sandboxes: The Future of App Development by Evan Barnet & Pam BarnetSandboxes: The Future of App Development by Evan Barnet & Pam Barnet
Sandboxes: The Future of App Development by Evan Barnet & Pam BarnetSalesforce Admins
 
Developing saa s products main principles
Developing saa s products main principlesDeveloping saa s products main principles
Developing saa s products main principlesTanya Epstein
 
Becoming an Inflectra Partner
Becoming an Inflectra PartnerBecoming an Inflectra Partner
Becoming an Inflectra PartnerInflectra
 

Similar to Targeted Rollouts: How to Release Features to Multiple Audiences (20)

Unifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfUnifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdf
 
Extend Your Commercial Force.com App - Dreamforce 2012 - 9/19
Extend Your Commercial Force.com App - Dreamforce 2012 - 9/19Extend Your Commercial Force.com App - Dreamforce 2012 - 9/19
Extend Your Commercial Force.com App - Dreamforce 2012 - 9/19
 
JourneyToLowCode_3of4.pdf
JourneyToLowCode_3of4.pdfJourneyToLowCode_3of4.pdf
JourneyToLowCode_3of4.pdf
 
Failure is an Option: Scaling Resilient Feature Delivery
Failure is an Option: Scaling Resilient Feature DeliveryFailure is an Option: Scaling Resilient Feature Delivery
Failure is an Option: Scaling Resilient Feature Delivery
 
Larry OConnor resume
Larry OConnor resume Larry OConnor resume
Larry OConnor resume
 
How To Sell Into Insurance with Perfecto
How To Sell Into Insurance with PerfectoHow To Sell Into Insurance with Perfecto
How To Sell Into Insurance with Perfecto
 
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments.pdf
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments.pdfThe Ultimate Guide to Performance Testing in Low-Code, No-Code Environments.pdf
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments.pdf
 
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
The Ultimate Guide to Performance Testing in Low-Code, No-Code Environments (...
 
QA & Testing Capabilities - Sigma Infosolutions
QA & Testing Capabilities - Sigma InfosolutionsQA & Testing Capabilities - Sigma Infosolutions
QA & Testing Capabilities - Sigma Infosolutions
 
SWM_WP_MaturityModel_July15
SWM_WP_MaturityModel_July15SWM_WP_MaturityModel_July15
SWM_WP_MaturityModel_July15
 
Project List for Students
Project List for StudentsProject List for Students
Project List for Students
 
ravi kumar s
ravi kumar sravi kumar s
ravi kumar s
 
The Bespoke Software Product Factory (2007)
The Bespoke Software Product Factory (2007)The Bespoke Software Product Factory (2007)
The Bespoke Software Product Factory (2007)
 
Journey toward3rdplatform
Journey toward3rdplatformJourney toward3rdplatform
Journey toward3rdplatform
 
Adform webinar: New Features
Adform webinar: New FeaturesAdform webinar: New Features
Adform webinar: New Features
 
Build vs. Buy: Designing an Effective Software Update Delivery Solution
Build vs. Buy: Designing an Effective Software Update Delivery SolutionBuild vs. Buy: Designing an Effective Software Update Delivery Solution
Build vs. Buy: Designing an Effective Software Update Delivery Solution
 
Spring '20 Jordan's Presentation
Spring '20 Jordan's PresentationSpring '20 Jordan's Presentation
Spring '20 Jordan's Presentation
 
Sandboxes: The Future of App Development by Evan Barnet & Pam Barnet
Sandboxes: The Future of App Development by Evan Barnet & Pam BarnetSandboxes: The Future of App Development by Evan Barnet & Pam Barnet
Sandboxes: The Future of App Development by Evan Barnet & Pam Barnet
 
Developing saa s products main principles
Developing saa s products main principlesDeveloping saa s products main principles
Developing saa s products main principles
 
Becoming an Inflectra Partner
Becoming an Inflectra PartnerBecoming an Inflectra Partner
Becoming an Inflectra Partner
 

More from Optimizely

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationOptimizely
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Optimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing RightOptimizely
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleOptimizely
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Optimizely
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueOptimizely
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsOptimizely
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Optimizely
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Optimizely
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingOptimizely
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideOptimizely
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentOptimizely
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOptimizely
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...Optimizely
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyOptimizely
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueOptimizely
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' EyesOptimizely
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubOptimizely
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationOptimizely
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely
 

More from Optimizely (20)

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product Development
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' Eyes
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with Experimentation
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
 

Recently uploaded

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 

Recently uploaded (20)

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 

Targeted Rollouts: How to Release Features to Multiple Audiences

  • 1. Introducing Targeted Rollouts Managing your release with audience targeting Kris McKee Senior Product Manager Optimizely
  • 2. • Turn on your system’s sound to hear the streaming presentation • Questions? Submit them to the presenters at anytime on the #test-and-learn Slack • Technical problems? Click “Help” or submit a question for assistance • This presentation will be available on-demand • A copy of the slide deck is available within your viewing console Housekeeping
  • 3. Separate code deployment from feature enablement to drive rapid iteration on digital products Feature management enables control over releases
  • 4. Benefits of a robust feature management system Innovate faster by releasing new features to customers more frequently, getting feedback, and iterating Scale experimentation by integrating feature management natively with experiments and making every release an experiment Mitigate launch risk by increasing control and flexibility for every team member
  • 5. Feature Flagging Create Features in Optimizely to enable feature release without a code deploy everybody
  • 6. Feature Rollouts Gradually roll out a feature for a specified audience to monitor impact on performance and business metrics
  • 7. Feature Flagging for an Audience Create Features in Optimizely to enable feature release for a specified audience without a code deploy
  • 8. Targeted Rollouts Gradually roll out a feature for several different audiences to differing rollout percentages to monitor impact on performance and business metrics
  • 9. Feature Configuration Instrument features with variables, or parameters that can be configured remotely, and without a code deploy
  • 10. Feature Configuration by Audience, by Environment Instrument features with variables that can be configured per audience or environment and without a code deploy
  • 11. Trunk-based development Develop features concurrently by implementing flags set to “off”. Deploy to master at any time while avoiding merge conflicts. Canary Releases Use a flag to send a small percentage of traffic to a new build of your application to discovery any unforeseen issues prior to rolling out to all users. Beta or Exclusive Access Give business users the power to grant exclusive access to new features or beta programs for your best customers or prospects in a sales cycle. Kill Switch With feature flags, you can quickly turn off problem features without rolling back an entire release. Dark Launches Deploy features behind “off” flags, then give marketers or PMs the ability to turn on the feature independent of a new deploy. Remote Configuration Add parameterized variables to feature flags to update features in real time, without a code push or app update. Variables can also be used to A/B test variations of features. Use Cases for Feature Management with Optimizely
  • 12. Ultimate control during complex beta releases Want to run several rounds of beta launches to gather feedback from different types of customers? Targeted Rollouts supports as many beta audience groups as needed for complete control during the most complex releases Offer different experiences for multiple end-user properties Do you have multiple customer sites that you would like to manage with one release? Use our environment capability to control audience-specific rollouts by environment or property User variables by audience or environment Add parameterized variables to feature flags by audience and by environment, to update features in real time, without a code push or app update. This provides the ultimate control of priority variables Launch feature by customer tiers or permission level Provide a different experience for your premier or corporate customers and manage roll out by tier independently, all without a code redeploy Additional Use Cases for Feature Management with Targeted Rollouts
  • 13. Use Case #1: Managing a complex beta process ● An international B2B SaaS company, ingrained into the tech stacks of hundreds of customers ● Releasing a foundational new release that requires data migration for each customer ● To manage migration complications, customers will be migrated one-by-one initially, then by group
  • 14. Use Case #1: Managing a complex beta process Ultimate control during complex beta releases Want to run several rounds of beta launches to gather feedback from different types of customers? Targeted Rollouts supports as many beta audience groups as needed for complete control during the most complex releases
  • 15. Use Case #2: Multiple end-user properties ● An international clothing retailer with several brands targeting different price points and demographics ● Managing a rollout to the homepage of all of their sites with one release ● Ongoing updates to be managed by PM, without a code redeploy
  • 16. Use Case #2: Multiple end-user properties Offer different experiences for multiple end-user properties Do you have multiple customer sites that you would like to manage with one release? Use our environment capability to control audience-specific rollouts by environment or property
  • 17. ● An international bike share company, with presence in 10+ US markets, and five international cities ● Managing response to COVID-19 requires awareness of constantly changing local regulations ● Latest release pushes reminders to customers of requirements in their local market ● Ongoing updates to be managed by PM, without a code redeploy Use Case #3: Single release regulatory updates, by market
  • 18. Use Case #3: Single release regulatory updates, by market User variables by audience or environment Add parameterized variables to feature flags by audience and by environment, to update features in real time, without a code push or app update. This provides the ultimate control of priority variables
  • 19. Use Case #4: Product release to multiple customer pricing tiers ● An international cloud-based B2B software company offering CRM solutions ● Launching an upgraded analytics feature that will have a different experience by market and for each customer tier ● Ongoing updates to be managed by PM, without a code redeploy
  • 20. Launch feature by customer tiers or permission level Provide a different experience for your premier or corporate customers and manage roll out by tier independently, all without a code redeploy Use Case #4: Progressively release to multiple customer pricing tiers
  • 21. So, when can you get your hands on Targeted Rollouts? Questions? Give me a ping at @kris.mckee on Slack or kris.mckee@optimizely.com All newly created Rollouts accounts from today onward will benefit from Targeted Rollouts starting today! 👉 Sign-up for Rollouts account by clicking the banner on the right We will be rolling Targeted Rollouts out to existing accounts over the next several weeks
  • 22. optimize.ly/dev-community Thank you. Please join us to continue this conversation in the Slack Channel: Optimizely.com/slack-community

Editor's Notes

  1. Flags: A feature flag is a rule to enable, disable, hide, or roll out a product feature at runtime. The main benefit of a feature flag is it allows an employee to configure the behavior of a product on the fly without deploying code.
  2. Rollouts: Control the risk of changing the customer experience by gradually releasing a feature and monitoring performance. Feature rollouts enable you to grant access for a specific feature to a certain set of users. Randomly assign to a percentage of users, target a specific audience, whitelist individual users/accounts, or do a combination of all of these. With Rollouts, you can ramp up access to any feature or experience slowly, to monitor key engineering metrics like performance or bugs, or key performance indicators of the user experience impact.
  3. Flags: A feature flag is a rule to enable, disable, hide, or roll out a product feature at runtime. The main benefit of a feature flag is it allows an employee to configure the behavior of a product on the fly without deploying code.
  4. Feature variables: Instrument features with configurable components or parameters that enable anyone on your team to control or update the feature on the fly, without deploying code.
  5. B2B software, priority and business, standard