SlideShare uma empresa Scribd logo
1 de 61
Baixar para ler offline
Orchestrating
experiments at scale
Flowcon
27 November 2018 Paris, France
Matteo Cavucci
@matteomced
Let’s make experiments for our
product, so we’ll find out what to build!
Shut up, you chump! We know already
what to build. Have a look at our
product strategy.
Let’s make experiments for our
product, so we’ll find out what to build!
Shut up, you chump! We know already
what to build. Have a look at our
product strategy.
Let’s make experiments for our
product, so we’ll find out what to build!
…and we had a design sprint
3 months ago. Get back to work!
The important things I have to say today
• You can’t create a successful product
without having people aligned on
purpose and goals.
• The product strategy is a visual tool to
connect business and delivery.
• Prioritising by value and outcomes
requires continuous validation.
Who’s this guy?
Matteo Cavucci
• Italian, but living in Berlin
• Ex ThoughtWorks, now independent
• Supporting executives, managers, and teams
improving ideation, planning, and delivery of
software products.
• I’ve been hired as a dev, designer, PM,
Scrum Master, PO, etc…
• A process nerd!
@matteoMCED
What is a product
strategy?
It's developer's understanding,
not your knowledge that
becomes the product.
— Alberto Brandolini
Issues with traditional product strategy
• General lack of alignment and
accountability to a common business goal.

• Decision making is not enabled by people
doing the work.
• Work is measured and prioritised by output,
not value delivered.

• Too many handoffs between silos leading to
poor execution and delays.

Information
Time
Information
Time
Verschlimmbesserung
An action that is supposed to improve something,
but ends up making it worse.
“It’s not an improvement; it’s a Verschlimmbesserung!”
Today’s solutions,
tomorrow’s problems.
A challenge
The challenge
• A large org producing one of the most
beloved software product of the internet
history.

• Based in North America, but with team
members distributed all around the globe.
• A large base of contributors, from semi-
professional partitioners to corporations.
Find new ways to attract
and delight the next
four million users.
A cross-functional team
of domain experts
Tech lead
UX designer
Product owner
Community
Program manager
Tech lead
User researcher
Marketing
A different set of principles
• Focus on learnings, instead of the mere
creation of artefacts with a continuous
process of discovery.
• Prioritise according the desired impact, not
the expected deliverable.
• Empower distributed, autonomous teams to
take the right decisions, keeping a consistent
focus on the global product.

From multiple ideas
to an actionable,
adaptive roadmap
Intuition & experience?
Experiment & test!
Hypothesis B
Hypothesis A
Discovery through options
Let ideas emerge
Mapping the current flow
spot areas of improvement
What is eventstorming?
Accelerate group learning using DDD
principles and Gamestorming approach
Eventstorming is a rapid, lightweight and
intense group modelling technique. It
makes easy to quickly understand
domains and accelerate business and
tech teams in designing complex and
powerful solutions for their products and
processes.
Why it works so well
Everybody is involved - Eventstorming
is designed to create conversations
between many people at the same time
Driven by participants - The focus and
the deepness of the conversation is
decided by the crowd.
Incremental notation - Introduce
specific notations when is needed, if is
needed.
Complex, not linear - Reality is rarely a
linear journey. Eventstorming captures
the hidden complexity of products.
A common language for all - Precise
and powerful language, familiar and
easy to learn by people with different
backgrounds.
How does it works
Describe what you know in events
• Orange sticky note
• Verb at past tense
• Relevant for domain experts
Examples:
• New extension submitted for review.
• Extension rated as excellent by end user.
• Extension promoted as featured.
…and place them along a timeline
• What do we need to have this
event happening?
• What other event is triggered by
this event?
From insights to opportunities
exploration structure boundaries frictions opportunities
Orchestrating
experiments
Establish a direction
toward which all the
work should contribute
Set a leading Vision
• A description of what place in the market
the organization seeks to achieve.
• Ambitious enough to inspire and set a
clear direction.
• Actionable in a reasonable timeframe
(6/12 months).
• Relevant for the business and
meaningful for the teams.
Take a look into the future
• What do we want to feel when working with the community of developers?
• What do we want the developers to feel when working with us?
• What do we want the extension makers to feel about our work together?
• What do we want the end user think about our service?
• What do we want the end user to say about our service?
• How would we describe the future service?
Contributiontothevision
Uncertainty
topic A topic B topic C topic D topic E
Grouping opportunities
topic A topic B topic C topic D topic E
Leading Vision
Visualising relations
Initiative
The Lean Value Tree
• The Lean Value Tree is a visual tool to
facilitate capturing and sharing the
product strategy
• An effective way to share and analyse
desired outcomes, examine risks, and
continuously prioritize what is
needed.
Leading Vision
Bet
Experiment
Bet
Goal
GoalGoal
Goal A Goal B Goal C Goal D Goal E
Leading Vision
From topics to high-level Goals
GOAL:
CURRENT SITUATION:
IMPACT:
INDICATORS:
USER:
A name capturing the high-level goal
Customer selection & focus
Observations and insights from the current implementation
The result we’d like to achieve in terms of behavioural change
How are we going to observe the change
From opportunities to Bets
Goal A
leading vision
Bet 1
Bet 2
Bet 3
BET:
PEOPLE:POTENTIAL RISKS:
INDICATORS:
HYPOTHESIS:
A name capturing the Bet
We believe that _________ will result in ________________
Who need to be involved, and how
THE SCENARIO:
A brief description of the desired scenario
from user’s perspective
How are we going to observe the change
Whatever we need to keep in mind when validating this Bet
EXP. IMPACT: Hi/Mid/Low
Prioritise Bets
WIP per Goal: 2
WIP per quarter: 9
Prioritise Bets
YES
YES, BUT LATER
WIP per Goal: 2
WIP per quarter: 9
Prioritise Bets
THIS QUARTER
NEXT QUARTER
From Bets to Experiments
Goal A
Leading Vision
Bet 1
Experiment 1
Experiment 2
Experiment 3
Experiment 4
Team
EXPERIMENT:
ACTIONS:
INDICATORS:
A name capturing the experiment
What are we planning to gather data
Metrics and results to measure the change
EXPECTATIONS:
What do we like to see
DUE DATE:
A quick
example
Becoming the 2019 go-to conference
for managers and PO in Europe.
Becoming the 2019 go-to conference
for managers and PO in Europe.
An immersive
attendee experience
Attracting
enthusiast sponsors
Cutting edge
presentations
Growing
a community
Becoming the 2019 go-to conference
for managers and POs in Europe
An immersive
attendee experience
Attracting
enthusiast sponsors
Cutting edge
presentations
Growing
a community
Offering spaces
for networking
Connect with
speakers
Get feedback
on real life challenges
Becoming the 2019 go-to conference
for managers and POs in Europe
An immersive
attendee experience
Attracting
enthusiast sponsors
Cutting edge
presentations
Growing
a community
Get feedback
on real life challenges
Unconference
space
Coaching
corner by speakers
Q&A panel with
moderated questions from the audience
A different way
of thinking
Compass overmaps
Supporting
continuous learning
Strategy
is a hypothesis
Challenge the
“but this is how we always do it”
mentality
Merci!
Matteo Cavucci
@matteomced
matteo@mced.it

Mais conteúdo relacionado

Mais procurados

"The Story of How We Saved an Australia Telco Millions of Dollars by Invalida...
"The Story of How We Saved an Australia Telco Millions of Dollars by Invalida..."The Story of How We Saved an Australia Telco Millions of Dollars by Invalida...
"The Story of How We Saved an Australia Telco Millions of Dollars by Invalida...Productized
 
Lean agile meets design thinking
Lean agile meets design thinkingLean agile meets design thinking
Lean agile meets design thinkingRavneet Kaur
 
Changing the way we change – leveraging a combination of Lean, Design, and S...
 Changing the way we change – leveraging a combination of Lean, Design, and S... Changing the way we change – leveraging a combination of Lean, Design, and S...
Changing the way we change – leveraging a combination of Lean, Design, and S...Scrum Australia Pty Ltd
 
Product Strategy - How to figure out a plan for your product?
Product Strategy - How to figure out a plan for your product?Product Strategy - How to figure out a plan for your product?
Product Strategy - How to figure out a plan for your product?Julie Knibbe
 
Product strategy in a customer centric company at LeanKit
Product strategy in a customer centric company at LeanKitProduct strategy in a customer centric company at LeanKit
Product strategy in a customer centric company at LeanKitFlorent de Gantes
 
Thinking more product: Moving from Scrum to a dual-track agile approach by Su...
Thinking more product: Moving from Scrum to a dual-track agile approach by Su...Thinking more product: Moving from Scrum to a dual-track agile approach by Su...
Thinking more product: Moving from Scrum to a dual-track agile approach by Su...Agile Software Community of India
 
“Creation, Maintenance & Destruction: A Product Lifecycle Philosophy” by Rush...
“Creation, Maintenance & Destruction: A Product Lifecycle Philosophy” by Rush...“Creation, Maintenance & Destruction: A Product Lifecycle Philosophy” by Rush...
“Creation, Maintenance & Destruction: A Product Lifecycle Philosophy” by Rush...Productized
 
Roadmaps - the good, the bad and the ugly!
Roadmaps - the good, the bad and the ugly!Roadmaps - the good, the bad and the ugly!
Roadmaps - the good, the bad and the ugly!Product Anonymous
 
SaaS - How to structure and measure a POC or Pilot
SaaS - How to structure and measure a POC or PilotSaaS - How to structure and measure a POC or Pilot
SaaS - How to structure and measure a POC or Pilotactionable.me
 
Regan Davis "Product 1.5 Iterating Towards a Better Product Culture" Producti...
Regan Davis "Product 1.5 Iterating Towards a Better Product Culture" Producti...Regan Davis "Product 1.5 Iterating Towards a Better Product Culture" Producti...
Regan Davis "Product 1.5 Iterating Towards a Better Product Culture" Producti...Productized
 
Stefan Haas- Productized Masterclasses
Stefan Haas- Productized MasterclassesStefan Haas- Productized Masterclasses
Stefan Haas- Productized MasterclassesProductized
 
PM Genome - Productized Lisbon 2017
PM Genome - Productized Lisbon 2017PM Genome - Productized Lisbon 2017
PM Genome - Productized Lisbon 2017Productized
 
UX STRAT USA 2021: Elsa Ho, DoorDash
UX STRAT USA 2021: Elsa Ho, DoorDashUX STRAT USA 2021: Elsa Ho, DoorDash
UX STRAT USA 2021: Elsa Ho, DoorDashUX STRAT
 
Agile Product Development Playbook - Popular Tools and Techniques
Agile Product Development Playbook - Popular Tools and TechniquesAgile Product Development Playbook - Popular Tools and Techniques
Agile Product Development Playbook - Popular Tools and TechniquesAndy Birds
 
Implementing Dual-Track Agile :: Lessons from the trenches @ITSpring.by May 2019
Implementing Dual-Track Agile :: Lessons from the trenches @ITSpring.by May 2019Implementing Dual-Track Agile :: Lessons from the trenches @ITSpring.by May 2019
Implementing Dual-Track Agile :: Lessons from the trenches @ITSpring.by May 2019Pedro Teixeira
 

Mais procurados (20)

"The Story of How We Saved an Australia Telco Millions of Dollars by Invalida...
"The Story of How We Saved an Australia Telco Millions of Dollars by Invalida..."The Story of How We Saved an Australia Telco Millions of Dollars by Invalida...
"The Story of How We Saved an Australia Telco Millions of Dollars by Invalida...
 
Lean agile meets design thinking
Lean agile meets design thinkingLean agile meets design thinking
Lean agile meets design thinking
 
Lean Product Roadmaps
Lean Product RoadmapsLean Product Roadmaps
Lean Product Roadmaps
 
Changing the way we change – leveraging a combination of Lean, Design, and S...
 Changing the way we change – leveraging a combination of Lean, Design, and S... Changing the way we change – leveraging a combination of Lean, Design, and S...
Changing the way we change – leveraging a combination of Lean, Design, and S...
 
Product Strategy - How to figure out a plan for your product?
Product Strategy - How to figure out a plan for your product?Product Strategy - How to figure out a plan for your product?
Product Strategy - How to figure out a plan for your product?
 
Agile project discovery
Agile project discoveryAgile project discovery
Agile project discovery
 
Product strategy in a customer centric company at LeanKit
Product strategy in a customer centric company at LeanKitProduct strategy in a customer centric company at LeanKit
Product strategy in a customer centric company at LeanKit
 
Thinking more product: Moving from Scrum to a dual-track agile approach by Su...
Thinking more product: Moving from Scrum to a dual-track agile approach by Su...Thinking more product: Moving from Scrum to a dual-track agile approach by Su...
Thinking more product: Moving from Scrum to a dual-track agile approach by Su...
 
“Creation, Maintenance & Destruction: A Product Lifecycle Philosophy” by Rush...
“Creation, Maintenance & Destruction: A Product Lifecycle Philosophy” by Rush...“Creation, Maintenance & Destruction: A Product Lifecycle Philosophy” by Rush...
“Creation, Maintenance & Destruction: A Product Lifecycle Philosophy” by Rush...
 
Maiia Suta -MK
Maiia Suta -MKMaiia Suta -MK
Maiia Suta -MK
 
Roadmaps - the good, the bad and the ugly!
Roadmaps - the good, the bad and the ugly!Roadmaps - the good, the bad and the ugly!
Roadmaps - the good, the bad and the ugly!
 
SaaS - How to structure and measure a POC or Pilot
SaaS - How to structure and measure a POC or PilotSaaS - How to structure and measure a POC or Pilot
SaaS - How to structure and measure a POC or Pilot
 
Regan Davis "Product 1.5 Iterating Towards a Better Product Culture" Producti...
Regan Davis "Product 1.5 Iterating Towards a Better Product Culture" Producti...Regan Davis "Product 1.5 Iterating Towards a Better Product Culture" Producti...
Regan Davis "Product 1.5 Iterating Towards a Better Product Culture" Producti...
 
Stefan Haas- Productized Masterclasses
Stefan Haas- Productized MasterclassesStefan Haas- Productized Masterclasses
Stefan Haas- Productized Masterclasses
 
PM Genome - Productized Lisbon 2017
PM Genome - Productized Lisbon 2017PM Genome - Productized Lisbon 2017
PM Genome - Productized Lisbon 2017
 
UX STRAT USA 2021: Elsa Ho, DoorDash
UX STRAT USA 2021: Elsa Ho, DoorDashUX STRAT USA 2021: Elsa Ho, DoorDash
UX STRAT USA 2021: Elsa Ho, DoorDash
 
Clark "Building An Agile Team"
Clark "Building An Agile Team"Clark "Building An Agile Team"
Clark "Building An Agile Team"
 
Agile Product Development Playbook - Popular Tools and Techniques
Agile Product Development Playbook - Popular Tools and TechniquesAgile Product Development Playbook - Popular Tools and Techniques
Agile Product Development Playbook - Popular Tools and Techniques
 
Lean Value Tree Overview
Lean Value Tree OverviewLean Value Tree Overview
Lean Value Tree Overview
 
Implementing Dual-Track Agile :: Lessons from the trenches @ITSpring.by May 2019
Implementing Dual-Track Agile :: Lessons from the trenches @ITSpring.by May 2019Implementing Dual-Track Agile :: Lessons from the trenches @ITSpring.by May 2019
Implementing Dual-Track Agile :: Lessons from the trenches @ITSpring.by May 2019
 

Semelhante a Orchestrating experiments at scale

The right stuff - Orchestrating experiments at scale
The right stuff - Orchestrating experiments at scaleThe right stuff - Orchestrating experiments at scale
The right stuff - Orchestrating experiments at scalematteo cavucci
 
How do you know you're ready for a Design Sprint?
How do you know you're ready for a Design Sprint?How do you know you're ready for a Design Sprint?
How do you know you're ready for a Design Sprint?Highland
 
2.4 Product Spotlight: Designing for THEO
2.4 Product Spotlight: Designing for THEO2.4 Product Spotlight: Designing for THEO
2.4 Product Spotlight: Designing for THEOTargetX
 
Boston UXPA 2016 | What’s Worse: A Root Canal or Selecting Health Insurance
Boston UXPA 2016 | What’s Worse: A Root Canal or Selecting Health InsuranceBoston UXPA 2016 | What’s Worse: A Root Canal or Selecting Health Insurance
Boston UXPA 2016 | What’s Worse: A Root Canal or Selecting Health InsuranceBecky Minervino
 
Becoming agile with Peapod Labs Sr. Product Owner
Becoming agile with Peapod Labs Sr. Product OwnerBecoming agile with Peapod Labs Sr. Product Owner
Becoming agile with Peapod Labs Sr. Product OwnerPromotable
 
Understanding The Urge To Agility
Understanding The Urge To AgilityUnderstanding The Urge To Agility
Understanding The Urge To AgilityACM
 
(PROJEKTURA) lean startup
(PROJEKTURA) lean startup(PROJEKTURA) lean startup
(PROJEKTURA) lean startupRatko Mutavdzic
 
Building the A - Team
Building the A - TeamBuilding the A - Team
Building the A - TeamLucas Bruce
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programVWO
 
How to leverage your work with a Product Mindset - Mark Opanasiuk.pdf
How to leverage your work with a Product Mindset - Mark Opanasiuk.pdfHow to leverage your work with a Product Mindset - Mark Opanasiuk.pdf
How to leverage your work with a Product Mindset - Mark Opanasiuk.pdfMark Opanasiuk
 
PM Skills & Toolkit for Driving Customer-Focused Teams
PM Skills & Toolkit for Driving Customer-Focused TeamsPM Skills & Toolkit for Driving Customer-Focused Teams
PM Skills & Toolkit for Driving Customer-Focused TeamsProduct School
 
Denver startup week outcome based roadmaps
Denver startup week   outcome based roadmapsDenver startup week   outcome based roadmaps
Denver startup week outcome based roadmapsAnderson H. Santiago
 
FXD 2018: Jen Cardello, Fidelity Investments
FXD 2018: Jen Cardello, Fidelity InvestmentsFXD 2018: Jen Cardello, Fidelity Investments
FXD 2018: Jen Cardello, Fidelity InvestmentsMad*Pow
 
Flexible Product Development Process
Flexible Product Development ProcessFlexible Product Development Process
Flexible Product Development ProcessDanielReinold1
 
Use Collaboration to Solve Your Biggest Challenges
Use Collaboration to Solve Your Biggest ChallengesUse Collaboration to Solve Your Biggest Challenges
Use Collaboration to Solve Your Biggest ChallengesApttus
 
EDUCACION GAME.. DIAPOSITIVAS INTERACTIVAS
EDUCACION GAME.. DIAPOSITIVAS INTERACTIVASEDUCACION GAME.. DIAPOSITIVAS INTERACTIVAS
EDUCACION GAME.. DIAPOSITIVAS INTERACTIVASROCIO GOMEZ DEL VALLE
 
Beyond the Crystal Ball –The Agile PMO - Heather Fleming and Justin Riservato
Beyond the Crystal Ball –The Agile PMO - Heather Fleming and Justin RiservatoBeyond the Crystal Ball –The Agile PMO - Heather Fleming and Justin Riservato
Beyond the Crystal Ball –The Agile PMO - Heather Fleming and Justin RiservatoAtlassian
 
Rapid User Research - a talk from Agile 2013 by Aviva Rosenstein
Rapid User Research - a talk from Agile 2013 by Aviva RosensteinRapid User Research - a talk from Agile 2013 by Aviva Rosenstein
Rapid User Research - a talk from Agile 2013 by Aviva RosensteinAviva Rosenstein
 

Semelhante a Orchestrating experiments at scale (20)

The right stuff - Orchestrating experiments at scale
The right stuff - Orchestrating experiments at scaleThe right stuff - Orchestrating experiments at scale
The right stuff - Orchestrating experiments at scale
 
How do you know you're ready for a Design Sprint?
How do you know you're ready for a Design Sprint?How do you know you're ready for a Design Sprint?
How do you know you're ready for a Design Sprint?
 
2.4 Product Spotlight: Designing for THEO
2.4 Product Spotlight: Designing for THEO2.4 Product Spotlight: Designing for THEO
2.4 Product Spotlight: Designing for THEO
 
Boston UXPA 2016 | What’s Worse: A Root Canal or Selecting Health Insurance
Boston UXPA 2016 | What’s Worse: A Root Canal or Selecting Health InsuranceBoston UXPA 2016 | What’s Worse: A Root Canal or Selecting Health Insurance
Boston UXPA 2016 | What’s Worse: A Root Canal or Selecting Health Insurance
 
Becoming agile with Peapod Labs Sr. Product Owner
Becoming agile with Peapod Labs Sr. Product OwnerBecoming agile with Peapod Labs Sr. Product Owner
Becoming agile with Peapod Labs Sr. Product Owner
 
Understanding The Urge To Agility
Understanding The Urge To AgilityUnderstanding The Urge To Agility
Understanding The Urge To Agility
 
(PROJEKTURA) lean startup
(PROJEKTURA) lean startup(PROJEKTURA) lean startup
(PROJEKTURA) lean startup
 
Building the A - Team
Building the A - TeamBuilding the A - Team
Building the A - Team
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO program
 
How to leverage your work with a Product Mindset - Mark Opanasiuk.pdf
How to leverage your work with a Product Mindset - Mark Opanasiuk.pdfHow to leverage your work with a Product Mindset - Mark Opanasiuk.pdf
How to leverage your work with a Product Mindset - Mark Opanasiuk.pdf
 
SIT - Innovation Consulting - New Product Development
SIT - Innovation Consulting - New Product DevelopmentSIT - Innovation Consulting - New Product Development
SIT - Innovation Consulting - New Product Development
 
PM Skills & Toolkit for Driving Customer-Focused Teams
PM Skills & Toolkit for Driving Customer-Focused TeamsPM Skills & Toolkit for Driving Customer-Focused Teams
PM Skills & Toolkit for Driving Customer-Focused Teams
 
Denver startup week outcome based roadmaps
Denver startup week   outcome based roadmapsDenver startup week   outcome based roadmaps
Denver startup week outcome based roadmaps
 
FXD 2018: Jen Cardello, Fidelity Investments
FXD 2018: Jen Cardello, Fidelity InvestmentsFXD 2018: Jen Cardello, Fidelity Investments
FXD 2018: Jen Cardello, Fidelity Investments
 
Lean UX principles
Lean UX principlesLean UX principles
Lean UX principles
 
Flexible Product Development Process
Flexible Product Development ProcessFlexible Product Development Process
Flexible Product Development Process
 
Use Collaboration to Solve Your Biggest Challenges
Use Collaboration to Solve Your Biggest ChallengesUse Collaboration to Solve Your Biggest Challenges
Use Collaboration to Solve Your Biggest Challenges
 
EDUCACION GAME.. DIAPOSITIVAS INTERACTIVAS
EDUCACION GAME.. DIAPOSITIVAS INTERACTIVASEDUCACION GAME.. DIAPOSITIVAS INTERACTIVAS
EDUCACION GAME.. DIAPOSITIVAS INTERACTIVAS
 
Beyond the Crystal Ball –The Agile PMO - Heather Fleming and Justin Riservato
Beyond the Crystal Ball –The Agile PMO - Heather Fleming and Justin RiservatoBeyond the Crystal Ball –The Agile PMO - Heather Fleming and Justin Riservato
Beyond the Crystal Ball –The Agile PMO - Heather Fleming and Justin Riservato
 
Rapid User Research - a talk from Agile 2013 by Aviva Rosenstein
Rapid User Research - a talk from Agile 2013 by Aviva RosensteinRapid User Research - a talk from Agile 2013 by Aviva Rosenstein
Rapid User Research - a talk from Agile 2013 by Aviva Rosenstein
 

Mais de matteo cavucci

Redesign Design (duo version)
Redesign Design (duo version)Redesign Design (duo version)
Redesign Design (duo version)matteo cavucci
 
As user, I hate user stories
As user, I hate user storiesAs user, I hate user stories
As user, I hate user storiesmatteo cavucci
 
NIAGARA! - a practical guide to surviving the css
NIAGARA! - a practical guide to surviving the cssNIAGARA! - a practical guide to surviving the css
NIAGARA! - a practical guide to surviving the cssmatteo cavucci
 
Perché odio i temi di WordPress
Perché odio i temi di WordPressPerché odio i temi di WordPress
Perché odio i temi di WordPressmatteo cavucci
 

Mais de matteo cavucci (7)

Redesign design V2.0
Redesign design V2.0Redesign design V2.0
Redesign design V2.0
 
Redesign Design (duo version)
Redesign Design (duo version)Redesign Design (duo version)
Redesign Design (duo version)
 
Redesign design
Redesign designRedesign design
Redesign design
 
As user, I hate user stories
As user, I hate user storiesAs user, I hate user stories
As user, I hate user stories
 
Better user stories
Better user storiesBetter user stories
Better user stories
 
NIAGARA! - a practical guide to surviving the css
NIAGARA! - a practical guide to surviving the cssNIAGARA! - a practical guide to surviving the css
NIAGARA! - a practical guide to surviving the css
 
Perché odio i temi di WordPress
Perché odio i temi di WordPressPerché odio i temi di WordPress
Perché odio i temi di WordPress
 

Último

10 Best WordPress Plugins to make the website effective in 2024
10 Best WordPress Plugins to make the website effective in 202410 Best WordPress Plugins to make the website effective in 2024
10 Best WordPress Plugins to make the website effective in 2024digital learning point
 
guest bathroom white and blue ssssssssss
guest bathroom white and blue ssssssssssguest bathroom white and blue ssssssssss
guest bathroom white and blue ssssssssssNadaMohammed714321
 
Unit1_Syllbwbnwnwneneneneneneentation_Sem2.pptx
Unit1_Syllbwbnwnwneneneneneneentation_Sem2.pptxUnit1_Syllbwbnwnwneneneneneneentation_Sem2.pptx
Unit1_Syllbwbnwnwneneneneneneentation_Sem2.pptxNitish292041
 
Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Rndexperts
 
General Knowledge Quiz Game C++ CODE.pptx
General Knowledge Quiz Game C++ CODE.pptxGeneral Knowledge Quiz Game C++ CODE.pptx
General Knowledge Quiz Game C++ CODE.pptxmarckustrevion
 
怎么办理英国Newcastle毕业证纽卡斯尔大学学位证书一手渠道
怎么办理英国Newcastle毕业证纽卡斯尔大学学位证书一手渠道怎么办理英国Newcastle毕业证纽卡斯尔大学学位证书一手渠道
怎么办理英国Newcastle毕业证纽卡斯尔大学学位证书一手渠道yrolcks
 
guest bathroom white and bluesssssssssss
guest bathroom white and bluesssssssssssguest bathroom white and bluesssssssssss
guest bathroom white and bluesssssssssssNadaMohammed714321
 
group_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfgroup_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfneelspinoy
 
Making and Unmaking of Chandigarh - A City of Two Plans2-4-24.ppt
Making and Unmaking of Chandigarh - A City of Two Plans2-4-24.pptMaking and Unmaking of Chandigarh - A City of Two Plans2-4-24.ppt
Making and Unmaking of Chandigarh - A City of Two Plans2-4-24.pptJIT KUMAR GUPTA
 
Interior Design for Office a cura di RMG Project Studio
Interior Design for Office a cura di RMG Project StudioInterior Design for Office a cura di RMG Project Studio
Interior Design for Office a cura di RMG Project StudioRMG Project Studio
 
Giulio Michelon, Founder di @Belka – “Oltre le Stime: Sviluppare una Mentalit...
Giulio Michelon, Founder di @Belka – “Oltre le Stime: Sviluppare una Mentalit...Giulio Michelon, Founder di @Belka – “Oltre le Stime: Sviluppare una Mentalit...
Giulio Michelon, Founder di @Belka – “Oltre le Stime: Sviluppare una Mentalit...Associazione Digital Days
 
AI and Design Vol. 2: Navigating the New Frontier - Morgenbooster
AI and Design Vol. 2: Navigating the New Frontier - MorgenboosterAI and Design Vol. 2: Navigating the New Frontier - Morgenbooster
AI and Design Vol. 2: Navigating the New Frontier - Morgenbooster1508 A/S
 
cda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptcda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptMaryamAfzal41
 
world health day 2024.pptxgbbvggvbhjjjbbbb
world health day 2024.pptxgbbvggvbhjjjbbbbworld health day 2024.pptxgbbvggvbhjjjbbbb
world health day 2024.pptxgbbvggvbhjjjbbbbpreetirao780
 
DAKSHIN BIHAR GRAMIN BANK: REDEFINING THE DIGITAL BANKING EXPERIENCE WITH A U...
DAKSHIN BIHAR GRAMIN BANK: REDEFINING THE DIGITAL BANKING EXPERIENCE WITH A U...DAKSHIN BIHAR GRAMIN BANK: REDEFINING THE DIGITAL BANKING EXPERIENCE WITH A U...
DAKSHIN BIHAR GRAMIN BANK: REDEFINING THE DIGITAL BANKING EXPERIENCE WITH A U...Rishabh Aryan
 
Piece by Piece Magazine
Piece by Piece Magazine                      Piece by Piece Magazine
Piece by Piece Magazine CharlottePulte
 
Pearl Disrtrict urban analyusis study pptx
Pearl Disrtrict urban analyusis study pptxPearl Disrtrict urban analyusis study pptx
Pearl Disrtrict urban analyusis study pptxDanielTamiru4
 
How to Empower the future of UX Design with Gen AI
How to Empower the future of UX Design with Gen AIHow to Empower the future of UX Design with Gen AI
How to Empower the future of UX Design with Gen AIyuj
 
The spirit of digital place - game worlds and architectural phenomenology
The spirit of digital place - game worlds and architectural phenomenologyThe spirit of digital place - game worlds and architectural phenomenology
The spirit of digital place - game worlds and architectural phenomenologyChristopher Totten
 
Color Theory Explained for Noobs- Think360 Studio
Color Theory Explained for Noobs- Think360 StudioColor Theory Explained for Noobs- Think360 Studio
Color Theory Explained for Noobs- Think360 StudioThink360 Studio
 

Último (20)

10 Best WordPress Plugins to make the website effective in 2024
10 Best WordPress Plugins to make the website effective in 202410 Best WordPress Plugins to make the website effective in 2024
10 Best WordPress Plugins to make the website effective in 2024
 
guest bathroom white and blue ssssssssss
guest bathroom white and blue ssssssssssguest bathroom white and blue ssssssssss
guest bathroom white and blue ssssssssss
 
Unit1_Syllbwbnwnwneneneneneneentation_Sem2.pptx
Unit1_Syllbwbnwnwneneneneneneentation_Sem2.pptxUnit1_Syllbwbnwnwneneneneneneentation_Sem2.pptx
Unit1_Syllbwbnwnwneneneneneneentation_Sem2.pptx
 
Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025
 
General Knowledge Quiz Game C++ CODE.pptx
General Knowledge Quiz Game C++ CODE.pptxGeneral Knowledge Quiz Game C++ CODE.pptx
General Knowledge Quiz Game C++ CODE.pptx
 
怎么办理英国Newcastle毕业证纽卡斯尔大学学位证书一手渠道
怎么办理英国Newcastle毕业证纽卡斯尔大学学位证书一手渠道怎么办理英国Newcastle毕业证纽卡斯尔大学学位证书一手渠道
怎么办理英国Newcastle毕业证纽卡斯尔大学学位证书一手渠道
 
guest bathroom white and bluesssssssssss
guest bathroom white and bluesssssssssssguest bathroom white and bluesssssssssss
guest bathroom white and bluesssssssssss
 
group_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfgroup_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdf
 
Making and Unmaking of Chandigarh - A City of Two Plans2-4-24.ppt
Making and Unmaking of Chandigarh - A City of Two Plans2-4-24.pptMaking and Unmaking of Chandigarh - A City of Two Plans2-4-24.ppt
Making and Unmaking of Chandigarh - A City of Two Plans2-4-24.ppt
 
Interior Design for Office a cura di RMG Project Studio
Interior Design for Office a cura di RMG Project StudioInterior Design for Office a cura di RMG Project Studio
Interior Design for Office a cura di RMG Project Studio
 
Giulio Michelon, Founder di @Belka – “Oltre le Stime: Sviluppare una Mentalit...
Giulio Michelon, Founder di @Belka – “Oltre le Stime: Sviluppare una Mentalit...Giulio Michelon, Founder di @Belka – “Oltre le Stime: Sviluppare una Mentalit...
Giulio Michelon, Founder di @Belka – “Oltre le Stime: Sviluppare una Mentalit...
 
AI and Design Vol. 2: Navigating the New Frontier - Morgenbooster
AI and Design Vol. 2: Navigating the New Frontier - MorgenboosterAI and Design Vol. 2: Navigating the New Frontier - Morgenbooster
AI and Design Vol. 2: Navigating the New Frontier - Morgenbooster
 
cda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptcda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis ppt
 
world health day 2024.pptxgbbvggvbhjjjbbbb
world health day 2024.pptxgbbvggvbhjjjbbbbworld health day 2024.pptxgbbvggvbhjjjbbbb
world health day 2024.pptxgbbvggvbhjjjbbbb
 
DAKSHIN BIHAR GRAMIN BANK: REDEFINING THE DIGITAL BANKING EXPERIENCE WITH A U...
DAKSHIN BIHAR GRAMIN BANK: REDEFINING THE DIGITAL BANKING EXPERIENCE WITH A U...DAKSHIN BIHAR GRAMIN BANK: REDEFINING THE DIGITAL BANKING EXPERIENCE WITH A U...
DAKSHIN BIHAR GRAMIN BANK: REDEFINING THE DIGITAL BANKING EXPERIENCE WITH A U...
 
Piece by Piece Magazine
Piece by Piece Magazine                      Piece by Piece Magazine
Piece by Piece Magazine
 
Pearl Disrtrict urban analyusis study pptx
Pearl Disrtrict urban analyusis study pptxPearl Disrtrict urban analyusis study pptx
Pearl Disrtrict urban analyusis study pptx
 
How to Empower the future of UX Design with Gen AI
How to Empower the future of UX Design with Gen AIHow to Empower the future of UX Design with Gen AI
How to Empower the future of UX Design with Gen AI
 
The spirit of digital place - game worlds and architectural phenomenology
The spirit of digital place - game worlds and architectural phenomenologyThe spirit of digital place - game worlds and architectural phenomenology
The spirit of digital place - game worlds and architectural phenomenology
 
Color Theory Explained for Noobs- Think360 Studio
Color Theory Explained for Noobs- Think360 StudioColor Theory Explained for Noobs- Think360 Studio
Color Theory Explained for Noobs- Think360 Studio
 

Orchestrating experiments at scale

  • 1. Orchestrating experiments at scale Flowcon 27 November 2018 Paris, France Matteo Cavucci @matteomced
  • 2. Let’s make experiments for our product, so we’ll find out what to build!
  • 3. Shut up, you chump! We know already what to build. Have a look at our product strategy. Let’s make experiments for our product, so we’ll find out what to build!
  • 4. Shut up, you chump! We know already what to build. Have a look at our product strategy. Let’s make experiments for our product, so we’ll find out what to build! …and we had a design sprint 3 months ago. Get back to work!
  • 5. The important things I have to say today • You can’t create a successful product without having people aligned on purpose and goals. • The product strategy is a visual tool to connect business and delivery. • Prioritising by value and outcomes requires continuous validation.
  • 7. Matteo Cavucci • Italian, but living in Berlin • Ex ThoughtWorks, now independent • Supporting executives, managers, and teams improving ideation, planning, and delivery of software products. • I’ve been hired as a dev, designer, PM, Scrum Master, PO, etc… • A process nerd! @matteoMCED
  • 8. What is a product strategy?
  • 9. It's developer's understanding, not your knowledge that becomes the product. — Alberto Brandolini
  • 10.
  • 11. Issues with traditional product strategy • General lack of alignment and accountability to a common business goal.
 • Decision making is not enabled by people doing the work. • Work is measured and prioritised by output, not value delivered.
 • Too many handoffs between silos leading to poor execution and delays.

  • 14. Verschlimmbesserung An action that is supposed to improve something, but ends up making it worse. “It’s not an improvement; it’s a Verschlimmbesserung!”
  • 17. The challenge • A large org producing one of the most beloved software product of the internet history.
 • Based in North America, but with team members distributed all around the globe. • A large base of contributors, from semi- professional partitioners to corporations.
  • 18. Find new ways to attract and delight the next four million users.
  • 19. A cross-functional team of domain experts Tech lead UX designer Product owner Community Program manager Tech lead User researcher Marketing
  • 20. A different set of principles • Focus on learnings, instead of the mere creation of artefacts with a continuous process of discovery. • Prioritise according the desired impact, not the expected deliverable. • Empower distributed, autonomous teams to take the right decisions, keeping a consistent focus on the global product.

  • 21. From multiple ideas to an actionable, adaptive roadmap
  • 26. Mapping the current flow spot areas of improvement
  • 27.
  • 28. What is eventstorming? Accelerate group learning using DDD principles and Gamestorming approach Eventstorming is a rapid, lightweight and intense group modelling technique. It makes easy to quickly understand domains and accelerate business and tech teams in designing complex and powerful solutions for their products and processes.
  • 29. Why it works so well Everybody is involved - Eventstorming is designed to create conversations between many people at the same time Driven by participants - The focus and the deepness of the conversation is decided by the crowd. Incremental notation - Introduce specific notations when is needed, if is needed. Complex, not linear - Reality is rarely a linear journey. Eventstorming captures the hidden complexity of products. A common language for all - Precise and powerful language, familiar and easy to learn by people with different backgrounds.
  • 30.
  • 31. How does it works Describe what you know in events • Orange sticky note • Verb at past tense • Relevant for domain experts Examples: • New extension submitted for review. • Extension rated as excellent by end user. • Extension promoted as featured. …and place them along a timeline • What do we need to have this event happening? • What other event is triggered by this event?
  • 32. From insights to opportunities exploration structure boundaries frictions opportunities
  • 34. Establish a direction toward which all the work should contribute
  • 35. Set a leading Vision • A description of what place in the market the organization seeks to achieve. • Ambitious enough to inspire and set a clear direction. • Actionable in a reasonable timeframe (6/12 months). • Relevant for the business and meaningful for the teams.
  • 36. Take a look into the future • What do we want to feel when working with the community of developers? • What do we want the developers to feel when working with us? • What do we want the extension makers to feel about our work together? • What do we want the end user think about our service? • What do we want the end user to say about our service? • How would we describe the future service?
  • 38. topic A topic B topic C topic D topic E Grouping opportunities
  • 39. topic A topic B topic C topic D topic E Leading Vision Visualising relations
  • 40. Initiative The Lean Value Tree • The Lean Value Tree is a visual tool to facilitate capturing and sharing the product strategy • An effective way to share and analyse desired outcomes, examine risks, and continuously prioritize what is needed. Leading Vision Bet Experiment Bet Goal GoalGoal
  • 41. Goal A Goal B Goal C Goal D Goal E Leading Vision From topics to high-level Goals
  • 42. GOAL: CURRENT SITUATION: IMPACT: INDICATORS: USER: A name capturing the high-level goal Customer selection & focus Observations and insights from the current implementation The result we’d like to achieve in terms of behavioural change How are we going to observe the change
  • 43. From opportunities to Bets Goal A leading vision Bet 1 Bet 2 Bet 3
  • 44. BET: PEOPLE:POTENTIAL RISKS: INDICATORS: HYPOTHESIS: A name capturing the Bet We believe that _________ will result in ________________ Who need to be involved, and how THE SCENARIO: A brief description of the desired scenario from user’s perspective How are we going to observe the change Whatever we need to keep in mind when validating this Bet EXP. IMPACT: Hi/Mid/Low
  • 45.
  • 47. WIP per Goal: 2 WIP per quarter: 9 Prioritise Bets YES YES, BUT LATER
  • 48. WIP per Goal: 2 WIP per quarter: 9 Prioritise Bets THIS QUARTER NEXT QUARTER
  • 49. From Bets to Experiments Goal A Leading Vision Bet 1 Experiment 1 Experiment 2 Experiment 3 Experiment 4 Team
  • 50. EXPERIMENT: ACTIONS: INDICATORS: A name capturing the experiment What are we planning to gather data Metrics and results to measure the change EXPECTATIONS: What do we like to see DUE DATE:
  • 52. Becoming the 2019 go-to conference for managers and PO in Europe.
  • 53. Becoming the 2019 go-to conference for managers and PO in Europe. An immersive attendee experience Attracting enthusiast sponsors Cutting edge presentations Growing a community
  • 54. Becoming the 2019 go-to conference for managers and POs in Europe An immersive attendee experience Attracting enthusiast sponsors Cutting edge presentations Growing a community Offering spaces for networking Connect with speakers Get feedback on real life challenges
  • 55. Becoming the 2019 go-to conference for managers and POs in Europe An immersive attendee experience Attracting enthusiast sponsors Cutting edge presentations Growing a community Get feedback on real life challenges Unconference space Coaching corner by speakers Q&A panel with moderated questions from the audience
  • 56. A different way of thinking
  • 60. Challenge the “but this is how we always do it” mentality