SlideShare uma empresa Scribd logo
1 de 19
Baixar para ler offline
W1	
  
Test	
  Management	
  
10/4/17	
  11:30	
  
The	
  Lean	
  Startup	
  Method:	
  Its	
  Value	
  for	
  
Testers	
  
Presented	
  by:	
  
Lee	
  Copeland	
  
	
  TechWell	
  Corp.	
  
Brought	
  to	
  you	
  by:	
  
350	
  Corporate	
  Way,	
  Suite	
  400,	
  Orange	
  Park,	
  FL	
  32073	
  	
  
888-­‐-­‐-­‐268-­‐-­‐-­‐8770	
  ·∙·∙	
  904-­‐-­‐-­‐278-­‐-­‐-­‐0524	
  -­‐	
  info@techwell.com	
  -­‐	
  http://www.starwest.techwell.com/	
  
 
Lee	
  Copeland	
  
TechWell	
  Corp.	
  
	
  
With	
  more	
  than	
  forty	
  years	
  of	
  experience	
  as	
  an	
  information	
  systems	
  professional	
  
at	
  commercial	
  and	
  nonprofit	
  organizations,	
  Lee	
  Copeland	
  has	
  held	
  technical	
  and	
  
managerial	
  positions	
  in	
  applications	
  development,	
  software	
  testing,	
  and	
  software	
  
process	
  improvement.	
  At	
  TechWell,	
  Lee	
  has	
  developed	
  and	
  taught	
  numerous	
  
training	
  courses	
  on	
  software	
  development	
  and	
  testing	
  issues,	
  and	
  is	
  a	
  sought-­‐
after	
  speaker	
  at	
  software	
  conferences	
  in	
  the	
  United	
  States	
  and	
  abroad.	
  He	
  is	
  the	
  
author	
  of	
  the	
  popular	
  reference	
  book,	
  A	
  Practitioner’s	
  Guide	
  to	
  Software	
  Test	
  
Design.	
  
	
  
2	
  
3	
  
Lee Copeland
TechWell
lee@techwell.com
@grandpacopeland
Testing Lessons
from Lean Startups
4	
  4	
  
Topics
•  The Dismal Record of Startups
•  Eric Ries
•  Foundations of Lean Startup
•  What Value for Testers?
3	
  
5	
  5	
  
The Dismal Record of Startups
•  A startup is an organization
created to deliver a new
product or service under
conditions of extreme
uncertainty
6	
  6	
  
The Dismal Record of Startups
•  Shikhar Ghosh of the Harvard Business School
reported these statistics:
–  95% of startups will fall short
of their financial projections
–  80% will fail to meet their
projected return on investment
–  40% will cease operations with
investors losing everything
4	
  
7	
  7	
  
The Dismal Record of Startups
•  The #1 cause of failure = No Market for their
Product
•  It’s a great product or service that no one
wants to buy
8	
  8	
  
Eric Ries
•  An entrepreneur with an
impressive track record
–  Product to connect students
with … employers
–  Product to let people play in
a 3D virtual world
5	
  
9	
  9	
  
Eric Ries
•  Ries discovered that under conditions of
extreme uncertainty, classical management
methods do not bring success
‒  When we lack knowledge – we gather more
information
‒  When we lack alignment – we give more
detailed instructions
‒  When outcomes are not what we expected –
we impose more detailed controls
10	
  10	
  
Eric Ries
•  He formulated the Lean
Startup methodology
based on his and others’
experiences
6	
  
11	
  11	
  
Foundations of Lean Startup
1.  Customer Development
2.  Build-Measure-Learn (BML) Loop
3.  Minimum Viable Product (MVP)
4.  Validated Learning
5.  One Metric That Matters (OMTM)
12	
  12	
  
1. Customer Development
•  Learning and discovering who a company’s
initial customers will be, and what markets they
are in, requires a separate, distinct, and parallel
process from Product Development
― Steve Blank
7	
  
13	
  13	
  
2. Build-Measure-Learn Loop
In rapid iterations
Persevere or Pivot?
•  GOAL:
14	
  14	
  
3. Minimum Viable Product (MVP)
8	
  
•  The MVP is that version of the product that
enables a full turn of the Build-Measure-Learn
loop with a minimum amount of effort and the
least amount of development time
15	
  15	
  
3. Minimum Viable Product (MVP)
•  The minimum viable product lacks many
features that may prove essential later on – and
that’s OK
16	
  16	
  
3. Minimum Viable Product (MVP)
(Final product)(Minimum
viable product)
9	
  
17	
  17	
  
4. Validated Learning
•  Validated learning is “the process of
demonstrating empirically that the team has
discovered valuable truths about the present
and future business prospects”
18	
  18	
  
5. One Metric That Matters (OMTM)
•  Most metrics gathered by organizations are
“vanity metrics.” They make us feel good (or
look good), but don’t really show progress
toward our goal
Number of
customers
Cost to obtain
each new
customer
Number of
customers
actually using
the product
10	
  
19	
  19	
  
5. One Metric That Matters (OMTM)
•  The One Metric That Matters measures the one
most important thing at the present state of the
startup
20	
  20	
  
The Lean Startup Methodology
What Value for Testers?
11	
  
21	
  21	
  
What Value for Testers?
•  As software testers, we are rarely part of an
entrepreneurial startup team
•  Are there lessons for us from the Lean Startup
methodology?
22	
  22	
  
1. Customer Development
•  Ask:
–  Who are our customers?
–  What are their problems
our testing solves?
–  Do our customers perceive
these problems as
important?
–  Are they willing to pay for
our testing services?
12	
  
23	
  23	
  
1. Customer Development
•  Customer Development suggests that we
should identify the “customers” of our
TESTING SERVICES:
–  Developers
–  Users
–  Management
And serve THEM, not our testing process
24	
  24	
  
1. Customer Development
•  Or this could be our future …
Largest dot-com
flop in history
Raised $375 million
in first public
offering on revenue
of $395,000 and net
losses of $50
million
13	
  
25	
  25	
  
2. Build-Measure-Learn Loop
•  BML loop is equivalent to the Exploratory
Testing loop
This	
  is	
  
where	
  
we	
  start	
  
Not	
  here!	
  
26	
  26	
  
3. Minimal Viable Product (MVP)
•  The idea of an MVP
suggests we could
start with a Minimal
Viable Set of Tests
•  Don’t strive for
“completeness” from
the beginning
•  Add additional tests
as the need becomes
apparent and
warranted
Learn	
  what	
  your	
  
customers	
  want/
need/value	
  
14	
  
27	
  27	
  
4. Validated Learning
“It isn't what we don't
know that gives us
trouble, it's what we
know that ain't so”
Will Rogers
American Humorist
28	
  28	
  
4. Validated Learning
•  The Lean Startup
methodology suggests
running frequent
experiments to determine
customer response
•  As testers, we can run
frequent tests to determine
both system capabilities
and customer satisfaction
15	
  
29	
  29	
  
5. One Metric That Matters
30	
  30	
  
5. One Metric That Matters
•  Is your metrics program an example of
“success theatre”?
16	
  
31	
  31	
  
5. One Metric That Matters
•  Replace the dozens of vanity metrics …
–  Test cases planned
–  Test cases implemented
–  Test cases executed
–  Test cases passed
–  Test cases failed
–  …
32	
  32	
  
5. One Metric That Matters
•  … with one that is truly indicative of something
vital
17	
  
33	
  33	
  
5. One Metric That Matters
•  Does your metric
–  Measure your success at improving quality?
–  Directly relate to product success?
–  Tie to real customers of your service?
–  Help you determine what to do next?
Ivory Madison, “Bonfire of the Vanity Metrics”
34	
  34	
  
In Conclusion
•  The Lean Startup methodology has many
insights to offer to software testers
•  Become familiar with its precepts. Adopt its
ideas for your testing
18	
  
35	
  35	
  
Thanks
Tạm biệt từ Việt NamGood bye from Viet Nam
36	
  36	
  
One Final Bit of Advice
Be Open to Serendipity
“Finding something good
without looking for it”

Mais conteúdo relacionado

Mais procurados

The Future of Testing
The Future of TestingThe Future of Testing
The Future of TestingPaul Gerrard
 
Niels Malotaux - Help We Have a QA Problem!
Niels Malotaux -  Help We Have a QA Problem!Niels Malotaux -  Help We Have a QA Problem!
Niels Malotaux - Help We Have a QA Problem!TEST Huddle
 
Kristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's SeatKristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's SeatTEST Huddle
 
From good to great emetrics_dc_keynote
From good to great emetrics_dc_keynoteFrom good to great emetrics_dc_keynote
From good to great emetrics_dc_keynoteEd Wu
 
Boost Your Intelligent Assistants with UX Testing
Boost Your Intelligent Assistants with UX TestingBoost Your Intelligent Assistants with UX Testing
Boost Your Intelligent Assistants with UX TestingApplause
 
Innovation day 2012 11. luc van goethem & frederik wouters - verhaert - 'r...
Innovation day 2012   11. luc van goethem & frederik wouters - verhaert -  'r...Innovation day 2012   11. luc van goethem & frederik wouters - verhaert -  'r...
Innovation day 2012 11. luc van goethem & frederik wouters - verhaert - 'r...Verhaert Masters in Innovation
 
Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)Rob Crowley
 
Kelly stephen product launch vs escape
Kelly stephen   product launch vs escapeKelly stephen   product launch vs escape
Kelly stephen product launch vs escapeProductCamp SoCal
 
Hans-Henrik Olesen - What to Automate and What not to Automate
Hans-Henrik Olesen - What to Automate and What not to AutomateHans-Henrik Olesen - What to Automate and What not to Automate
Hans-Henrik Olesen - What to Automate and What not to AutomateTEST Huddle
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTechWell
 
Innovation Experiment Systems Practices (ICSOB 2015)
Innovation Experiment Systems Practices (ICSOB 2015)Innovation Experiment Systems Practices (ICSOB 2015)
Innovation Experiment Systems Practices (ICSOB 2015)Teemu Karvonen
 
Top 15 reasons to choose qa testing as career
Top 15 reasons to choose qa testing as career Top 15 reasons to choose qa testing as career
Top 15 reasons to choose qa testing as career JanBask Training
 
What is Customer Validation
What is Customer ValidationWhat is Customer Validation
What is Customer ValidationCentercode
 
Key Success Factors in New Product Efforts
Key Success Factors in New Product EffortsKey Success Factors in New Product Efforts
Key Success Factors in New Product EffortsAtul Setlur
 
Challenges with measuring quality for agile distributed research type project
Challenges with measuring quality for agile distributed research type projectChallenges with measuring quality for agile distributed research type project
Challenges with measuring quality for agile distributed research type projectChandan Patary
 
Odoo Implementation Methodology
Odoo Implementation MethodologyOdoo Implementation Methodology
Odoo Implementation MethodologyQuang Ngoc
 
Help we are doing Lean but we are not improving by ING
Help we are doing Lean but we are not improving by INGHelp we are doing Lean but we are not improving by ING
Help we are doing Lean but we are not improving by INGInstitut Lean France
 

Mais procurados (20)

The Future of Testing
The Future of TestingThe Future of Testing
The Future of Testing
 
Niels Malotaux - Help We Have a QA Problem!
Niels Malotaux -  Help We Have a QA Problem!Niels Malotaux -  Help We Have a QA Problem!
Niels Malotaux - Help We Have a QA Problem!
 
Kristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's SeatKristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's Seat
 
Martijn Beijk & Charles Goodall
Martijn Beijk & Charles GoodallMartijn Beijk & Charles Goodall
Martijn Beijk & Charles Goodall
 
From good to great emetrics_dc_keynote
From good to great emetrics_dc_keynoteFrom good to great emetrics_dc_keynote
From good to great emetrics_dc_keynote
 
Boost Your Intelligent Assistants with UX Testing
Boost Your Intelligent Assistants with UX TestingBoost Your Intelligent Assistants with UX Testing
Boost Your Intelligent Assistants with UX Testing
 
William "RED" Davidson Presentation
William "RED" Davidson Presentation William "RED" Davidson Presentation
William "RED" Davidson Presentation
 
Rich Mironov Presentation
Rich Mironov PresentationRich Mironov Presentation
Rich Mironov Presentation
 
Innovation day 2012 11. luc van goethem & frederik wouters - verhaert - 'r...
Innovation day 2012   11. luc van goethem & frederik wouters - verhaert -  'r...Innovation day 2012   11. luc van goethem & frederik wouters - verhaert -  'r...
Innovation day 2012 11. luc van goethem & frederik wouters - verhaert - 'r...
 
Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)
 
Kelly stephen product launch vs escape
Kelly stephen   product launch vs escapeKelly stephen   product launch vs escape
Kelly stephen product launch vs escape
 
Hans-Henrik Olesen - What to Automate and What not to Automate
Hans-Henrik Olesen - What to Automate and What not to AutomateHans-Henrik Olesen - What to Automate and What not to Automate
Hans-Henrik Olesen - What to Automate and What not to Automate
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Innovation Experiment Systems Practices (ICSOB 2015)
Innovation Experiment Systems Practices (ICSOB 2015)Innovation Experiment Systems Practices (ICSOB 2015)
Innovation Experiment Systems Practices (ICSOB 2015)
 
Top 15 reasons to choose qa testing as career
Top 15 reasons to choose qa testing as career Top 15 reasons to choose qa testing as career
Top 15 reasons to choose qa testing as career
 
What is Customer Validation
What is Customer ValidationWhat is Customer Validation
What is Customer Validation
 
Key Success Factors in New Product Efforts
Key Success Factors in New Product EffortsKey Success Factors in New Product Efforts
Key Success Factors in New Product Efforts
 
Challenges with measuring quality for agile distributed research type project
Challenges with measuring quality for agile distributed research type projectChallenges with measuring quality for agile distributed research type project
Challenges with measuring quality for agile distributed research type project
 
Odoo Implementation Methodology
Odoo Implementation MethodologyOdoo Implementation Methodology
Odoo Implementation Methodology
 
Help we are doing Lean but we are not improving by ING
Help we are doing Lean but we are not improving by INGHelp we are doing Lean but we are not improving by ING
Help we are doing Lean but we are not improving by ING
 

Semelhante a The Lean Startup Method: Its Value for Testers

The Lean Startup Method and Its Value for Testers
The Lean Startup Method and Its Value for TestersThe Lean Startup Method and Its Value for Testers
The Lean Startup Method and Its Value for TestersJosiah Renaudin
 
E101 october 24 2012 entrepreneurial management
E101 october 24 2012 entrepreneurial managementE101 october 24 2012 entrepreneurial management
E101 october 24 2012 entrepreneurial managementJon E Worren
 
EIS-PM-Devt-Services-Boot Camp_Combined (1)
EIS-PM-Devt-Services-Boot Camp_Combined (1)EIS-PM-Devt-Services-Boot Camp_Combined (1)
EIS-PM-Devt-Services-Boot Camp_Combined (1)Thomas Squeo
 
Разработка эффективной тестовой стратегии, Антон Семенченко
Разработка эффективной тестовой стратегии, Антон СеменченкоРазработка эффективной тестовой стратегии, Антон Семенченко
Разработка эффективной тестовой стратегии, Антон СеменченкоCOMAQA.BY
 
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)Ron Lazaro
 
ProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoftProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoftProduct Excellence
 
Motarme Customer Development Workshop for Trinity Launchbox July 2015
Motarme Customer Development Workshop for Trinity Launchbox July 2015Motarme Customer Development Workshop for Trinity Launchbox July 2015
Motarme Customer Development Workshop for Trinity Launchbox July 2015Motarme Marketing Technology
 
Build Innovation into Your Admin Routine
Build Innovation into Your Admin RoutineBuild Innovation into Your Admin Routine
Build Innovation into Your Admin RoutineSalesforce Admins
 
Construction Future Wales Performance Management (Benchmarking) 2016
Construction Future Wales Performance Management (Benchmarking) 2016Construction Future Wales Performance Management (Benchmarking) 2016
Construction Future Wales Performance Management (Benchmarking) 2016Rae Davies
 
Creating Irresistible Products in 4 Steps by Google Product Leader
Creating Irresistible Products in 4 Steps by Google Product LeaderCreating Irresistible Products in 4 Steps by Google Product Leader
Creating Irresistible Products in 4 Steps by Google Product LeaderProduct School
 
Lean start up bootcamp 1 introduction
Lean start up bootcamp 1   introductionLean start up bootcamp 1   introduction
Lean start up bootcamp 1 introductionJames Cracknell
 
Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2Edmund FOng
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation OrchestraOptimizely
 
Product Management Playbook product inception to launch
Product Management Playbook   product inception to launchProduct Management Playbook   product inception to launch
Product Management Playbook product inception to launchjhassemer
 
Lean startup, customer development, and the business model canvas
Lean startup, customer development, and the business model canvasLean startup, customer development, and the business model canvas
Lean startup, customer development, and the business model canvasgistinitiative
 

Semelhante a The Lean Startup Method: Its Value for Testers (20)

The Lean Startup Method and Its Value for Testers
The Lean Startup Method and Its Value for TestersThe Lean Startup Method and Its Value for Testers
The Lean Startup Method and Its Value for Testers
 
E101 october 24 2012 entrepreneurial management
E101 october 24 2012 entrepreneurial managementE101 october 24 2012 entrepreneurial management
E101 october 24 2012 entrepreneurial management
 
Lean startup
Lean startup Lean startup
Lean startup
 
EIS-PM-Devt-Services-Boot Camp_Combined (1)
EIS-PM-Devt-Services-Boot Camp_Combined (1)EIS-PM-Devt-Services-Boot Camp_Combined (1)
EIS-PM-Devt-Services-Boot Camp_Combined (1)
 
Разработка эффективной тестовой стратегии, Антон Семенченко
Разработка эффективной тестовой стратегии, Антон СеменченкоРазработка эффективной тестовой стратегии, Антон Семенченко
Разработка эффективной тестовой стратегии, Антон Семенченко
 
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
 
ProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoftProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoft
 
Motarme Customer Development Workshop for Trinity Launchbox July 2015
Motarme Customer Development Workshop for Trinity Launchbox July 2015Motarme Customer Development Workshop for Trinity Launchbox July 2015
Motarme Customer Development Workshop for Trinity Launchbox July 2015
 
Build Innovation into Your Admin Routine
Build Innovation into Your Admin RoutineBuild Innovation into Your Admin Routine
Build Innovation into Your Admin Routine
 
Lean UX principles
Lean UX principlesLean UX principles
Lean UX principles
 
Agile metrics at-pmi bangalore
Agile metrics at-pmi bangaloreAgile metrics at-pmi bangalore
Agile metrics at-pmi bangalore
 
Lean Startup 301
Lean Startup 301Lean Startup 301
Lean Startup 301
 
Construction Future Wales Performance Management (Benchmarking) 2016
Construction Future Wales Performance Management (Benchmarking) 2016Construction Future Wales Performance Management (Benchmarking) 2016
Construction Future Wales Performance Management (Benchmarking) 2016
 
Creating Irresistible Products in 4 Steps by Google Product Leader
Creating Irresistible Products in 4 Steps by Google Product LeaderCreating Irresistible Products in 4 Steps by Google Product Leader
Creating Irresistible Products in 4 Steps by Google Product Leader
 
Lean start up bootcamp 1 introduction
Lean start up bootcamp 1   introductionLean start up bootcamp 1   introduction
Lean start up bootcamp 1 introduction
 
Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation Orchestra
 
BFBM(1-2016) Startup with mvp
 BFBM(1-2016) Startup with mvp BFBM(1-2016) Startup with mvp
BFBM(1-2016) Startup with mvp
 
Product Management Playbook product inception to launch
Product Management Playbook   product inception to launchProduct Management Playbook   product inception to launch
Product Management Playbook product inception to launch
 
Lean startup, customer development, and the business model canvas
Lean startup, customer development, and the business model canvasLean startup, customer development, and the business model canvas
Lean startup, customer development, and the business model canvas
 

Mais de TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and RecoveringTechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartTechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyTechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowTechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipTechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsTechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationTechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessTechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateTechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessTechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayTechWell
 

Mais de TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development Today
 

Último

%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrainmasabamasaba
 
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park %in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park masabamasaba
 
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...masabamasaba
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfonteinmasabamasaba
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...SelfMade bd
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...masabamasaba
 
WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2
 
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...masabamasaba
 
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Hararemasabamasaba
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is insideshinachiaurasa2
 
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...masabamasaba
 
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...masabamasaba
 
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyviewmasabamasaba
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...Shane Coughlan
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...chiefasafspells
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...Jittipong Loespradit
 
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...WSO2
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisamasabamasaba
 
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburgmasabamasaba
 

Último (20)

%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
 
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park %in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
 
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
 
WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?
 
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
 
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
 
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
 
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
 

The Lean Startup Method: Its Value for Testers

  • 1. W1   Test  Management   10/4/17  11:30   The  Lean  Startup  Method:  Its  Value  for   Testers   Presented  by:   Lee  Copeland    TechWell  Corp.   Brought  to  you  by:   350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073     888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  info@techwell.com  -­‐  http://www.starwest.techwell.com/  
  • 2.   Lee  Copeland   TechWell  Corp.     With  more  than  forty  years  of  experience  as  an  information  systems  professional   at  commercial  and  nonprofit  organizations,  Lee  Copeland  has  held  technical  and   managerial  positions  in  applications  development,  software  testing,  and  software   process  improvement.  At  TechWell,  Lee  has  developed  and  taught  numerous   training  courses  on  software  development  and  testing  issues,  and  is  a  sought-­‐ after  speaker  at  software  conferences  in  the  United  States  and  abroad.  He  is  the   author  of  the  popular  reference  book,  A  Practitioner’s  Guide  to  Software  Test   Design.    
  • 3. 2   3   Lee Copeland TechWell lee@techwell.com @grandpacopeland Testing Lessons from Lean Startups 4  4   Topics •  The Dismal Record of Startups •  Eric Ries •  Foundations of Lean Startup •  What Value for Testers?
  • 4. 3   5  5   The Dismal Record of Startups •  A startup is an organization created to deliver a new product or service under conditions of extreme uncertainty 6  6   The Dismal Record of Startups •  Shikhar Ghosh of the Harvard Business School reported these statistics: –  95% of startups will fall short of their financial projections –  80% will fail to meet their projected return on investment –  40% will cease operations with investors losing everything
  • 5. 4   7  7   The Dismal Record of Startups •  The #1 cause of failure = No Market for their Product •  It’s a great product or service that no one wants to buy 8  8   Eric Ries •  An entrepreneur with an impressive track record –  Product to connect students with … employers –  Product to let people play in a 3D virtual world
  • 6. 5   9  9   Eric Ries •  Ries discovered that under conditions of extreme uncertainty, classical management methods do not bring success ‒  When we lack knowledge – we gather more information ‒  When we lack alignment – we give more detailed instructions ‒  When outcomes are not what we expected – we impose more detailed controls 10  10   Eric Ries •  He formulated the Lean Startup methodology based on his and others’ experiences
  • 7. 6   11  11   Foundations of Lean Startup 1.  Customer Development 2.  Build-Measure-Learn (BML) Loop 3.  Minimum Viable Product (MVP) 4.  Validated Learning 5.  One Metric That Matters (OMTM) 12  12   1. Customer Development •  Learning and discovering who a company’s initial customers will be, and what markets they are in, requires a separate, distinct, and parallel process from Product Development ― Steve Blank
  • 8. 7   13  13   2. Build-Measure-Learn Loop In rapid iterations Persevere or Pivot? •  GOAL: 14  14   3. Minimum Viable Product (MVP)
  • 9. 8   •  The MVP is that version of the product that enables a full turn of the Build-Measure-Learn loop with a minimum amount of effort and the least amount of development time 15  15   3. Minimum Viable Product (MVP) •  The minimum viable product lacks many features that may prove essential later on – and that’s OK 16  16   3. Minimum Viable Product (MVP) (Final product)(Minimum viable product)
  • 10. 9   17  17   4. Validated Learning •  Validated learning is “the process of demonstrating empirically that the team has discovered valuable truths about the present and future business prospects” 18  18   5. One Metric That Matters (OMTM) •  Most metrics gathered by organizations are “vanity metrics.” They make us feel good (or look good), but don’t really show progress toward our goal Number of customers Cost to obtain each new customer Number of customers actually using the product
  • 11. 10   19  19   5. One Metric That Matters (OMTM) •  The One Metric That Matters measures the one most important thing at the present state of the startup 20  20   The Lean Startup Methodology What Value for Testers?
  • 12. 11   21  21   What Value for Testers? •  As software testers, we are rarely part of an entrepreneurial startup team •  Are there lessons for us from the Lean Startup methodology? 22  22   1. Customer Development •  Ask: –  Who are our customers? –  What are their problems our testing solves? –  Do our customers perceive these problems as important? –  Are they willing to pay for our testing services?
  • 13. 12   23  23   1. Customer Development •  Customer Development suggests that we should identify the “customers” of our TESTING SERVICES: –  Developers –  Users –  Management And serve THEM, not our testing process 24  24   1. Customer Development •  Or this could be our future … Largest dot-com flop in history Raised $375 million in first public offering on revenue of $395,000 and net losses of $50 million
  • 14. 13   25  25   2. Build-Measure-Learn Loop •  BML loop is equivalent to the Exploratory Testing loop This  is   where   we  start   Not  here!   26  26   3. Minimal Viable Product (MVP) •  The idea of an MVP suggests we could start with a Minimal Viable Set of Tests •  Don’t strive for “completeness” from the beginning •  Add additional tests as the need becomes apparent and warranted Learn  what  your   customers  want/ need/value  
  • 15. 14   27  27   4. Validated Learning “It isn't what we don't know that gives us trouble, it's what we know that ain't so” Will Rogers American Humorist 28  28   4. Validated Learning •  The Lean Startup methodology suggests running frequent experiments to determine customer response •  As testers, we can run frequent tests to determine both system capabilities and customer satisfaction
  • 16. 15   29  29   5. One Metric That Matters 30  30   5. One Metric That Matters •  Is your metrics program an example of “success theatre”?
  • 17. 16   31  31   5. One Metric That Matters •  Replace the dozens of vanity metrics … –  Test cases planned –  Test cases implemented –  Test cases executed –  Test cases passed –  Test cases failed –  … 32  32   5. One Metric That Matters •  … with one that is truly indicative of something vital
  • 18. 17   33  33   5. One Metric That Matters •  Does your metric –  Measure your success at improving quality? –  Directly relate to product success? –  Tie to real customers of your service? –  Help you determine what to do next? Ivory Madison, “Bonfire of the Vanity Metrics” 34  34   In Conclusion •  The Lean Startup methodology has many insights to offer to software testers •  Become familiar with its precepts. Adopt its ideas for your testing
  • 19. 18   35  35   Thanks Tạm biệt từ Việt NamGood bye from Viet Nam 36  36   One Final Bit of Advice Be Open to Serendipity “Finding something good without looking for it”