SlideShare uma empresa Scribd logo
1 de 32
Baixar para ler offline
Software Bug Fixes Lead Time
Improvements
Eduardo M. Torres PMP
Green Belt Project Storyboard
Storyboard Checklist
2
Storyboard submission is key to certification - You will be certified based on the following:
1. Complete all required Storyboard elements - See checklist below
2. Tell your story succinctly - 25 slides maximum - unlimited Appendix
3. Use the tools wisely - Use the right tools for the right reasons and include a "Take Away" or learning on each slide
4. Label your graphs clearly - Title all graphs & charts, label each axis and indicate the time frame of the data
5. Be clear about your analysis - Describe all root cause hypotheses along with how you verified or disproved each one
6. Show measurable Improvement - Document each reduction in waste, time or defects and show "before" and "after"
Submit all required Storyboard elements
- For any requirement with more than one option - please include one or more of the options listed
- Review "Example" tab on templates to see how to fill in each field
(T) = Template available
Slides
What is the story of your project?
Green Belt Storyboard (T) 1-31
Have you completed all the required elements of the storyboard?
Green Belt Storyboard Checklist (T)
What is the one-page summary of your work?
Executive Summary (T) Note: includes "Before & After" Project Y graphic showing improvement
What was the problem, goal, scope and reason for this project to exist?
Project Charter (T) Goal Statement Builder (T) - use to insure proper format
What is the high-level view of the process being addressed?
SIPOC (T)
What is the detailed view of one or more of the steps in the SIPOC ("As Is" Map)?
Detailed Map Swimlane (T) Value Stream (T) Basic Flow
4
Define Phase Requirements
6
8
7
2-3
Green Belt Storyboard Checklist
Green Belt Candidate:
Introduction Phase Requirements
Storyboard Checklist (part 2)
3
What was the plan for collecting data? What type? How much? By whom and how?
Data Collection Plan (T) (Operational Definitions must be included, Start with Project Y) 10
What does the baseline data look like when displayed?
Baseline Data Display (Run Chart required) Run Chart and Histogram or ☐Boxplot 11-12
What were the suspected root causes of the problem with the Project Y?
Fishbone Diagram (T) (With key root causes circled) 14
What issues or opportunities did you discover by studying the process?
Project Specific Map Value-Added Flow Analysis (T) Spaghetti (T) Other
What were your main theories about the root causes of Project Y issues and how did you verify them?
Hypothesis Statement(s) and Results Root Cause Hypothesis Worksheet (T)
What data, observations or other proof do you have of root caues hypothesis verification?
Verification of Root Cause Pareto Chart Box Plot Run Chart Histogram
What were the solutions you developed to solve the problem at the root?
List of Improvements Solution Selection Matrix (T) Impact Effort Matrix (T)
What does the improved process look like with waste removed and solutions implemented?
"To Be" Map (or segment) Swimlane (T) Value Stream (T) Flow Map Spaghetti (T)
What measurements or graphs do you have to show the "after" process is better?
Proof of Improvement Run Chart Box Plot Histogram Other
What are the lessons learned? Soft/hard savings? Potential replication? Process Owner sign off?
Project Closure (T) If solution will be repurposed, include Transfer Opportunities (T)
What terms and acronyms did you use that people outside your might need explained?
Key Words - Definitions of non-DMAIC, industry specific terms
Additional Slides as needed
23-24
Control Phase Requirements
26
Appendix
30-31
22
Measure Phase Requirements
Analyze Phase Requirements
15-16
18
17, 19
Improve Phase Requirements
21
Key Take Away: The project was a great success! Customer perception
changed in a good way!
Executive Summary
4
Business Case
Root Cause Analysis
What are the critical findings/root causes that were discovered?
Solutions Implemented
Data showed bug fix ticket assignments and fix deliveries to official branch
took too long, lots of time spent in software building in multiple process
steps, and unnecesary code inspections.
Graphical Display of Improvement
Improved SW Bug Fix Lead Time
List key solutions that were implemented to address root causes
1. Use Kanban methodology for bug fix tickets assignments
2. Removal of Code Inspections for LOC < 250
3. SW deliveries directly to Official Branch
4. Conducted Cross-Training for build and delivery to Official Branch flexibility
Executive Summary
Project Results
What is the importance of doing this project? (State in lost dollars,
productivity loss, customer dissatisfaction, cost avoidance, risk, etc.)
What are the measurable process improvements/wins?
SW Bug Fix Lead Time has reduced from 25 days to 15 days
Lead time improvement for Software Bug Fixes will result in an cost savings
and improved used of resources. Lead Time improvement could translate into
monetary benefits because we will be able to utilize development and testing
resources to work on more features, which could increase customer revenue.
This aligns with our 'Best In Class' mission.
Define Phase
Project Charter
Key Take Away: Excellent buy-in – project is worth doing.
6
Phase Actual
Define: September 1st September 3rd
Measure: September 17th September 28th
Analyze: October 21st November 1st
Improve: November 21st December 1st
Control: December 14th December 13th
1st Process Step Position Person Title % of Time
Last Process Step Team Lead Eduardo M. Torres Lean Six Sigma
Green Belt
Candidate
40%
Sponsor Phil D. Director 15%
In Scope: Team Member Bharati R. Release Lead 20%
Team Member Rashmi M. Software Builder 20%
Out of Scope: Hardware
additions,
Official Build Load
delivery and Test
processes done
by external teams
Team Member Sundar E. Software Developer 20%
Team Member Errol D. Software Tester 20%
Ticket Assignment Process, Code Development Process
Development and Software Build Process
Goal Statement Timeline
Decrease the Software Bug Fixes Lead Time form 25 Days to 15 Days by
4/1/2019
Scope - First/Last and In/Out Team Members
Fix Request Ticket Created by Customer
The current total lead time for Software Bug Fixes is an average of 25 days.
This results in missing milestones by test teams and delivery delays to
customers
Fix Request Ticket built in the Official Branch
Lead time improvement for Software Bug Fixes will result in an cost savings
and improved used of resources. Lead Time improvement could translate
into monetary benefits because we will be able to utilize development and
testing resources to work on more features, which could increase
customer revenue. This aligns with our 'Best In Class' mission.
Planned Completion Date
Project Charter
Problem Statement Business Case & Benefits
Software Bug Fixes Lead Time Improvement
SIPOC
Key Take Away: The scope of the project is from the moment a bug fix ticket is
created until the bug fix is built in the Official branch 7
S I P O C
Suppliers Inputs Process Outputs Customers
Testers and Fix Request Testers
Customer Support
Patch Testing
Results
Customer Support
Sanity Test Team Sanity Test Results
Fix Request Ticket
Ready for Testing
SIPOC
Fix Request Ticket
Created
Ticket Assigned to
Developer
Develop fix by
assigned developer
Build, test,deliver fix
to local branch
Customer Requirements
Response-Time
Target Response Time is 15 days or less
Build, test,deliver fix
to official branch
Fix Delivered and
built in Official
Branch
“As-Is” Detailed Map Segment
Key Take Away: The team learned how long is taking to provide a fix to the
customer! Provides a bigger picture of the impact the work they do. 8
Software Bug Fix Delivery
Yes
No
Yes
No
No Yes
Customer
Release
Lead
SW
Developer
SW Builder
Sanity
Testing
Team
Creates
Ticket
Test
OK
Private
Patch
Testing
Code
Inspection
Code
Changes
Assigns
Ticket to
Developer
Deliver to
Parent
Branch
Local
Branch
Build
Sanity
Testing
Inspectio
n OK
Test
OK
Deliver to
Official
Branch
In Scope
Out of
Scope
Dev Build
Official SW
Load with fix
delivered
Official
Branch
Build
Measure Phase
Data Collection Plan
Key Take Away: Since this is a lead time project, most of the measures turned
about to be continuous measures of different segments of time. The discrete
measure is to determine if a process step is really needed 10
Measure
Title
Data Type
(Continuous
or Discrete)
Operational Definition
Stratification
Factors
(By who/what/
where/when)
Sampling Notes
(Time Frame, etc.)
Who and How
(Person responsible and
method - Check Sheet?)
SW Bug Fix
Lead Time
Days -
Continuous
The amount of time (in Days) it takes from the
moment the customer creates a bug fix ticket
(ticket state Created) to the moment the bug fix
is built into the official SW branch (ticket state
Ready For Testing 'RFT').
None
Sample every bug fix
ticket for the next 6
weeks starting 8/1
Release Leader will check the
date stamps on the bug
tracking tool
Ticket
Assigned Lead
Time
Days -
Continuous
The amount of time (in Days) it takes from the
moment the customer creates a bug fix ticket
(ticket state Created) to the moment the bug fix
ticket is assigned to a SW developer (ticket
state Assigned).
None
Sample every bug fix
ticket for the next 6
weeks starting 8/1
Release Leader will check the
date stamps on the bug
tracking tool
Ticket Ready
to Submit
Lead Time
Days -
Continuous
The amount of time (in Days) it takes from the
moment the the bug fix ticket is assigned to a
SW developer (ticket state Assigned) to the
moment SW developer is ready to deliver the
code (ticket state Ready to Submit).
Development testing is done, and Code
Inspection is approved in the Ready to Submit
State.
None
Sample every bug fix
ticket for the next 6
weeks starting 8/1
Release Leader will check the
date stamps on the bug
tracking tool
Ticket Code
Commited
Lead Time
Days -
Continuous
The amount of time (in Days) it takes from the
moment the SW developer is ready to deliver
the code (ticket state Ready to Submit) to the
moment SW developer delivered the code to
parent branch (ticket state Code Committed).
Development testing is done, and Code
Inspection is approved in the Ready to Submit
State.
None
Sample every bug fix
ticket for the next 6
weeks starting 8/1
Release Leader will check the
date stamps on the bug
tracking tool
Ticket Ready
for Testing
Lead Time
Days -
Continuous
The amount of time (in Days) it takes from the
moment SW developer delivered the code to
parent branch (ticket state Code Committed) to
the moment bug fix is built into the official SW
branch (ticket state Ready For Testing 'RFT').
None
Sample every bug fix
ticket for the next 6
weeks starting 8/1
Release Leader will check the
date stamps on the bug
tracking tool
Code
Inspections
Lead Time
Days -
Continuous
The amount of time (in Days) it takes from the
moment code inspection is created to the
moment the code inspection is approved.
None
Sample 20 Code
Inspections per week for
the next 6 weeks starting
8/1
Release Leader will check the
number of comments on the
code inspection tool
Comments per
Code
Inspections
Discrete
The ammount of Comments in a Code
Inspections
By LOC (Lines of
Code)
Sample 20 Code
Inspections per week for
the next 6 weeks starting
8/1
Release Leader will check the
number of comments on the
code inspection tool
Data Collection Plan
Baseline – Project Y
Key Take Away: Lots of variation in the process and the average time to deliver
bug fixes is 25 days which is very high! 11
Mean: 25.81
0
10
20
30
40
50
60
Days
Baseline Lead Time of Software Bug Fixes (August 2018-September 2018)
Baseline – Software Bug Fixes Lead Time
Key Take Away: Target delivery is 15 days or less, so the bug fix delivery
process is clearly not capable. 75th Percentile is 33 days! 12
0
5
10
15
20
25
30
0.0
3.0
6.0
9.0
12.0
15.0
18.0
21.0
24.0
27.0
30.0
33.0
36.0
39.0
42.0
45.0
48.0
51.0
54.0
Frequency
Lead Time in Days
Baseline Lead Time of Software Bug Fixes (August 2018 - September 2018)
Count = 279
Mean = 25.817
StDev = 10.568
Minimum = 3
25th Percentile (Q1) = 18
50th Percentile (Median) = 25
75th Percentile (Q3) = 33
Maximum = 55
95% CI Mean = 24.572 to 27.063
95% CI Sigma = 9.758 to 11.526
Anderson-Darling Normality Test:
A-Squared = 0.430934
P-Value = 0.3045
Analyze Phase
Fishbone Diagram
Key Take Away: The biggest areas to analyze further where code inspections,
delivery to parent branches, assignment of bug fix tickets. 14
Fishbone Diagram
Not enough hardw are for
testing
Process
Parent branch locked all the time
Tickets assignment taking too long
Environment
Lab enviroment not the same
as customer environment
Test need to be redone due
to test environment issues
Only China Site doing
Sanity Testing
People
Bug Fix
Deliveries
taking Too
Loong
Debug Capabilities not robust enough
Tests are not automated
Issue Difficult to reproduce
Logs provided incomplete or no logs
No feedback fromtest team w ith
test results
Policies
Requirements Not Clear
Not enough time for developers to
review Code Inspection
Code inspection approval is slow
Competence area not
enough staffed
Map Segment Showing Analysis
Key Take Away: Process analysis showed a potential for removing unnecessary
steps that are not adding value or causing bottlenecks 15
Software Bug Fix Delivery
Yes
No
Yes
No
No Yes
Customer
Release
Lead
SW
Developer
SW Builder
Sanity
Testing
Team
Creates
Ticket
Test
OK
Private
Patch
Testing
Code
Inspection
Code
Changes
Assigns
Ticket to
Developer
Deliver to
Parent
Branch
Local
Branch
Build
Sanity
Testing
Inspectio
n OK
Test
OK
Deliver to
Official
Branch
In Scope
Out of
Scope
Dev Build
Code Inspection
may not needed.
Code delivery
potential delay.
Possible delay
assigning work.
Official SW
Load with fix
delivered
Official
Branch
Build
Map Segment Showing Analysis
Key Take Away: Biggest opportunities to remove steps are Code Inspections
and Deliver to Parent Branch. Opportunities for time reduction in Assign Tickets
to Software Developers step. 16
Name: Eduardo M. Torre Process Name:
Date: November 7th
Time
Measured In: Minutes Hours Days
# Process Step
Step Label
(VA, NVA,
NVAr)
Value
Added
Time
NVA & NVA-
Required
Work Time
NVA - Wait
Time
1 Assign Ticket to Software Developer NVAr 2
2 Software Code Changes VA 10
3 Development Build VA 1
4 Code Inspection NVA 3
5 Private Patch Testing VA 1
6 Deliver to Parent Branch NVA 3
7 Local Branch Build NVA 1
8 Sanity Testing NVAr 2
9 Deliver to Official Branch NVAr 1
10 Official Branch Build VA 1
Time %of total
13 52.00% 50
12 48.00%
0 0.00%
25 100.00%Total Cycle Time
Value-Added Flow Analysis
Software Bug Fixes Delivery
(select units)
Total Value-Added Work Time
Total Non-Value-Added or NVA-r Work Time
NVA - Wait Time
Value Added Flow Data
Key Take Away: Split of the Baseline data based on the ticket state. Deliver to
Parent branch time is all wasted time. Removing code inspection saves
average 3 days in the lead time 17
# Process Step Lead Time
Total Lead
Time
1 Assign Ticket to Software Developer Ticket Assigned Lead Time 2
2 Software Code Changes
4 Development Build
3 Code Inspection
5 Private Patch Testing
6 Deliver to Parent Branch Ticket Code Committed Lead Time 3
7 Local Branch Build
8 Sanity Testing
9 Deliver to Official Branch
10 Official Branch Build
Ticket Ready to Submit Lead Time
Ticket Ready For Testing Lead
Time
15
5
Root Cause Hypothesis
Key Take Away: Data confirmed all the hypotheses except the code inspection
not needed for LOC > 250. 18
#
Possible Root Cause (x)
(1 or 2-Word Descriptor)
Root Cause Hypothesis
(Theory of how "X" is influencing the Project "Y")
Theory True
or False?
Verification
(How did you prove or
disprove this theory?)
1 Assignment Time
Tickets Assignemnt Taking too long adding wasted
time in Lead Time
TRUE
See Box Plot on next slide - Average is 2
days target is < 1 day
2 Inspection Not Need Code Inspection is not needed
TRUE and
FALSE
Next slides show pie charts
TRUE for LOC < 250. No Comments in
91% of the inspections
FALSE for LOC > 250 No Comments in
34% of the inspections
3 Delivery Time Delivery to Parent Branch taking too long TRUE
See Box Plot on next slide- Average is 3
days target is < 1 day
Root Cause Hypothesis
Root Cause Hypothesis Results
Key Take Away: Data confirmed all the hypotheses except the code inspection
not needed for LOC > 250. 19
Improve Phase
Selected Solutions
Key Take Away: The effort required to cross-train SW builders (Development
tasks) will not allow to meet the schedule. Code removal buy-in showed that
sometimes some processes are a false sense of security 21
Project Goal
Decrease the Software Bug Fixes Lead Time form 25
Days to 15 Days by 4/1/2019
(As stated on Project Charter)
Very Low
(less good)
Moderate
Very High
(best)
1 2 3 4 5
Potential Solution
(Provide Brief Description)
Potential to
Meet Goal
Positive
Customer
Impact
Cost to
Implement
(1 = $$$
& 5 = $)
Stakeholder
Buy-in
Time to
Implement
(1 = Long
5 = Quick)
Weighted Criteria 10 9 8 7 5
Remove code inspections for LOC < 250 5 3 4 3 5 155 Yes
Cross-train Developers 4 3 3 3 4 132 Yes
Cross-train SW Builders 2 3 3 3 1 97 No
Use Kanban methodology for tickets assignment 4 4 3 4 4 148 Yes
Total
Score
Implement?
Yes/No
Solution Selection Matrix
Please rank each solution for each criteria
by using the 1-5 Scale as indicated below
“To Be” Map Segment
Key Take Away: Process changes including remove unnecessary inspections
(for fixes of 250 Lines of Code or Less), removing bottlenecks, Cross-training to
reduce hand-offs and use of Kanban methodologies. 22
Software Bug Fix Delivery
Yes
No
Yes Yes
No
No
No Yes
Customer
Release
Lead
SW
Developer
SW Builder
Sanity
Testing
Team
Creates
Ticket Test
OK
Private
Patch
Testing
Code
Inspection
Code
Changes
Prioritizes
Ticket
Official SW
Load with fix
delivered
Sanity
Testing
Inspectio
n OK
Test
OK
Deliver to
Official
Branch
In Scope
Out of
Scope
Lines of
Code < 250PicksTicket
Use Kanban to
minimize Tickets
not assigned
Remove code
inspections for
LOC < 250
Deliver Directly to
Official Branch
Cross-train
Developers for SW
Builder tasks
Local
Branch
Build
Local Branch Build
done by
developers
Official
Branch
Build
Run Chart Showing Improvement
Key Take Away: Improvements had an impact of 39% reduction on Software
Bug Fixes lead time while cutting variability in half! This gave much faster
response time with greatly improved reliability!
23
Improved – Software Bug Fixes Lead Time
Key Take Away: Data with improvement solutions shows an average lead time
decrease from 25.8 days to 15.6 days and 75th Percentile is 19 days from 33
days
24
0
2
4
6
8
10
12
14
16
18
4.0
6.0
8.0
10.0
12.0
14.0
16.0
18.0
20.0
22.0
24.0
26.0
Frequency
Lead Time In Days
Improved Lead Time of Software Bug Fixes (November 2018)
Count = 100
Mean = 15.640
StDev = 5.264
Minimum = 4
25th Percentile (Q1) = 12
50th Percentile (Median) = 15.500
75th Percentile (Q3) = 19
Maximum = 27
95% CI Mean = 14.596 to 16.684
95% CI Sigma = 4.622 to 6.115
Anderson-Darling Normality Test:
A-Squared = 0.404791
P-Value = 0.3474
Improved Value Added Flow Data
Key Take Away: Improvements showed on Step #1 (from 2 days to <1 day) by
using Kanban and on Step #7 (from 3 days to <1 day) by SW cross-train
developers to deliver directly to Official Branch. 25
# Process Step Lead Time
Total Lead
Time
1 Assign Ticket to Software Developer Ticket Assigned Lead Time 0
2 Software Code Changes
3 Local Branch Build
4 Code Inspections if LOC > 250
5 Private Patch Testing
6 Sanity Testing
7 Deliver to Official Branch Ticket Code Committed Lead Time 0
8 Official Branch Build 1
Ticket Ready to Submit Lead Time 15
Control Phase
Project Closure
Key Take Away: Ended up with resource effort savings and the VP is thrilled!
27
Do's and Don'ts for Future Efforts
Yes
Yes
Yes
Has been informed of process changes: The Platform Software Team did a great job! We are moving on the right
direction to be "Best In Class" - I'm offically giving my stamp of approval
for documented improvements.
- Phil Diguglielmo - Director
Agrees to continued monitoring of new process:
Has received new process documentation:
Process Owner Hand-off Sign-off From Project Sponsor
Final Calculations of Savings or Gains
Effort savings of 46 People Month that is translated in $384K in savings
Team member morale increased, more time to work on features.
Hard Savings/Profit Increase Soft Savings - Cost or Time
Project Closure
Continuous communication to avoid surprises Customer Perception changed in a good way.
Open Minded attitude due to we will challenge status quo
Be sure to give credit to everyone who came up with good ideas -
credit is free!
In some cases some processes give a false sense of secuirty like Code
Inspection for bug fixes
Lessons Learned Customer Impact
Positive Impacts on External Customer
Process Control Plan
Key Take Away: The bug tracking tool has the data needed to collects this
information. We’ll only need the Release Lead to gather the data 28
Customer
Release Lead
SW Developer
SW Builder
Testing Team
List of
Measures:
P1
Cycle Time Starts
Ticket Assigned
Time Starts
P2
Ticket Assigned
Time Ends
P3
Ticket Ready to
Submit Time
Starts
P4
Ticket Ready to
Submit Time Ends
P5
Ticket Code
Committed Time
O1
Ticket Ready For
Testing Time
Starts
O2
Ticket Ready For
Testing Time
Ends
P = Process Measures, O = Output Measures
Process Control Plan
Creates
Ticket
Testing
Sanity
Testing
Delivery to
Official
Branch
Build
Official
Branch
P2
P4
O1
Prioritize
Ticket
Picks
Ticket
Code
Changes
P1
P3
Fix
delivered
O2
P5
Monitoring Response Control Plan
Key Take Away: Responding to the last 4 items will help ensure that the first
item (our primary goal) remains low. 29
Name of the Measure
Input,
Process or
Output?
What is the
Target?
Method of Data
Capture
Checking
Frequency
Person
Responsible
Upper/Lower
Trigger Point
Who Will
Respond?
Reaction Plan
Bug Fix Lead Time Output 15 Days or Less
Date stamp when
customer create a
bug fix ticket to date
stamp the fix is built
in the official branch
Weekly Release Lead
No greater than 17
Days
Upper Control Limit
Release Lead
Observe the following Measurements to see why it's taking
longer. Make corrections
- Ticket Assigned Time
- Ticket Ready to Submit Time
- Ticket Code Commited Time
- Ticket Ready For Testing Time
Ticket Assigned Lead
Time
Process 1 Day or Less
Date stamp when
customer create a
bug fix ticket to date
stamp when the
ticket is assigned to
a SW developer
Weekly Release Lead
No greater than 2
Days
Upper Control Limit
Release Lead
Make corrections
- More resources needed?
- Escalation Needed for more resources?
Ready to Submit Lead
Time
Process 12 Days or Less
Date Stamp when the
ticket is assigned to
a developer to a sw
developer is ready to
submit to Official
Branch.
Weekly Release Lead
No greater than 15
Days
Upper Control Limit
Release Lead
Make corrections
- Fast response from the test team?
- Architects or Subject Matter Experts need involvement?
- Environment Issues?
Code Commited Lead
Time
Process 1 Days or Less
Date Stamp when the
ticket is delivered to
Official Branch.
Weekly Release Lead
No greater than 2
Days
Upper Control Limit
Release Lead
Make corrections. Understand why we cannot deliver to
Official Branch
- Environment Issues?
- Official Branch locked due to external issues?
Code Commited Lead
Time
Process 1 Day
Date Stamp when the
ticket is delivered to
Official Branch.
Weekly Release Lead
No greater than 2
Days
Upper Control Limit
Release Lead
Make corrections. Understand why Official Branch is not
doing software builds
- Environment Issues?
- Official Branch locked due to external issues?
Monitoring Plan Response Plan
Appendix
Key Words
31
Key Word Description
Code Inspection The most formal type of review, which is a kind of static testing to
avoid the defect multiplication at a later stage
Development Branch Software repository created under a Parent Branch and used by
software developers to make code changes
Development Build Build one or more software components in the Development Branch
Lines of Code (LOC) Is a software metric used to measure the size of a computer program
by counting the number of lines in the text of the program's source
code.
Local Branch Software repository created under the Official Software Release
repository
Local Branch Build Build all software components in the Local Branch
Official Branch Official Software Release repository
Official Branch Build Build all software components in the Official Branch
Parent Branch Higher Level repository
People Month Number of Resourses / Month
Private Patch Testing Testing of software code changes done to fix specific bug or issue
Sanity Testing Testing so no further issues are introduced due to these changes.
SW Bug Fix Lead Time The amount of time (in Days) it takes from the moment the customer
creates a bug fix ticket (ticket state Created) to the moment the bug
fix is built into the official SW branch (ticket state Ready For Testing
'RFT').
Ticket Assigned Lead Time
The amount of time (in Days) it takes from the moment the customer
creates a bug fix ticket (ticket state Created) to the moment the bug
fix ticket is assigned to a SW developer (ticket state Assigned).
Ticket Code Commited Lead Time The amount of time (in Days) it takes from the moment the SW
developer is ready to deliver the code (ticket state Ready to Submit)
to the moment SW developer delivered the code to parent branch
(ticket state Code Committed). Development testing is done, and
Code Inspection is approved in the Ready to Submit State.
Ticket Ready for Testing Lead Time The amount of time (in Days) it takes from the moment SW developer
delivered the code to parent branch (ticket state Code Committed) to
the moment bug fix is built into the official SW branch (ticket state
Ready For Testing 'RFT').
Ticket Ready to Submit Lead Time The amount of time (in Days) it takes from the moment the the bug fix
ticket is assigned to a SW developer (ticket state Assigned) to the
moment SW developer is ready to deliver the code (ticket state Ready
to Submit). Development testing is done, and Code Inspection is
approved in the Ready to Submit State.
Key Words
32
Ticket State Description
Created Ticket created by a customer
Assigned Ticket Assigned to a developer
Ready to Submit Development testing is done, and code inspection is approved
Code Committed Code delivered to a Parent Branch
Ready for Testing (RFT)Code built in Official Branch and ready for verification

Mais conteúdo relacionado

Mais procurados

How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma EffortHow A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma EffortGoLeanSixSigma.com
 
Ts16949 Internal Audit (Jul05) Nc Rs
Ts16949 Internal Audit (Jul05) Nc RsTs16949 Internal Audit (Jul05) Nc Rs
Ts16949 Internal Audit (Jul05) Nc Rsrpatils
 
Software Testing Life Cycle
Software Testing Life CycleSoftware Testing Life Cycle
Software Testing Life CycleUdayakumar Sree
 
six sigma for staff turnover
six sigma for staff turnoversix sigma for staff turnover
six sigma for staff turnovermohamedsliem8
 
Project Management Plan One Pager Presentation Report Infographic Ppt Pdf Doc...
Project Management Plan One Pager Presentation Report Infographic Ppt Pdf Doc...Project Management Plan One Pager Presentation Report Infographic Ppt Pdf Doc...
Project Management Plan One Pager Presentation Report Infographic Ppt Pdf Doc...SlideTeam
 
Green Belt Project Storyboard Template Example
Green Belt Project Storyboard Template Example Green Belt Project Storyboard Template Example
Green Belt Project Storyboard Template Example GoLeanSixSigma.com
 
Six sigma green belt project template
Six sigma green belt project templateSix sigma green belt project template
Six sigma green belt project templateShankaran Rd
 
Agile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Groupsuwalki24.pl
 
USER ACCEPTANCE TESTING
USER ACCEPTANCE TESTINGUSER ACCEPTANCE TESTING
USER ACCEPTANCE TESTINGKADARI SHIVRAJ
 
Project attrition
Project attritionProject attrition
Project attritiondigvijayra
 
Project Status Presentation One Pager Presentation Report Infographic Ppt Pdf...
Project Status Presentation One Pager Presentation Report Infographic Ppt Pdf...Project Status Presentation One Pager Presentation Report Infographic Ppt Pdf...
Project Status Presentation One Pager Presentation Report Infographic Ppt Pdf...SlideTeam
 
Black Belt Project on Increasing CSAT%
Black Belt Project on Increasing CSAT%Black Belt Project on Increasing CSAT%
Black Belt Project on Increasing CSAT%Sk. Noor Mohammad
 
Root Cause Analysis
Root Cause AnalysisRoot Cause Analysis
Root Cause Analysismtalhausmani
 
Agile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterAgile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterDeclan Whelan
 
Define phase lean six sigma tollgate template
Define phase   lean six sigma tollgate templateDefine phase   lean six sigma tollgate template
Define phase lean six sigma tollgate templateSteven Bonacorsi
 

Mais procurados (20)

How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma EffortHow A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
How A Single Black Belt Project Jump Starts a Successful Lean Six Sigma Effort
 
Ts16949 Internal Audit (Jul05) Nc Rs
Ts16949 Internal Audit (Jul05) Nc RsTs16949 Internal Audit (Jul05) Nc Rs
Ts16949 Internal Audit (Jul05) Nc Rs
 
Root Cause Analysis ( RCA )
Root Cause Analysis ( RCA )Root Cause Analysis ( RCA )
Root Cause Analysis ( RCA )
 
Software Testing Life Cycle
Software Testing Life CycleSoftware Testing Life Cycle
Software Testing Life Cycle
 
Test plan
Test planTest plan
Test plan
 
six sigma for staff turnover
six sigma for staff turnoversix sigma for staff turnover
six sigma for staff turnover
 
Project Management Plan One Pager Presentation Report Infographic Ppt Pdf Doc...
Project Management Plan One Pager Presentation Report Infographic Ppt Pdf Doc...Project Management Plan One Pager Presentation Report Infographic Ppt Pdf Doc...
Project Management Plan One Pager Presentation Report Infographic Ppt Pdf Doc...
 
Green Belt Project Storyboard Template Example
Green Belt Project Storyboard Template Example Green Belt Project Storyboard Template Example
Green Belt Project Storyboard Template Example
 
Six sigma green belt project template
Six sigma green belt project templateSix sigma green belt project template
Six sigma green belt project template
 
Six Sigma DMAIC Case Study
Six Sigma DMAIC Case StudySix Sigma DMAIC Case Study
Six Sigma DMAIC Case Study
 
Agile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Group
 
USER ACCEPTANCE TESTING
USER ACCEPTANCE TESTINGUSER ACCEPTANCE TESTING
USER ACCEPTANCE TESTING
 
Project attrition
Project attritionProject attrition
Project attrition
 
Project Status Presentation One Pager Presentation Report Infographic Ppt Pdf...
Project Status Presentation One Pager Presentation Report Infographic Ppt Pdf...Project Status Presentation One Pager Presentation Report Infographic Ppt Pdf...
Project Status Presentation One Pager Presentation Report Infographic Ppt Pdf...
 
Black Belt Project on Increasing CSAT%
Black Belt Project on Increasing CSAT%Black Belt Project on Increasing CSAT%
Black Belt Project on Increasing CSAT%
 
Bug Reporting
Bug ReportingBug Reporting
Bug Reporting
 
Root Cause Analysis
Root Cause AnalysisRoot Cause Analysis
Root Cause Analysis
 
SMART Requirements
SMART RequirementsSMART Requirements
SMART Requirements
 
Agile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterAgile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile Tester
 
Define phase lean six sigma tollgate template
Define phase   lean six sigma tollgate templateDefine phase   lean six sigma tollgate template
Define phase lean six sigma tollgate template
 

Semelhante a PROJECT STORYBOARD: Reducing Software Bug Fix Lead Time From 25 to 15 days

Improve phase lean six sigma tollgate template
Improve phase   lean six sigma tollgate templateImprove phase   lean six sigma tollgate template
Improve phase lean six sigma tollgate templateSteven Bonacorsi
 
Improve phase lean six sigma tollgate template
Improve phase   lean six sigma tollgate templateImprove phase   lean six sigma tollgate template
Improve phase lean six sigma tollgate templateSteven Bonacorsi
 
Managing projects by data
Managing projects by dataManaging projects by data
Managing projects by dataMobi Marketing
 
PGP New Product Generation Project 2003
PGP New Product Generation Project 2003PGP New Product Generation Project 2003
PGP New Product Generation Project 2003Sidewinder2011
 
Measure phase lean six sigma tollgate template
Measure phase   lean six sigma tollgate templateMeasure phase   lean six sigma tollgate template
Measure phase lean six sigma tollgate templateSteven Bonacorsi
 
Measure phase lean six sigma tollgate template
Measure phase   lean six sigma tollgate templateMeasure phase   lean six sigma tollgate template
Measure phase lean six sigma tollgate templateSteven Bonacorsi
 
Six Sigma Green Belt Training Part 5
Six Sigma Green Belt Training Part 5Six Sigma Green Belt Training Part 5
Six Sigma Green Belt Training Part 5Skillogic Solutions
 
Lean six sigma executive overview (case study) templates
Lean six sigma executive overview (case study) templatesLean six sigma executive overview (case study) templates
Lean six sigma executive overview (case study) templatesSteven Bonacorsi
 
Risk Driven Testing
Risk Driven TestingRisk Driven Testing
Risk Driven TestingJorge Boria
 
Managing IT Projects
Managing IT ProjectsManaging IT Projects
Managing IT ProjectsRhys Leong
 
Six sigma ajal
Six sigma ajalSix sigma ajal
Six sigma ajalAJAL A J
 
LeSS Like Adoption @ SAP
LeSS Like Adoption @ SAPLeSS Like Adoption @ SAP
LeSS Like Adoption @ SAPRobert Briese
 
Integrating agile into sdlc presentation pmi v2
Integrating agile into sdlc presentation   pmi v2Integrating agile into sdlc presentation   pmi v2
Integrating agile into sdlc presentation pmi v2pmimkecomm
 

Semelhante a PROJECT STORYBOARD: Reducing Software Bug Fix Lead Time From 25 to 15 days (20)

D07 Project Charter
D07 Project CharterD07 Project Charter
D07 Project Charter
 
Improve phase lean six sigma tollgate template
Improve phase   lean six sigma tollgate templateImprove phase   lean six sigma tollgate template
Improve phase lean six sigma tollgate template
 
Improve phase lean six sigma tollgate template
Improve phase   lean six sigma tollgate templateImprove phase   lean six sigma tollgate template
Improve phase lean six sigma tollgate template
 
Managing projects by data
Managing projects by dataManaging projects by data
Managing projects by data
 
15 Deliv template
15 Deliv template15 Deliv template
15 Deliv template
 
6 Sigma
6 Sigma6 Sigma
6 Sigma
 
PGP New Product Generation Project 2003
PGP New Product Generation Project 2003PGP New Product Generation Project 2003
PGP New Product Generation Project 2003
 
Measure phase lean six sigma tollgate template
Measure phase   lean six sigma tollgate templateMeasure phase   lean six sigma tollgate template
Measure phase lean six sigma tollgate template
 
Measure phase lean six sigma tollgate template
Measure phase   lean six sigma tollgate templateMeasure phase   lean six sigma tollgate template
Measure phase lean six sigma tollgate template
 
Six Sigma Green Belt Training Part 5
Six Sigma Green Belt Training Part 5Six Sigma Green Belt Training Part 5
Six Sigma Green Belt Training Part 5
 
Lean six sigma executive overview (case study) templates
Lean six sigma executive overview (case study) templatesLean six sigma executive overview (case study) templates
Lean six sigma executive overview (case study) templates
 
Risk Driven Testing
Risk Driven TestingRisk Driven Testing
Risk Driven Testing
 
Intake Process Itpmo
Intake Process ItpmoIntake Process Itpmo
Intake Process Itpmo
 
Managing IT Projects
Managing IT ProjectsManaging IT Projects
Managing IT Projects
 
Six sigma ajal
Six sigma ajalSix sigma ajal
Six sigma ajal
 
LeSS Like Adoption @ SAP
LeSS Like Adoption @ SAPLeSS Like Adoption @ SAP
LeSS Like Adoption @ SAP
 
Integrating agile into sdlc presentation pmi v2
Integrating agile into sdlc presentation   pmi v2Integrating agile into sdlc presentation   pmi v2
Integrating agile into sdlc presentation pmi v2
 
Metrics Sirisha
Metrics  SirishaMetrics  Sirisha
Metrics Sirisha
 
Metrics Sirisha
Metrics  SirishaMetrics  Sirisha
Metrics Sirisha
 
Metrics Sirisha
Metrics  SirishaMetrics  Sirisha
Metrics Sirisha
 

Mais de GoLeanSixSigma.com

Webinar: Process Improvement in Government Using Lean Six Sigma
Webinar: Process Improvement in Government Using Lean Six SigmaWebinar: Process Improvement in Government Using Lean Six Sigma
Webinar: Process Improvement in Government Using Lean Six SigmaGoLeanSixSigma.com
 
Webinar: How to Create Predictable Cash Flow With Lean Six Sigma Projects
Webinar: How to Create Predictable Cash Flow With Lean Six Sigma ProjectsWebinar: How to Create Predictable Cash Flow With Lean Six Sigma Projects
Webinar: How to Create Predictable Cash Flow With Lean Six Sigma ProjectsGoLeanSixSigma.com
 
Webinar: How Soldiers Receive 100% Funding for Lean Six Sigma Certification
Webinar: How Soldiers Receive 100% Funding for Lean Six Sigma CertificationWebinar: How Soldiers Receive 100% Funding for Lean Six Sigma Certification
Webinar: How Soldiers Receive 100% Funding for Lean Six Sigma CertificationGoLeanSixSigma.com
 
Webinar: 10 Tips for a Standout Lean Six Sigma Green Belt Project
Webinar: 10 Tips for a Standout Lean Six Sigma Green Belt ProjectWebinar: 10 Tips for a Standout Lean Six Sigma Green Belt Project
Webinar: 10 Tips for a Standout Lean Six Sigma Green Belt ProjectGoLeanSixSigma.com
 
Webinar: How Army Soldiers Can Advance Their Careers With Green Belt Training...
Webinar: How Army Soldiers Can Advance Their Careers With Green Belt Training...Webinar: How Army Soldiers Can Advance Their Careers With Green Belt Training...
Webinar: How Army Soldiers Can Advance Their Careers With Green Belt Training...GoLeanSixSigma.com
 
Webinar: Going Remote - How Process Improvement Teams Collaborate Virtually
Webinar: Going Remote - How Process Improvement Teams Collaborate VirtuallyWebinar: Going Remote - How Process Improvement Teams Collaborate Virtually
Webinar: Going Remote - How Process Improvement Teams Collaborate VirtuallyGoLeanSixSigma.com
 
How to Request Army Credentialing Assistance on ArmyIgnited.com
How to Request Army Credentialing Assistance on ArmyIgnited.comHow to Request Army Credentialing Assistance on ArmyIgnited.com
How to Request Army Credentialing Assistance on ArmyIgnited.comGoLeanSixSigma.com
 
Webinar: Remote Learning - How to Successfully Switch Lean Six Sigma Training...
Webinar: Remote Learning - How to Successfully Switch Lean Six Sigma Training...Webinar: Remote Learning - How to Successfully Switch Lean Six Sigma Training...
Webinar: Remote Learning - How to Successfully Switch Lean Six Sigma Training...GoLeanSixSigma.com
 
Webinar: How Tax Preparers & Accountants Can Increase Their Profitability Usi...
Webinar: How Tax Preparers & Accountants Can Increase Their Profitability Usi...Webinar: How Tax Preparers & Accountants Can Increase Their Profitability Usi...
Webinar: How Tax Preparers & Accountants Can Increase Their Profitability Usi...GoLeanSixSigma.com
 
Webinar: Remote Learning - How to Brainstorm Lean Six Sigma Improvement Ideas
Webinar: Remote Learning - How to Brainstorm Lean Six Sigma Improvement IdeasWebinar: Remote Learning - How to Brainstorm Lean Six Sigma Improvement Ideas
Webinar: Remote Learning - How to Brainstorm Lean Six Sigma Improvement IdeasGoLeanSixSigma.com
 
Webinar: How to Facilitate Successful Virtual Kaizen Events
Webinar: How to Facilitate Successful Virtual Kaizen EventsWebinar: How to Facilitate Successful Virtual Kaizen Events
Webinar: How to Facilitate Successful Virtual Kaizen EventsGoLeanSixSigma.com
 
Webinar: Online Green Belt Workshop Information Session
Webinar: Online Green Belt Workshop Information SessionWebinar: Online Green Belt Workshop Information Session
Webinar: Online Green Belt Workshop Information SessionGoLeanSixSigma.com
 
Webinar: Online Green Belt Information Session
Webinar: Online Green Belt Information SessionWebinar: Online Green Belt Information Session
Webinar: Online Green Belt Information SessionGoLeanSixSigma.com
 
Webinar: Going Virtual - How to Coach Problem Solvers on A3s
Webinar: Going Virtual - How to Coach Problem Solvers on A3sWebinar: Going Virtual - How to Coach Problem Solvers on A3s
Webinar: Going Virtual - How to Coach Problem Solvers on A3sGoLeanSixSigma.com
 
Webinar: How to Manage Your Project to Completion Using the Project Builder
Webinar: How to Manage Your Project to Completion Using the Project BuilderWebinar: How to Manage Your Project to Completion Using the Project Builder
Webinar: How to Manage Your Project to Completion Using the Project BuilderGoLeanSixSigma.com
 
Webinar: DMAIC: Common Challenges & How to Overcome Them
Webinar: DMAIC: Common Challenges & How to Overcome ThemWebinar: DMAIC: Common Challenges & How to Overcome Them
Webinar: DMAIC: Common Challenges & How to Overcome ThemGoLeanSixSigma.com
 
WEBINAR: How to Deploy Lean Six Sigma in Your Organization
WEBINAR: How to Deploy Lean Six Sigma in Your OrganizationWEBINAR: How to Deploy Lean Six Sigma in Your Organization
WEBINAR: How to Deploy Lean Six Sigma in Your OrganizationGoLeanSixSigma.com
 
WEBINAR: Introduction to Process Management
WEBINAR: Introduction to Process ManagementWEBINAR: Introduction to Process Management
WEBINAR: Introduction to Process ManagementGoLeanSixSigma.com
 
Webinar: How to Use a Fishbone Diagram (Encore!)
Webinar: How to Use a Fishbone Diagram (Encore!)Webinar: How to Use a Fishbone Diagram (Encore!)
Webinar: How to Use a Fishbone Diagram (Encore!)GoLeanSixSigma.com
 
WEBINAR: Introduction to Value Stream Mapping
WEBINAR: Introduction to Value Stream MappingWEBINAR: Introduction to Value Stream Mapping
WEBINAR: Introduction to Value Stream MappingGoLeanSixSigma.com
 

Mais de GoLeanSixSigma.com (20)

Webinar: Process Improvement in Government Using Lean Six Sigma
Webinar: Process Improvement in Government Using Lean Six SigmaWebinar: Process Improvement in Government Using Lean Six Sigma
Webinar: Process Improvement in Government Using Lean Six Sigma
 
Webinar: How to Create Predictable Cash Flow With Lean Six Sigma Projects
Webinar: How to Create Predictable Cash Flow With Lean Six Sigma ProjectsWebinar: How to Create Predictable Cash Flow With Lean Six Sigma Projects
Webinar: How to Create Predictable Cash Flow With Lean Six Sigma Projects
 
Webinar: How Soldiers Receive 100% Funding for Lean Six Sigma Certification
Webinar: How Soldiers Receive 100% Funding for Lean Six Sigma CertificationWebinar: How Soldiers Receive 100% Funding for Lean Six Sigma Certification
Webinar: How Soldiers Receive 100% Funding for Lean Six Sigma Certification
 
Webinar: 10 Tips for a Standout Lean Six Sigma Green Belt Project
Webinar: 10 Tips for a Standout Lean Six Sigma Green Belt ProjectWebinar: 10 Tips for a Standout Lean Six Sigma Green Belt Project
Webinar: 10 Tips for a Standout Lean Six Sigma Green Belt Project
 
Webinar: How Army Soldiers Can Advance Their Careers With Green Belt Training...
Webinar: How Army Soldiers Can Advance Their Careers With Green Belt Training...Webinar: How Army Soldiers Can Advance Their Careers With Green Belt Training...
Webinar: How Army Soldiers Can Advance Their Careers With Green Belt Training...
 
Webinar: Going Remote - How Process Improvement Teams Collaborate Virtually
Webinar: Going Remote - How Process Improvement Teams Collaborate VirtuallyWebinar: Going Remote - How Process Improvement Teams Collaborate Virtually
Webinar: Going Remote - How Process Improvement Teams Collaborate Virtually
 
How to Request Army Credentialing Assistance on ArmyIgnited.com
How to Request Army Credentialing Assistance on ArmyIgnited.comHow to Request Army Credentialing Assistance on ArmyIgnited.com
How to Request Army Credentialing Assistance on ArmyIgnited.com
 
Webinar: Remote Learning - How to Successfully Switch Lean Six Sigma Training...
Webinar: Remote Learning - How to Successfully Switch Lean Six Sigma Training...Webinar: Remote Learning - How to Successfully Switch Lean Six Sigma Training...
Webinar: Remote Learning - How to Successfully Switch Lean Six Sigma Training...
 
Webinar: How Tax Preparers & Accountants Can Increase Their Profitability Usi...
Webinar: How Tax Preparers & Accountants Can Increase Their Profitability Usi...Webinar: How Tax Preparers & Accountants Can Increase Their Profitability Usi...
Webinar: How Tax Preparers & Accountants Can Increase Their Profitability Usi...
 
Webinar: Remote Learning - How to Brainstorm Lean Six Sigma Improvement Ideas
Webinar: Remote Learning - How to Brainstorm Lean Six Sigma Improvement IdeasWebinar: Remote Learning - How to Brainstorm Lean Six Sigma Improvement Ideas
Webinar: Remote Learning - How to Brainstorm Lean Six Sigma Improvement Ideas
 
Webinar: How to Facilitate Successful Virtual Kaizen Events
Webinar: How to Facilitate Successful Virtual Kaizen EventsWebinar: How to Facilitate Successful Virtual Kaizen Events
Webinar: How to Facilitate Successful Virtual Kaizen Events
 
Webinar: Online Green Belt Workshop Information Session
Webinar: Online Green Belt Workshop Information SessionWebinar: Online Green Belt Workshop Information Session
Webinar: Online Green Belt Workshop Information Session
 
Webinar: Online Green Belt Information Session
Webinar: Online Green Belt Information SessionWebinar: Online Green Belt Information Session
Webinar: Online Green Belt Information Session
 
Webinar: Going Virtual - How to Coach Problem Solvers on A3s
Webinar: Going Virtual - How to Coach Problem Solvers on A3sWebinar: Going Virtual - How to Coach Problem Solvers on A3s
Webinar: Going Virtual - How to Coach Problem Solvers on A3s
 
Webinar: How to Manage Your Project to Completion Using the Project Builder
Webinar: How to Manage Your Project to Completion Using the Project BuilderWebinar: How to Manage Your Project to Completion Using the Project Builder
Webinar: How to Manage Your Project to Completion Using the Project Builder
 
Webinar: DMAIC: Common Challenges & How to Overcome Them
Webinar: DMAIC: Common Challenges & How to Overcome ThemWebinar: DMAIC: Common Challenges & How to Overcome Them
Webinar: DMAIC: Common Challenges & How to Overcome Them
 
WEBINAR: How to Deploy Lean Six Sigma in Your Organization
WEBINAR: How to Deploy Lean Six Sigma in Your OrganizationWEBINAR: How to Deploy Lean Six Sigma in Your Organization
WEBINAR: How to Deploy Lean Six Sigma in Your Organization
 
WEBINAR: Introduction to Process Management
WEBINAR: Introduction to Process ManagementWEBINAR: Introduction to Process Management
WEBINAR: Introduction to Process Management
 
Webinar: How to Use a Fishbone Diagram (Encore!)
Webinar: How to Use a Fishbone Diagram (Encore!)Webinar: How to Use a Fishbone Diagram (Encore!)
Webinar: How to Use a Fishbone Diagram (Encore!)
 
WEBINAR: Introduction to Value Stream Mapping
WEBINAR: Introduction to Value Stream MappingWEBINAR: Introduction to Value Stream Mapping
WEBINAR: Introduction to Value Stream Mapping
 

Último

Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxUmeshTimilsina1
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...Nguyen Thanh Tu Collection
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...Nguyen Thanh Tu Collection
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxDr. Sarita Anand
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structuredhanjurrannsibayan2
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfSherif Taha
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfDr Vijay Vishwakarma
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...Amil baba
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.christianmathematics
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - Englishneillewis46
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsMebane Rash
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxCeline George
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...pradhanghanshyam7136
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024Elizabeth Walsh
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Pooja Bhuva
 
OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsSandeep D Chaudhary
 
Basic Intentional Injuries Health Education
Basic Intentional Injuries Health EducationBasic Intentional Injuries Health Education
Basic Intentional Injuries Health EducationNeilDeclaro1
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxEsquimalt MFRC
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Pooja Bhuva
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jisc
 

Último (20)

Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & Systems
 
Basic Intentional Injuries Health Education
Basic Intentional Injuries Health EducationBasic Intentional Injuries Health Education
Basic Intentional Injuries Health Education
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 

PROJECT STORYBOARD: Reducing Software Bug Fix Lead Time From 25 to 15 days

  • 1. Software Bug Fixes Lead Time Improvements Eduardo M. Torres PMP Green Belt Project Storyboard
  • 2. Storyboard Checklist 2 Storyboard submission is key to certification - You will be certified based on the following: 1. Complete all required Storyboard elements - See checklist below 2. Tell your story succinctly - 25 slides maximum - unlimited Appendix 3. Use the tools wisely - Use the right tools for the right reasons and include a "Take Away" or learning on each slide 4. Label your graphs clearly - Title all graphs & charts, label each axis and indicate the time frame of the data 5. Be clear about your analysis - Describe all root cause hypotheses along with how you verified or disproved each one 6. Show measurable Improvement - Document each reduction in waste, time or defects and show "before" and "after" Submit all required Storyboard elements - For any requirement with more than one option - please include one or more of the options listed - Review "Example" tab on templates to see how to fill in each field (T) = Template available Slides What is the story of your project? Green Belt Storyboard (T) 1-31 Have you completed all the required elements of the storyboard? Green Belt Storyboard Checklist (T) What is the one-page summary of your work? Executive Summary (T) Note: includes "Before & After" Project Y graphic showing improvement What was the problem, goal, scope and reason for this project to exist? Project Charter (T) Goal Statement Builder (T) - use to insure proper format What is the high-level view of the process being addressed? SIPOC (T) What is the detailed view of one or more of the steps in the SIPOC ("As Is" Map)? Detailed Map Swimlane (T) Value Stream (T) Basic Flow 4 Define Phase Requirements 6 8 7 2-3 Green Belt Storyboard Checklist Green Belt Candidate: Introduction Phase Requirements
  • 3. Storyboard Checklist (part 2) 3 What was the plan for collecting data? What type? How much? By whom and how? Data Collection Plan (T) (Operational Definitions must be included, Start with Project Y) 10 What does the baseline data look like when displayed? Baseline Data Display (Run Chart required) Run Chart and Histogram or ☐Boxplot 11-12 What were the suspected root causes of the problem with the Project Y? Fishbone Diagram (T) (With key root causes circled) 14 What issues or opportunities did you discover by studying the process? Project Specific Map Value-Added Flow Analysis (T) Spaghetti (T) Other What were your main theories about the root causes of Project Y issues and how did you verify them? Hypothesis Statement(s) and Results Root Cause Hypothesis Worksheet (T) What data, observations or other proof do you have of root caues hypothesis verification? Verification of Root Cause Pareto Chart Box Plot Run Chart Histogram What were the solutions you developed to solve the problem at the root? List of Improvements Solution Selection Matrix (T) Impact Effort Matrix (T) What does the improved process look like with waste removed and solutions implemented? "To Be" Map (or segment) Swimlane (T) Value Stream (T) Flow Map Spaghetti (T) What measurements or graphs do you have to show the "after" process is better? Proof of Improvement Run Chart Box Plot Histogram Other What are the lessons learned? Soft/hard savings? Potential replication? Process Owner sign off? Project Closure (T) If solution will be repurposed, include Transfer Opportunities (T) What terms and acronyms did you use that people outside your might need explained? Key Words - Definitions of non-DMAIC, industry specific terms Additional Slides as needed 23-24 Control Phase Requirements 26 Appendix 30-31 22 Measure Phase Requirements Analyze Phase Requirements 15-16 18 17, 19 Improve Phase Requirements 21
  • 4. Key Take Away: The project was a great success! Customer perception changed in a good way! Executive Summary 4 Business Case Root Cause Analysis What are the critical findings/root causes that were discovered? Solutions Implemented Data showed bug fix ticket assignments and fix deliveries to official branch took too long, lots of time spent in software building in multiple process steps, and unnecesary code inspections. Graphical Display of Improvement Improved SW Bug Fix Lead Time List key solutions that were implemented to address root causes 1. Use Kanban methodology for bug fix tickets assignments 2. Removal of Code Inspections for LOC < 250 3. SW deliveries directly to Official Branch 4. Conducted Cross-Training for build and delivery to Official Branch flexibility Executive Summary Project Results What is the importance of doing this project? (State in lost dollars, productivity loss, customer dissatisfaction, cost avoidance, risk, etc.) What are the measurable process improvements/wins? SW Bug Fix Lead Time has reduced from 25 days to 15 days Lead time improvement for Software Bug Fixes will result in an cost savings and improved used of resources. Lead Time improvement could translate into monetary benefits because we will be able to utilize development and testing resources to work on more features, which could increase customer revenue. This aligns with our 'Best In Class' mission.
  • 6. Project Charter Key Take Away: Excellent buy-in – project is worth doing. 6 Phase Actual Define: September 1st September 3rd Measure: September 17th September 28th Analyze: October 21st November 1st Improve: November 21st December 1st Control: December 14th December 13th 1st Process Step Position Person Title % of Time Last Process Step Team Lead Eduardo M. Torres Lean Six Sigma Green Belt Candidate 40% Sponsor Phil D. Director 15% In Scope: Team Member Bharati R. Release Lead 20% Team Member Rashmi M. Software Builder 20% Out of Scope: Hardware additions, Official Build Load delivery and Test processes done by external teams Team Member Sundar E. Software Developer 20% Team Member Errol D. Software Tester 20% Ticket Assignment Process, Code Development Process Development and Software Build Process Goal Statement Timeline Decrease the Software Bug Fixes Lead Time form 25 Days to 15 Days by 4/1/2019 Scope - First/Last and In/Out Team Members Fix Request Ticket Created by Customer The current total lead time for Software Bug Fixes is an average of 25 days. This results in missing milestones by test teams and delivery delays to customers Fix Request Ticket built in the Official Branch Lead time improvement for Software Bug Fixes will result in an cost savings and improved used of resources. Lead Time improvement could translate into monetary benefits because we will be able to utilize development and testing resources to work on more features, which could increase customer revenue. This aligns with our 'Best In Class' mission. Planned Completion Date Project Charter Problem Statement Business Case & Benefits Software Bug Fixes Lead Time Improvement
  • 7. SIPOC Key Take Away: The scope of the project is from the moment a bug fix ticket is created until the bug fix is built in the Official branch 7 S I P O C Suppliers Inputs Process Outputs Customers Testers and Fix Request Testers Customer Support Patch Testing Results Customer Support Sanity Test Team Sanity Test Results Fix Request Ticket Ready for Testing SIPOC Fix Request Ticket Created Ticket Assigned to Developer Develop fix by assigned developer Build, test,deliver fix to local branch Customer Requirements Response-Time Target Response Time is 15 days or less Build, test,deliver fix to official branch Fix Delivered and built in Official Branch
  • 8. “As-Is” Detailed Map Segment Key Take Away: The team learned how long is taking to provide a fix to the customer! Provides a bigger picture of the impact the work they do. 8 Software Bug Fix Delivery Yes No Yes No No Yes Customer Release Lead SW Developer SW Builder Sanity Testing Team Creates Ticket Test OK Private Patch Testing Code Inspection Code Changes Assigns Ticket to Developer Deliver to Parent Branch Local Branch Build Sanity Testing Inspectio n OK Test OK Deliver to Official Branch In Scope Out of Scope Dev Build Official SW Load with fix delivered Official Branch Build
  • 10. Data Collection Plan Key Take Away: Since this is a lead time project, most of the measures turned about to be continuous measures of different segments of time. The discrete measure is to determine if a process step is really needed 10 Measure Title Data Type (Continuous or Discrete) Operational Definition Stratification Factors (By who/what/ where/when) Sampling Notes (Time Frame, etc.) Who and How (Person responsible and method - Check Sheet?) SW Bug Fix Lead Time Days - Continuous The amount of time (in Days) it takes from the moment the customer creates a bug fix ticket (ticket state Created) to the moment the bug fix is built into the official SW branch (ticket state Ready For Testing 'RFT'). None Sample every bug fix ticket for the next 6 weeks starting 8/1 Release Leader will check the date stamps on the bug tracking tool Ticket Assigned Lead Time Days - Continuous The amount of time (in Days) it takes from the moment the customer creates a bug fix ticket (ticket state Created) to the moment the bug fix ticket is assigned to a SW developer (ticket state Assigned). None Sample every bug fix ticket for the next 6 weeks starting 8/1 Release Leader will check the date stamps on the bug tracking tool Ticket Ready to Submit Lead Time Days - Continuous The amount of time (in Days) it takes from the moment the the bug fix ticket is assigned to a SW developer (ticket state Assigned) to the moment SW developer is ready to deliver the code (ticket state Ready to Submit). Development testing is done, and Code Inspection is approved in the Ready to Submit State. None Sample every bug fix ticket for the next 6 weeks starting 8/1 Release Leader will check the date stamps on the bug tracking tool Ticket Code Commited Lead Time Days - Continuous The amount of time (in Days) it takes from the moment the SW developer is ready to deliver the code (ticket state Ready to Submit) to the moment SW developer delivered the code to parent branch (ticket state Code Committed). Development testing is done, and Code Inspection is approved in the Ready to Submit State. None Sample every bug fix ticket for the next 6 weeks starting 8/1 Release Leader will check the date stamps on the bug tracking tool Ticket Ready for Testing Lead Time Days - Continuous The amount of time (in Days) it takes from the moment SW developer delivered the code to parent branch (ticket state Code Committed) to the moment bug fix is built into the official SW branch (ticket state Ready For Testing 'RFT'). None Sample every bug fix ticket for the next 6 weeks starting 8/1 Release Leader will check the date stamps on the bug tracking tool Code Inspections Lead Time Days - Continuous The amount of time (in Days) it takes from the moment code inspection is created to the moment the code inspection is approved. None Sample 20 Code Inspections per week for the next 6 weeks starting 8/1 Release Leader will check the number of comments on the code inspection tool Comments per Code Inspections Discrete The ammount of Comments in a Code Inspections By LOC (Lines of Code) Sample 20 Code Inspections per week for the next 6 weeks starting 8/1 Release Leader will check the number of comments on the code inspection tool Data Collection Plan
  • 11. Baseline – Project Y Key Take Away: Lots of variation in the process and the average time to deliver bug fixes is 25 days which is very high! 11 Mean: 25.81 0 10 20 30 40 50 60 Days Baseline Lead Time of Software Bug Fixes (August 2018-September 2018)
  • 12. Baseline – Software Bug Fixes Lead Time Key Take Away: Target delivery is 15 days or less, so the bug fix delivery process is clearly not capable. 75th Percentile is 33 days! 12 0 5 10 15 20 25 30 0.0 3.0 6.0 9.0 12.0 15.0 18.0 21.0 24.0 27.0 30.0 33.0 36.0 39.0 42.0 45.0 48.0 51.0 54.0 Frequency Lead Time in Days Baseline Lead Time of Software Bug Fixes (August 2018 - September 2018) Count = 279 Mean = 25.817 StDev = 10.568 Minimum = 3 25th Percentile (Q1) = 18 50th Percentile (Median) = 25 75th Percentile (Q3) = 33 Maximum = 55 95% CI Mean = 24.572 to 27.063 95% CI Sigma = 9.758 to 11.526 Anderson-Darling Normality Test: A-Squared = 0.430934 P-Value = 0.3045
  • 14. Fishbone Diagram Key Take Away: The biggest areas to analyze further where code inspections, delivery to parent branches, assignment of bug fix tickets. 14 Fishbone Diagram Not enough hardw are for testing Process Parent branch locked all the time Tickets assignment taking too long Environment Lab enviroment not the same as customer environment Test need to be redone due to test environment issues Only China Site doing Sanity Testing People Bug Fix Deliveries taking Too Loong Debug Capabilities not robust enough Tests are not automated Issue Difficult to reproduce Logs provided incomplete or no logs No feedback fromtest team w ith test results Policies Requirements Not Clear Not enough time for developers to review Code Inspection Code inspection approval is slow Competence area not enough staffed
  • 15. Map Segment Showing Analysis Key Take Away: Process analysis showed a potential for removing unnecessary steps that are not adding value or causing bottlenecks 15 Software Bug Fix Delivery Yes No Yes No No Yes Customer Release Lead SW Developer SW Builder Sanity Testing Team Creates Ticket Test OK Private Patch Testing Code Inspection Code Changes Assigns Ticket to Developer Deliver to Parent Branch Local Branch Build Sanity Testing Inspectio n OK Test OK Deliver to Official Branch In Scope Out of Scope Dev Build Code Inspection may not needed. Code delivery potential delay. Possible delay assigning work. Official SW Load with fix delivered Official Branch Build
  • 16. Map Segment Showing Analysis Key Take Away: Biggest opportunities to remove steps are Code Inspections and Deliver to Parent Branch. Opportunities for time reduction in Assign Tickets to Software Developers step. 16 Name: Eduardo M. Torre Process Name: Date: November 7th Time Measured In: Minutes Hours Days # Process Step Step Label (VA, NVA, NVAr) Value Added Time NVA & NVA- Required Work Time NVA - Wait Time 1 Assign Ticket to Software Developer NVAr 2 2 Software Code Changes VA 10 3 Development Build VA 1 4 Code Inspection NVA 3 5 Private Patch Testing VA 1 6 Deliver to Parent Branch NVA 3 7 Local Branch Build NVA 1 8 Sanity Testing NVAr 2 9 Deliver to Official Branch NVAr 1 10 Official Branch Build VA 1 Time %of total 13 52.00% 50 12 48.00% 0 0.00% 25 100.00%Total Cycle Time Value-Added Flow Analysis Software Bug Fixes Delivery (select units) Total Value-Added Work Time Total Non-Value-Added or NVA-r Work Time NVA - Wait Time
  • 17. Value Added Flow Data Key Take Away: Split of the Baseline data based on the ticket state. Deliver to Parent branch time is all wasted time. Removing code inspection saves average 3 days in the lead time 17 # Process Step Lead Time Total Lead Time 1 Assign Ticket to Software Developer Ticket Assigned Lead Time 2 2 Software Code Changes 4 Development Build 3 Code Inspection 5 Private Patch Testing 6 Deliver to Parent Branch Ticket Code Committed Lead Time 3 7 Local Branch Build 8 Sanity Testing 9 Deliver to Official Branch 10 Official Branch Build Ticket Ready to Submit Lead Time Ticket Ready For Testing Lead Time 15 5
  • 18. Root Cause Hypothesis Key Take Away: Data confirmed all the hypotheses except the code inspection not needed for LOC > 250. 18 # Possible Root Cause (x) (1 or 2-Word Descriptor) Root Cause Hypothesis (Theory of how "X" is influencing the Project "Y") Theory True or False? Verification (How did you prove or disprove this theory?) 1 Assignment Time Tickets Assignemnt Taking too long adding wasted time in Lead Time TRUE See Box Plot on next slide - Average is 2 days target is < 1 day 2 Inspection Not Need Code Inspection is not needed TRUE and FALSE Next slides show pie charts TRUE for LOC < 250. No Comments in 91% of the inspections FALSE for LOC > 250 No Comments in 34% of the inspections 3 Delivery Time Delivery to Parent Branch taking too long TRUE See Box Plot on next slide- Average is 3 days target is < 1 day Root Cause Hypothesis
  • 19. Root Cause Hypothesis Results Key Take Away: Data confirmed all the hypotheses except the code inspection not needed for LOC > 250. 19
  • 21. Selected Solutions Key Take Away: The effort required to cross-train SW builders (Development tasks) will not allow to meet the schedule. Code removal buy-in showed that sometimes some processes are a false sense of security 21 Project Goal Decrease the Software Bug Fixes Lead Time form 25 Days to 15 Days by 4/1/2019 (As stated on Project Charter) Very Low (less good) Moderate Very High (best) 1 2 3 4 5 Potential Solution (Provide Brief Description) Potential to Meet Goal Positive Customer Impact Cost to Implement (1 = $$$ & 5 = $) Stakeholder Buy-in Time to Implement (1 = Long 5 = Quick) Weighted Criteria 10 9 8 7 5 Remove code inspections for LOC < 250 5 3 4 3 5 155 Yes Cross-train Developers 4 3 3 3 4 132 Yes Cross-train SW Builders 2 3 3 3 1 97 No Use Kanban methodology for tickets assignment 4 4 3 4 4 148 Yes Total Score Implement? Yes/No Solution Selection Matrix Please rank each solution for each criteria by using the 1-5 Scale as indicated below
  • 22. “To Be” Map Segment Key Take Away: Process changes including remove unnecessary inspections (for fixes of 250 Lines of Code or Less), removing bottlenecks, Cross-training to reduce hand-offs and use of Kanban methodologies. 22 Software Bug Fix Delivery Yes No Yes Yes No No No Yes Customer Release Lead SW Developer SW Builder Sanity Testing Team Creates Ticket Test OK Private Patch Testing Code Inspection Code Changes Prioritizes Ticket Official SW Load with fix delivered Sanity Testing Inspectio n OK Test OK Deliver to Official Branch In Scope Out of Scope Lines of Code < 250PicksTicket Use Kanban to minimize Tickets not assigned Remove code inspections for LOC < 250 Deliver Directly to Official Branch Cross-train Developers for SW Builder tasks Local Branch Build Local Branch Build done by developers Official Branch Build
  • 23. Run Chart Showing Improvement Key Take Away: Improvements had an impact of 39% reduction on Software Bug Fixes lead time while cutting variability in half! This gave much faster response time with greatly improved reliability! 23
  • 24. Improved – Software Bug Fixes Lead Time Key Take Away: Data with improvement solutions shows an average lead time decrease from 25.8 days to 15.6 days and 75th Percentile is 19 days from 33 days 24 0 2 4 6 8 10 12 14 16 18 4.0 6.0 8.0 10.0 12.0 14.0 16.0 18.0 20.0 22.0 24.0 26.0 Frequency Lead Time In Days Improved Lead Time of Software Bug Fixes (November 2018) Count = 100 Mean = 15.640 StDev = 5.264 Minimum = 4 25th Percentile (Q1) = 12 50th Percentile (Median) = 15.500 75th Percentile (Q3) = 19 Maximum = 27 95% CI Mean = 14.596 to 16.684 95% CI Sigma = 4.622 to 6.115 Anderson-Darling Normality Test: A-Squared = 0.404791 P-Value = 0.3474
  • 25. Improved Value Added Flow Data Key Take Away: Improvements showed on Step #1 (from 2 days to <1 day) by using Kanban and on Step #7 (from 3 days to <1 day) by SW cross-train developers to deliver directly to Official Branch. 25 # Process Step Lead Time Total Lead Time 1 Assign Ticket to Software Developer Ticket Assigned Lead Time 0 2 Software Code Changes 3 Local Branch Build 4 Code Inspections if LOC > 250 5 Private Patch Testing 6 Sanity Testing 7 Deliver to Official Branch Ticket Code Committed Lead Time 0 8 Official Branch Build 1 Ticket Ready to Submit Lead Time 15
  • 27. Project Closure Key Take Away: Ended up with resource effort savings and the VP is thrilled! 27 Do's and Don'ts for Future Efforts Yes Yes Yes Has been informed of process changes: The Platform Software Team did a great job! We are moving on the right direction to be "Best In Class" - I'm offically giving my stamp of approval for documented improvements. - Phil Diguglielmo - Director Agrees to continued monitoring of new process: Has received new process documentation: Process Owner Hand-off Sign-off From Project Sponsor Final Calculations of Savings or Gains Effort savings of 46 People Month that is translated in $384K in savings Team member morale increased, more time to work on features. Hard Savings/Profit Increase Soft Savings - Cost or Time Project Closure Continuous communication to avoid surprises Customer Perception changed in a good way. Open Minded attitude due to we will challenge status quo Be sure to give credit to everyone who came up with good ideas - credit is free! In some cases some processes give a false sense of secuirty like Code Inspection for bug fixes Lessons Learned Customer Impact Positive Impacts on External Customer
  • 28. Process Control Plan Key Take Away: The bug tracking tool has the data needed to collects this information. We’ll only need the Release Lead to gather the data 28 Customer Release Lead SW Developer SW Builder Testing Team List of Measures: P1 Cycle Time Starts Ticket Assigned Time Starts P2 Ticket Assigned Time Ends P3 Ticket Ready to Submit Time Starts P4 Ticket Ready to Submit Time Ends P5 Ticket Code Committed Time O1 Ticket Ready For Testing Time Starts O2 Ticket Ready For Testing Time Ends P = Process Measures, O = Output Measures Process Control Plan Creates Ticket Testing Sanity Testing Delivery to Official Branch Build Official Branch P2 P4 O1 Prioritize Ticket Picks Ticket Code Changes P1 P3 Fix delivered O2 P5
  • 29. Monitoring Response Control Plan Key Take Away: Responding to the last 4 items will help ensure that the first item (our primary goal) remains low. 29 Name of the Measure Input, Process or Output? What is the Target? Method of Data Capture Checking Frequency Person Responsible Upper/Lower Trigger Point Who Will Respond? Reaction Plan Bug Fix Lead Time Output 15 Days or Less Date stamp when customer create a bug fix ticket to date stamp the fix is built in the official branch Weekly Release Lead No greater than 17 Days Upper Control Limit Release Lead Observe the following Measurements to see why it's taking longer. Make corrections - Ticket Assigned Time - Ticket Ready to Submit Time - Ticket Code Commited Time - Ticket Ready For Testing Time Ticket Assigned Lead Time Process 1 Day or Less Date stamp when customer create a bug fix ticket to date stamp when the ticket is assigned to a SW developer Weekly Release Lead No greater than 2 Days Upper Control Limit Release Lead Make corrections - More resources needed? - Escalation Needed for more resources? Ready to Submit Lead Time Process 12 Days or Less Date Stamp when the ticket is assigned to a developer to a sw developer is ready to submit to Official Branch. Weekly Release Lead No greater than 15 Days Upper Control Limit Release Lead Make corrections - Fast response from the test team? - Architects or Subject Matter Experts need involvement? - Environment Issues? Code Commited Lead Time Process 1 Days or Less Date Stamp when the ticket is delivered to Official Branch. Weekly Release Lead No greater than 2 Days Upper Control Limit Release Lead Make corrections. Understand why we cannot deliver to Official Branch - Environment Issues? - Official Branch locked due to external issues? Code Commited Lead Time Process 1 Day Date Stamp when the ticket is delivered to Official Branch. Weekly Release Lead No greater than 2 Days Upper Control Limit Release Lead Make corrections. Understand why Official Branch is not doing software builds - Environment Issues? - Official Branch locked due to external issues? Monitoring Plan Response Plan
  • 31. Key Words 31 Key Word Description Code Inspection The most formal type of review, which is a kind of static testing to avoid the defect multiplication at a later stage Development Branch Software repository created under a Parent Branch and used by software developers to make code changes Development Build Build one or more software components in the Development Branch Lines of Code (LOC) Is a software metric used to measure the size of a computer program by counting the number of lines in the text of the program's source code. Local Branch Software repository created under the Official Software Release repository Local Branch Build Build all software components in the Local Branch Official Branch Official Software Release repository Official Branch Build Build all software components in the Official Branch Parent Branch Higher Level repository People Month Number of Resourses / Month Private Patch Testing Testing of software code changes done to fix specific bug or issue Sanity Testing Testing so no further issues are introduced due to these changes. SW Bug Fix Lead Time The amount of time (in Days) it takes from the moment the customer creates a bug fix ticket (ticket state Created) to the moment the bug fix is built into the official SW branch (ticket state Ready For Testing 'RFT'). Ticket Assigned Lead Time The amount of time (in Days) it takes from the moment the customer creates a bug fix ticket (ticket state Created) to the moment the bug fix ticket is assigned to a SW developer (ticket state Assigned). Ticket Code Commited Lead Time The amount of time (in Days) it takes from the moment the SW developer is ready to deliver the code (ticket state Ready to Submit) to the moment SW developer delivered the code to parent branch (ticket state Code Committed). Development testing is done, and Code Inspection is approved in the Ready to Submit State. Ticket Ready for Testing Lead Time The amount of time (in Days) it takes from the moment SW developer delivered the code to parent branch (ticket state Code Committed) to the moment bug fix is built into the official SW branch (ticket state Ready For Testing 'RFT'). Ticket Ready to Submit Lead Time The amount of time (in Days) it takes from the moment the the bug fix ticket is assigned to a SW developer (ticket state Assigned) to the moment SW developer is ready to deliver the code (ticket state Ready to Submit). Development testing is done, and Code Inspection is approved in the Ready to Submit State.
  • 32. Key Words 32 Ticket State Description Created Ticket created by a customer Assigned Ticket Assigned to a developer Ready to Submit Development testing is done, and code inspection is approved Code Committed Code delivered to a Parent Branch Ready for Testing (RFT)Code built in Official Branch and ready for verification