SlideShare a Scribd company logo
1 of 4
The Risk Tolerant Master Schedule – 3rd
in a Series 2012
1
Niwot Ridge Consulting
4347 PebbleBeach Drive
Niwot, Colorado 80503
: 303.241.9633
: glen.alleman@niwotridge.com
7 risk management process areas form the basis of an
integrated management approach Handling risk.
TECHNICAL AND PROGRAMMATIC DISRUPTIONS IN APROJECT’S PLAN DOES NOT
NEED TO NEGATIVELY IMPACT COST, TECHNICAL PERFORMANCE, OR SCHEDULE
METRICS
But traditional approaches to planning,scheduling,and managing technical performance are not adequate to defend
against these disruptions. This white paper outlines the six steps for building a risk-tolerant schedule using a field
proven approach.
In two prior white papers in this risk managementseries — “Risk/Opportunity” and “Managing Schedule Risk” — the
importance of planning risk management tasks and managing different types of uncertainty in the project schedule
was presented. This approach lays the foundation for building a risk tolerant project schedule that identifies
programmatic risk and implements the needed mitigation activities .
This paper presents the method for incorporating schedule risk management in a visible manner that provides
governance of the project’s technical and programmatic performance. This method is based on three core concepts
shared by all risk–tolerant plans:
1. Measures of progress must be quantitative rather than qualitative,
2. Normal and foreseen risk handling must be explicitly visible in the plan, and
3. Unforeseen risks must be acknowledged and actions taken when they occur.
Risk Management Structure
The table to the right describes the Risk
Management structure defined in the Risk
Management Guide for DoD Acquisition. This is the
process structure needed to develop the Risk
Tolerant schedule.
It is the tolerance of risk that makes a project robust.
Risk handling is critical to this robustness, but to be
robust more than just handling is needed. The
schedule, cost, and technical architecture of the
products or services mustthemselves be robustto be
credible in the presence of risk.
To build a risk-tolerant schedule, the PMBOK 4th
Edition instructs us to:
 Identify the schedule activities needed to complete the project.
 Sequence these activities in their order of dependency.
 Estimate the resources needed for each task.
 Estimate activity durations using a variety of methods.
 Use this information to create a schedule that contains the risk handling tasks, either retirement of mitigation.
 And control the changes to the schedule and update the risk handling actives in the presence of each change.
While this approach appears well grounded since itdefines processes that can be used to build the schedule, it fails
to address the core weakness ofmost planning process bynot specificallydesigned to be Risk Tolerant in four ways:
1. It is activity–based, not risk mitigation based.Technical risk is identified in PMBOK, but its connection to and with
programmatic risk is not defined. [1]
2. It is activity–based, not maturity assessment based. Progress is measured as the passage of time and
consumption of resources, not the increasing technical or programmatic maturity.
The Risk Tolerant Master Schedule – 3rd
in a Series 2012
2
Niwot Ridge Consulting
4347 PebbleBeach Drive
Niwot, Colorado 80503
: 303.241.9633
: glen.alleman@niwotridge.com
Uncalibrated ordinal scales should not be used to rank
risk. Instead specific descriptions of the meaning of
High, Low and the ranges betw een should be stated
Domain
High Risk
Example
Low Risk
Example
Maturity
Basic principles
observed
Item are
deployed and
operational
Sufficiency
Research
required
Processes
defined and
operational
Complexity 20% of interfaces
defined
Less than 5% of
design altered
during final
review
Uncertainty
Frequent
changes in
requirements
No changes in
requirements
Estimate
No chance
(< 5%)
Certain
(> 95%)
3. It is activity–based, with no quantitative basis of assessing the risk reduction effort from the current state to
completion. Explicit risk buy-down activities are not discussed in a manner consistent with an integrated plan.
4. §11.5.2 of PMBOK describes the recommended activities for Risk Response Planning, but it fails to make it clear
how to integrate these mitigation activities in the plan.
Measurable Maturity and Embedded Risk Management
Building a Risk Tolerant schedule starts with the understanding that traditional approaches to planning described
above, leaves out the very elements needed for risk tolerance. These elements start with the identification and
assessment of the project, product, and process states as part of the schedule.
Steps in Building a Risk Tolerant Plan
1. Define the measurable maturity Events of the project. These assessment points can be determined in terms of
capabilities or fidelityof the deliverables agreed to by the customer.Capabilities describe a defined outcome that
is not the final conclusion,butlays the groundwork for the continued delivery of value. [2] Objectives are reached
and the operational value delivered when a defined capability is available for use. Features and functions
describe the static and dynamic behaviors ofa system, but they are not directly connected to a strategy, mission
or vision defined in the chartering session of the project. Milestones indicate the arrival of a point in time.
Capabilities delivery provides an answer to the question: in order to achieve the objective of this project, what
capabilities must be possessed?
2. Define the SignificantAccomplishments and the Exit Criteria that deliver the needed capabilities for the project. A
capability is defined for each point along the maturity line – from immature to complete. Each Significant
Accomplishmentand its Exit Criteria needs to be worded as a past tense statement about the delivery of an end
item.This delivery mustbe 100% of some defined result.No percentage complete is allowed! Rather 100% of a
partially defined capability, product, or service clearly states what “done” looks like at each place along the way
to completion of the project.
3. Define the work needed to deliver the Significant
Accomplishments and their Exit Criteria. This provides
the focus needed to define what “done” looks like for
each exit criterion. These tasks should represent the
vast majority of the activities in the plan. Any other work
should be classified as Level of Effort.
4. Rank each task according to an ordinal risk scale. Each
task mustbe ranked since,it is not clear in the beginning
which tasks will be critical to the completion of the
schedule, which ones will interact and cause
programmatic risks to appear.
5. The ranking of risk. Six basic classes are commonly
used.[3] The probability scales commonly used are un-
calibrated in mostinstances. These types of scales (un-
calibrated) generally produce poor results unless the
process is well structured, stable and repeatable.
6. Define the explicit tasks to mitigate the known risks. These are risks with a probability of occurrence and a
probable impact. These tasks should be placed in front of Significant Accomplishments to provide a buffer or
time for correction.
7. Define alternative paths through the schedule for unknown risks – risks with a probability of occurrence but with
an unknown impact. These paths are indicated as branching probabilities in the plan.
The Risk Tolerant Master Schedule – 3rd
in a Series 2012
3
Niwot Ridge Consulting
4347 PebbleBeach Drive
Niwot, Colorado 80503
: 303.241.9633
: glen.alleman@niwotridge.com
Processes and Practices
“Risk monitoring is the process that systematically tracks and evaluates the performance of risk–handling actions
againstestablished metrics throughoutthe project and develops further risk–handling options,as appropriate.It feeds
information back into the other risk management activities of planning, assessment, and handling.” [5]
If monitoring is passive, then it is just a bookkeeping function. Proactive risk monitoring provides quantitative
information to decision makers through variance in the Cost,Performance,Schedule and changes in the risk analysis
data. Earned Value provides cardinal values for Costand Schedule (C-S) metrics. Technical Performance Measures
provide cardinal values for Performance (P) metrics. The C-P-S cardinal values are the basis of a continuous risk
management process by aligning risk reduction tasks with the Significant Accomplishments and their Exit Criteria.
These risk monitoring metrics provide adjustments to the risk handling strategy and the Risk Handlin g Plan and
provide information to update the risk probability and risk consequence portion of the risk analysis.
Learning to create a risk tolerant schedule and managing the technical and programmatic risks represented by this
schedule is a practice.A high technology program manager once noted,“You can’t learn surgery from reading a book
— you need to successfully complete a surgical residency.”
No amount of attending seminars or reading books or articles (even these articles) will provide the solution to
managing schedule risks. But there are two good starting points: Risk Management Guide for DoD Acquisition, Fifth
Edition (Version 2.0), Department of Defense, Defense Acquisition University, June 2003, and Effective Risk
Management: Some Keys to Success, Edmund H. Conrow, AIAA Press, 2003.
Applying riskmanagement to the four attributes of any project – the state of the project, product, process and w ork –
improvements can be made in the probability that the business w ill receive the benefits from the delivered
capabilities.
Traditional Approach Risk Tolerant Approach
State of the Project
Progress is measured as the
passage of time, the completion of
tasks or the reaching of milestones
with no quantitative assessment of
the technical and programmatic
maturity of the project.
Maturity Events provide not only a
review of the progress to date, but
also an assessment of the readiness
of the project to proceed to the next
step. The fidelity of a design, a
fabrication or an operational
capability can be assessed at each
project Event.
State of the Product
There are no quantitative measures
of completion other than they are
“done.”
The SignificantAccomplishments that
define the increasing maturity of
productelements are explicitly stated
in quantitative terms.
State of the Process
No specific process measures are
provided in the plan.
The Accomplishment Criteria – exit
criteria – by which the state of
product is measured, are explicitly
defined as the conditions of
completion for each accomplishment.
Work Delivery
Tasks describe the work necessary
to complete the project. When all the
tasks are done it is implied that the
project is done.
Only those tasks that support the
completion of the exit criteria are
defined in the plan. They are discrete
work. All other work is defined as
level of effort, since it has not specific
defined outcome.
The Risk Tolerant Master Schedule – 3rd
in a Series 2012
4
Niwot Ridge Consulting
4347 PebbleBeach Drive
Niwot, Colorado 80503
: 303.241.9633
: glen.alleman@niwotridge.com
These are recommended practicum guides. PMBOK®
, while introductory in nature, does not provide an integrated
approach to Cost, Performance, and Schedule risk management.
There are other texts that should be on the shelfof any competentrisk management professional, including: Making
Hard Decisions, 2nd
Edition, Robert T. Clemen, Duxberry Press, 1996; Introduction to Statistical Decision Theory,
John W. Pratt, Howard Raiffa and Robert Schlaifer, MIT Press, 1995; Quantitative Risk Analysis, David Vose, John
Wiley and Sons,2000;and Practical Risk Assessmentfor Project Management,Stephen Gray, John Wiley and Sons,
1995.
Bibliography
[1] PMBOK®
, the British Standards Institute, and the UK Institution of Civil Engineers as w ellas numerous internal risk management
handbooks combine risk and opportunity into single assessment criteria. It could be argued that riskincludes both opportunities
and losses. How ever, there is rarely an opportunity w ithout the possibility of loss. On the other hand there is almost alw ays a
chance of loss w ithout opportunity. The PMBOK approach changes the definition of risk: the potential for the realization of
unw anted, negative consequencesof an event. Opportunities are generally events that require intentional actions in order to
achieve value. Risks are events that can be ignored. For a detailed discussion of this issue as w ellas a definitive presentation of
risk management, see Appendix E, “Changing the Definition of Risk – Why Risk It?” Robert N. Charette, in Effective Risk
Management: Some Keys to Success, 2nd
Edition, Edmund H. Conrow , American Institute of Aeronautics and Astronautics
Press, 2003.
[2] “Agile Program Management: Moving fromPrinciples to Practice,” Glen B. Alleman, Cutter Agile Project Management Advisory
Service, Volume 6, Number 9.
[3] Appendix H: Some Characteristics and Limitations of Ordinal Scales in Risk Analyses, in Effective Risk Management, Edmund
Conrow , AIAA, 2003.
[4] Although the use of ordinal values is simple it is fraught w ith problems. Ordinal are a standard approach to riskranking. If ordinal
scales are used, their values must be derived fromthe underlying probability data or be calibrated w ith actualprobability data.
This is a complex topic best addressed in a book length manner. Appendix H and Appendix J of Effective Risk Management, E.
H. Conrow are the best sources.
[5] Risk Management Guide for DOD Acquisition, pp. 88.

More Related Content

What's hot

Capabilities based planning
Capabilities based planningCapabilities based planning
Capabilities based planningGlen Alleman
 
Showing how to Increase the Probability of Project Success by applying the ...
Showing how to Increase the Probability of Project Success by applying the ...Showing how to Increase the Probability of Project Success by applying the ...
Showing how to Increase the Probability of Project Success by applying the ...Glen Alleman
 
Getting To Done - A Master Class Workshop
Getting To Done - A Master Class WorkshopGetting To Done - A Master Class Workshop
Getting To Done - A Master Class WorkshopGlen Alleman
 
Practices of risk management
Practices of risk managementPractices of risk management
Practices of risk managementGlen Alleman
 
Integrating risk with earned value
Integrating risk with earned valueIntegrating risk with earned value
Integrating risk with earned valueGlen Alleman
 
Risk Management Processes (v2)
Risk Management Processes (v2)Risk Management Processes (v2)
Risk Management Processes (v2)Glen Alleman
 
Cpm500 d _alleman__tpm lesson 3 (v1)
Cpm500 d _alleman__tpm lesson 3 (v1)Cpm500 d _alleman__tpm lesson 3 (v1)
Cpm500 d _alleman__tpm lesson 3 (v1)Glen Alleman
 
Cure for cost and schedule growth
Cure for cost and schedule growthCure for cost and schedule growth
Cure for cost and schedule growthGlen Alleman
 
Risk Management Guidance
Risk Management GuidanceRisk Management Guidance
Risk Management GuidanceGlen Alleman
 
Increasing the probability of program success
Increasing the probability of program successIncreasing the probability of program success
Increasing the probability of program successGlen Alleman
 
IMP / IMS Step by Step
IMP / IMS Step by StepIMP / IMS Step by Step
IMP / IMS Step by StepGlen Alleman
 
Principles of IT Governance
Principles of IT GovernancePrinciples of IT Governance
Principles of IT GovernanceGlen Alleman
 
Establishing schedule margin using monte carlo simulation
Establishing schedule margin using monte carlo simulation Establishing schedule margin using monte carlo simulation
Establishing schedule margin using monte carlo simulation Glen Alleman
 
Performance based management in a nut shell (v5)
Performance based management in a nut shell (v5)Performance based management in a nut shell (v5)
Performance based management in a nut shell (v5)Glen Alleman
 
What Makes a Good Concept of Operations?
What Makes a Good Concept of Operations?What Makes a Good Concept of Operations?
What Makes a Good Concept of Operations?Glen Alleman
 
Principles of Risk Management
Principles of Risk ManagementPrinciples of Risk Management
Principles of Risk ManagementGlen Alleman
 
Estimating cost and schedule for monte carlo simulation
Estimating cost and schedule for monte carlo simulationEstimating cost and schedule for monte carlo simulation
Estimating cost and schedule for monte carlo simulationGlen Alleman
 
IMP & WBS - Getting Both Right is Paramount
IMP & WBS - Getting Both Right is ParamountIMP & WBS - Getting Both Right is Paramount
IMP & WBS - Getting Both Right is ParamountGlen Alleman
 

What's hot (20)

Capabilities based planning
Capabilities based planningCapabilities based planning
Capabilities based planning
 
Showing how to Increase the Probability of Project Success by applying the ...
Showing how to Increase the Probability of Project Success by applying the ...Showing how to Increase the Probability of Project Success by applying the ...
Showing how to Increase the Probability of Project Success by applying the ...
 
Getting To Done - A Master Class Workshop
Getting To Done - A Master Class WorkshopGetting To Done - A Master Class Workshop
Getting To Done - A Master Class Workshop
 
Practices of risk management
Practices of risk managementPractices of risk management
Practices of risk management
 
Integrating risk with earned value
Integrating risk with earned valueIntegrating risk with earned value
Integrating risk with earned value
 
Getting it Right
Getting it Right Getting it Right
Getting it Right
 
Risk Management Processes (v2)
Risk Management Processes (v2)Risk Management Processes (v2)
Risk Management Processes (v2)
 
Cpm500 d _alleman__tpm lesson 3 (v1)
Cpm500 d _alleman__tpm lesson 3 (v1)Cpm500 d _alleman__tpm lesson 3 (v1)
Cpm500 d _alleman__tpm lesson 3 (v1)
 
Cure for cost and schedule growth
Cure for cost and schedule growthCure for cost and schedule growth
Cure for cost and schedule growth
 
Risk Management Guidance
Risk Management GuidanceRisk Management Guidance
Risk Management Guidance
 
Increasing the probability of program success
Increasing the probability of program successIncreasing the probability of program success
Increasing the probability of program success
 
Software Engineering
Software EngineeringSoftware Engineering
Software Engineering
 
IMP / IMS Step by Step
IMP / IMS Step by StepIMP / IMS Step by Step
IMP / IMS Step by Step
 
Principles of IT Governance
Principles of IT GovernancePrinciples of IT Governance
Principles of IT Governance
 
Establishing schedule margin using monte carlo simulation
Establishing schedule margin using monte carlo simulation Establishing schedule margin using monte carlo simulation
Establishing schedule margin using monte carlo simulation
 
Performance based management in a nut shell (v5)
Performance based management in a nut shell (v5)Performance based management in a nut shell (v5)
Performance based management in a nut shell (v5)
 
What Makes a Good Concept of Operations?
What Makes a Good Concept of Operations?What Makes a Good Concept of Operations?
What Makes a Good Concept of Operations?
 
Principles of Risk Management
Principles of Risk ManagementPrinciples of Risk Management
Principles of Risk Management
 
Estimating cost and schedule for monte carlo simulation
Estimating cost and schedule for monte carlo simulationEstimating cost and schedule for monte carlo simulation
Estimating cost and schedule for monte carlo simulation
 
IMP & WBS - Getting Both Right is Paramount
IMP & WBS - Getting Both Right is ParamountIMP & WBS - Getting Both Right is Paramount
IMP & WBS - Getting Both Right is Paramount
 

Similar to Building a risk tolerant integrated master schedule

Building risk tolerance
Building risk toleranceBuilding risk tolerance
Building risk toleranceGlen Alleman
 
Building Risk Tolerance into the Program Plan and Schedule
Building Risk Tolerance into the Program Plan and ScheduleBuilding Risk Tolerance into the Program Plan and Schedule
Building Risk Tolerance into the Program Plan and ScheduleGlen Alleman
 
Repeatable Risk Identification - Paper
Repeatable Risk Identification - PaperRepeatable Risk Identification - Paper
Repeatable Risk Identification - PaperDaniel Ackermann
 
Presentation Project managment
Presentation Project managmentPresentation Project managment
Presentation Project managmentMalan Bothma
 
Managing risk as Opportunity
Managing risk as OpportunityManaging risk as Opportunity
Managing risk as OpportunityGlen Alleman
 
Episode 25 : Project Risk Management
Episode 25 :  Project Risk ManagementEpisode 25 :  Project Risk Management
Episode 25 : Project Risk ManagementSAJJAD KHUDHUR ABBAS
 
Project risk management
Project risk managementProject risk management
Project risk managementBarnatuCoffee
 
11. Project Risk Management.pptx
11. Project Risk Management.pptx11. Project Risk Management.pptx
11. Project Risk Management.pptxKamranKhan353531
 
Elico Solutions' Odoo ERP Project Management Implementation Approach
Elico Solutions' Odoo ERP Project Management Implementation ApproachElico Solutions' Odoo ERP Project Management Implementation Approach
Elico Solutions' Odoo ERP Project Management Implementation ApproachElico Solutions Singapore
 
Managing cost and schedule risk
Managing cost and schedule riskManaging cost and schedule risk
Managing cost and schedule riskGlen Alleman
 
Risk 0-risk-guide book for pmi-rmp by amer elbaz
Risk 0-risk-guide book for pmi-rmp by amer elbazRisk 0-risk-guide book for pmi-rmp by amer elbaz
Risk 0-risk-guide book for pmi-rmp by amer elbazMohamed Saeed
 
Project of entrepreneurship
Project of entrepreneurship Project of entrepreneurship
Project of entrepreneurship AliAbbas390458
 
Control only.pdf
Control only.pdfControl only.pdf
Control only.pdfNmnKmr2
 
Risk management (final review)
Risk management (final review)Risk management (final review)
Risk management (final review)Glen Alleman
 
Bertrand's Individual Essay
Bertrand's Individual EssayBertrand's Individual Essay
Bertrand's Individual EssayPrince Bertrand
 
Running head critical path method1 critical path method7critic
Running head critical path method1 critical path method7criticRunning head critical path method1 critical path method7critic
Running head critical path method1 critical path method7criticDIPESH30
 
PMP Training - 11 project risk management
PMP Training - 11 project risk managementPMP Training - 11 project risk management
PMP Training - 11 project risk managementejlp12
 

Similar to Building a risk tolerant integrated master schedule (20)

Building risk tolerance
Building risk toleranceBuilding risk tolerance
Building risk tolerance
 
Risk Management
Risk ManagementRisk Management
Risk Management
 
Building Risk Tolerance into the Program Plan and Schedule
Building Risk Tolerance into the Program Plan and ScheduleBuilding Risk Tolerance into the Program Plan and Schedule
Building Risk Tolerance into the Program Plan and Schedule
 
Repeatable Risk Identification - Paper
Repeatable Risk Identification - PaperRepeatable Risk Identification - Paper
Repeatable Risk Identification - Paper
 
Presentation Project managment
Presentation Project managmentPresentation Project managment
Presentation Project managment
 
Managing risk as Opportunity
Managing risk as OpportunityManaging risk as Opportunity
Managing risk as Opportunity
 
Episode 25 : Project Risk Management
Episode 25 :  Project Risk ManagementEpisode 25 :  Project Risk Management
Episode 25 : Project Risk Management
 
Project risk management
Project risk managementProject risk management
Project risk management
 
11. Project Risk Management.pptx
11. Project Risk Management.pptx11. Project Risk Management.pptx
11. Project Risk Management.pptx
 
Elico Solutions' Odoo ERP Project Management Implementation Approach
Elico Solutions' Odoo ERP Project Management Implementation ApproachElico Solutions' Odoo ERP Project Management Implementation Approach
Elico Solutions' Odoo ERP Project Management Implementation Approach
 
8. project risk management
8. project risk management8. project risk management
8. project risk management
 
Risk Management
Risk ManagementRisk Management
Risk Management
 
Managing cost and schedule risk
Managing cost and schedule riskManaging cost and schedule risk
Managing cost and schedule risk
 
Risk 0-risk-guide book for pmi-rmp by amer elbaz
Risk 0-risk-guide book for pmi-rmp by amer elbazRisk 0-risk-guide book for pmi-rmp by amer elbaz
Risk 0-risk-guide book for pmi-rmp by amer elbaz
 
Project of entrepreneurship
Project of entrepreneurship Project of entrepreneurship
Project of entrepreneurship
 
Control only.pdf
Control only.pdfControl only.pdf
Control only.pdf
 
Risk management (final review)
Risk management (final review)Risk management (final review)
Risk management (final review)
 
Bertrand's Individual Essay
Bertrand's Individual EssayBertrand's Individual Essay
Bertrand's Individual Essay
 
Running head critical path method1 critical path method7critic
Running head critical path method1 critical path method7criticRunning head critical path method1 critical path method7critic
Running head critical path method1 critical path method7critic
 
PMP Training - 11 project risk management
PMP Training - 11 project risk managementPMP Training - 11 project risk management
PMP Training - 11 project risk management
 

More from Glen Alleman

Managing risk with deliverables planning
Managing risk with deliverables planningManaging risk with deliverables planning
Managing risk with deliverables planningGlen Alleman
 
A Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSA Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSGlen Alleman
 
Increasing the Probability of Project Success
Increasing the Probability of Project SuccessIncreasing the Probability of Project Success
Increasing the Probability of Project SuccessGlen Alleman
 
Process Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMProcess Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMGlen Alleman
 
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Glen Alleman
 
From Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringFrom Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringGlen Alleman
 
NAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideNAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideGlen Alleman
 
Building a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineBuilding a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineGlen Alleman
 
Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Glen Alleman
 
DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)Glen Alleman
 
Making the impossible possible
Making the impossible possibleMaking the impossible possible
Making the impossible possibleGlen Alleman
 
Heliotropic Abundance
Heliotropic AbundanceHeliotropic Abundance
Heliotropic AbundanceGlen Alleman
 
Process Flow and Narrative for Agile
Process Flow and Narrative for AgileProcess Flow and Narrative for Agile
Process Flow and Narrative for AgileGlen Alleman
 
Building the Performance Measurement Baseline
Building the Performance Measurement BaselineBuilding the Performance Measurement Baseline
Building the Performance Measurement BaselineGlen Alleman
 
Program Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaProgram Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaGlen Alleman
 
Policy and Procedure Rollout
Policy and Procedure RolloutPolicy and Procedure Rollout
Policy and Procedure RolloutGlen Alleman
 
Integrated Master Plan Development
Integrated Master Plan DevelopmentIntegrated Master Plan Development
Integrated Master Plan DevelopmentGlen Alleman
 
Project Management Theory
Project Management TheoryProject Management Theory
Project Management TheoryGlen Alleman
 
Increasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesIncreasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesGlen Alleman
 
Seven Habits of a Highly Effective agile project manager
Seven Habits of a Highly Effective agile project managerSeven Habits of a Highly Effective agile project manager
Seven Habits of a Highly Effective agile project managerGlen Alleman
 

More from Glen Alleman (20)

Managing risk with deliverables planning
Managing risk with deliverables planningManaging risk with deliverables planning
Managing risk with deliverables planning
 
A Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSA Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMS
 
Increasing the Probability of Project Success
Increasing the Probability of Project SuccessIncreasing the Probability of Project Success
Increasing the Probability of Project Success
 
Process Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMProcess Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPM
 
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
 
From Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringFrom Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems Engineering
 
NAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideNAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guide
 
Building a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineBuilding a Credible Performance Measurement Baseline
Building a Credible Performance Measurement Baseline
 
Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Integrated master plan methodology (v2)
Integrated master plan methodology (v2)
 
DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)
 
Making the impossible possible
Making the impossible possibleMaking the impossible possible
Making the impossible possible
 
Heliotropic Abundance
Heliotropic AbundanceHeliotropic Abundance
Heliotropic Abundance
 
Process Flow and Narrative for Agile
Process Flow and Narrative for AgileProcess Flow and Narrative for Agile
Process Flow and Narrative for Agile
 
Building the Performance Measurement Baseline
Building the Performance Measurement BaselineBuilding the Performance Measurement Baseline
Building the Performance Measurement Baseline
 
Program Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaProgram Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six Sigma
 
Policy and Procedure Rollout
Policy and Procedure RolloutPolicy and Procedure Rollout
Policy and Procedure Rollout
 
Integrated Master Plan Development
Integrated Master Plan DevelopmentIntegrated Master Plan Development
Integrated Master Plan Development
 
Project Management Theory
Project Management TheoryProject Management Theory
Project Management Theory
 
Increasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesIncreasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and Practices
 
Seven Habits of a Highly Effective agile project manager
Seven Habits of a Highly Effective agile project managerSeven Habits of a Highly Effective agile project manager
Seven Habits of a Highly Effective agile project manager
 

Recently uploaded

Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 

Recently uploaded (20)

Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 

Building a risk tolerant integrated master schedule

  • 1. The Risk Tolerant Master Schedule – 3rd in a Series 2012 1 Niwot Ridge Consulting 4347 PebbleBeach Drive Niwot, Colorado 80503 : 303.241.9633 : glen.alleman@niwotridge.com 7 risk management process areas form the basis of an integrated management approach Handling risk. TECHNICAL AND PROGRAMMATIC DISRUPTIONS IN APROJECT’S PLAN DOES NOT NEED TO NEGATIVELY IMPACT COST, TECHNICAL PERFORMANCE, OR SCHEDULE METRICS But traditional approaches to planning,scheduling,and managing technical performance are not adequate to defend against these disruptions. This white paper outlines the six steps for building a risk-tolerant schedule using a field proven approach. In two prior white papers in this risk managementseries — “Risk/Opportunity” and “Managing Schedule Risk” — the importance of planning risk management tasks and managing different types of uncertainty in the project schedule was presented. This approach lays the foundation for building a risk tolerant project schedule that identifies programmatic risk and implements the needed mitigation activities . This paper presents the method for incorporating schedule risk management in a visible manner that provides governance of the project’s technical and programmatic performance. This method is based on three core concepts shared by all risk–tolerant plans: 1. Measures of progress must be quantitative rather than qualitative, 2. Normal and foreseen risk handling must be explicitly visible in the plan, and 3. Unforeseen risks must be acknowledged and actions taken when they occur. Risk Management Structure The table to the right describes the Risk Management structure defined in the Risk Management Guide for DoD Acquisition. This is the process structure needed to develop the Risk Tolerant schedule. It is the tolerance of risk that makes a project robust. Risk handling is critical to this robustness, but to be robust more than just handling is needed. The schedule, cost, and technical architecture of the products or services mustthemselves be robustto be credible in the presence of risk. To build a risk-tolerant schedule, the PMBOK 4th Edition instructs us to:  Identify the schedule activities needed to complete the project.  Sequence these activities in their order of dependency.  Estimate the resources needed for each task.  Estimate activity durations using a variety of methods.  Use this information to create a schedule that contains the risk handling tasks, either retirement of mitigation.  And control the changes to the schedule and update the risk handling actives in the presence of each change. While this approach appears well grounded since itdefines processes that can be used to build the schedule, it fails to address the core weakness ofmost planning process bynot specificallydesigned to be Risk Tolerant in four ways: 1. It is activity–based, not risk mitigation based.Technical risk is identified in PMBOK, but its connection to and with programmatic risk is not defined. [1] 2. It is activity–based, not maturity assessment based. Progress is measured as the passage of time and consumption of resources, not the increasing technical or programmatic maturity.
  • 2. The Risk Tolerant Master Schedule – 3rd in a Series 2012 2 Niwot Ridge Consulting 4347 PebbleBeach Drive Niwot, Colorado 80503 : 303.241.9633 : glen.alleman@niwotridge.com Uncalibrated ordinal scales should not be used to rank risk. Instead specific descriptions of the meaning of High, Low and the ranges betw een should be stated Domain High Risk Example Low Risk Example Maturity Basic principles observed Item are deployed and operational Sufficiency Research required Processes defined and operational Complexity 20% of interfaces defined Less than 5% of design altered during final review Uncertainty Frequent changes in requirements No changes in requirements Estimate No chance (< 5%) Certain (> 95%) 3. It is activity–based, with no quantitative basis of assessing the risk reduction effort from the current state to completion. Explicit risk buy-down activities are not discussed in a manner consistent with an integrated plan. 4. §11.5.2 of PMBOK describes the recommended activities for Risk Response Planning, but it fails to make it clear how to integrate these mitigation activities in the plan. Measurable Maturity and Embedded Risk Management Building a Risk Tolerant schedule starts with the understanding that traditional approaches to planning described above, leaves out the very elements needed for risk tolerance. These elements start with the identification and assessment of the project, product, and process states as part of the schedule. Steps in Building a Risk Tolerant Plan 1. Define the measurable maturity Events of the project. These assessment points can be determined in terms of capabilities or fidelityof the deliverables agreed to by the customer.Capabilities describe a defined outcome that is not the final conclusion,butlays the groundwork for the continued delivery of value. [2] Objectives are reached and the operational value delivered when a defined capability is available for use. Features and functions describe the static and dynamic behaviors ofa system, but they are not directly connected to a strategy, mission or vision defined in the chartering session of the project. Milestones indicate the arrival of a point in time. Capabilities delivery provides an answer to the question: in order to achieve the objective of this project, what capabilities must be possessed? 2. Define the SignificantAccomplishments and the Exit Criteria that deliver the needed capabilities for the project. A capability is defined for each point along the maturity line – from immature to complete. Each Significant Accomplishmentand its Exit Criteria needs to be worded as a past tense statement about the delivery of an end item.This delivery mustbe 100% of some defined result.No percentage complete is allowed! Rather 100% of a partially defined capability, product, or service clearly states what “done” looks like at each place along the way to completion of the project. 3. Define the work needed to deliver the Significant Accomplishments and their Exit Criteria. This provides the focus needed to define what “done” looks like for each exit criterion. These tasks should represent the vast majority of the activities in the plan. Any other work should be classified as Level of Effort. 4. Rank each task according to an ordinal risk scale. Each task mustbe ranked since,it is not clear in the beginning which tasks will be critical to the completion of the schedule, which ones will interact and cause programmatic risks to appear. 5. The ranking of risk. Six basic classes are commonly used.[3] The probability scales commonly used are un- calibrated in mostinstances. These types of scales (un- calibrated) generally produce poor results unless the process is well structured, stable and repeatable. 6. Define the explicit tasks to mitigate the known risks. These are risks with a probability of occurrence and a probable impact. These tasks should be placed in front of Significant Accomplishments to provide a buffer or time for correction. 7. Define alternative paths through the schedule for unknown risks – risks with a probability of occurrence but with an unknown impact. These paths are indicated as branching probabilities in the plan.
  • 3. The Risk Tolerant Master Schedule – 3rd in a Series 2012 3 Niwot Ridge Consulting 4347 PebbleBeach Drive Niwot, Colorado 80503 : 303.241.9633 : glen.alleman@niwotridge.com Processes and Practices “Risk monitoring is the process that systematically tracks and evaluates the performance of risk–handling actions againstestablished metrics throughoutthe project and develops further risk–handling options,as appropriate.It feeds information back into the other risk management activities of planning, assessment, and handling.” [5] If monitoring is passive, then it is just a bookkeeping function. Proactive risk monitoring provides quantitative information to decision makers through variance in the Cost,Performance,Schedule and changes in the risk analysis data. Earned Value provides cardinal values for Costand Schedule (C-S) metrics. Technical Performance Measures provide cardinal values for Performance (P) metrics. The C-P-S cardinal values are the basis of a continuous risk management process by aligning risk reduction tasks with the Significant Accomplishments and their Exit Criteria. These risk monitoring metrics provide adjustments to the risk handling strategy and the Risk Handlin g Plan and provide information to update the risk probability and risk consequence portion of the risk analysis. Learning to create a risk tolerant schedule and managing the technical and programmatic risks represented by this schedule is a practice.A high technology program manager once noted,“You can’t learn surgery from reading a book — you need to successfully complete a surgical residency.” No amount of attending seminars or reading books or articles (even these articles) will provide the solution to managing schedule risks. But there are two good starting points: Risk Management Guide for DoD Acquisition, Fifth Edition (Version 2.0), Department of Defense, Defense Acquisition University, June 2003, and Effective Risk Management: Some Keys to Success, Edmund H. Conrow, AIAA Press, 2003. Applying riskmanagement to the four attributes of any project – the state of the project, product, process and w ork – improvements can be made in the probability that the business w ill receive the benefits from the delivered capabilities. Traditional Approach Risk Tolerant Approach State of the Project Progress is measured as the passage of time, the completion of tasks or the reaching of milestones with no quantitative assessment of the technical and programmatic maturity of the project. Maturity Events provide not only a review of the progress to date, but also an assessment of the readiness of the project to proceed to the next step. The fidelity of a design, a fabrication or an operational capability can be assessed at each project Event. State of the Product There are no quantitative measures of completion other than they are “done.” The SignificantAccomplishments that define the increasing maturity of productelements are explicitly stated in quantitative terms. State of the Process No specific process measures are provided in the plan. The Accomplishment Criteria – exit criteria – by which the state of product is measured, are explicitly defined as the conditions of completion for each accomplishment. Work Delivery Tasks describe the work necessary to complete the project. When all the tasks are done it is implied that the project is done. Only those tasks that support the completion of the exit criteria are defined in the plan. They are discrete work. All other work is defined as level of effort, since it has not specific defined outcome.
  • 4. The Risk Tolerant Master Schedule – 3rd in a Series 2012 4 Niwot Ridge Consulting 4347 PebbleBeach Drive Niwot, Colorado 80503 : 303.241.9633 : glen.alleman@niwotridge.com These are recommended practicum guides. PMBOK® , while introductory in nature, does not provide an integrated approach to Cost, Performance, and Schedule risk management. There are other texts that should be on the shelfof any competentrisk management professional, including: Making Hard Decisions, 2nd Edition, Robert T. Clemen, Duxberry Press, 1996; Introduction to Statistical Decision Theory, John W. Pratt, Howard Raiffa and Robert Schlaifer, MIT Press, 1995; Quantitative Risk Analysis, David Vose, John Wiley and Sons,2000;and Practical Risk Assessmentfor Project Management,Stephen Gray, John Wiley and Sons, 1995. Bibliography [1] PMBOK® , the British Standards Institute, and the UK Institution of Civil Engineers as w ellas numerous internal risk management handbooks combine risk and opportunity into single assessment criteria. It could be argued that riskincludes both opportunities and losses. How ever, there is rarely an opportunity w ithout the possibility of loss. On the other hand there is almost alw ays a chance of loss w ithout opportunity. The PMBOK approach changes the definition of risk: the potential for the realization of unw anted, negative consequencesof an event. Opportunities are generally events that require intentional actions in order to achieve value. Risks are events that can be ignored. For a detailed discussion of this issue as w ellas a definitive presentation of risk management, see Appendix E, “Changing the Definition of Risk – Why Risk It?” Robert N. Charette, in Effective Risk Management: Some Keys to Success, 2nd Edition, Edmund H. Conrow , American Institute of Aeronautics and Astronautics Press, 2003. [2] “Agile Program Management: Moving fromPrinciples to Practice,” Glen B. Alleman, Cutter Agile Project Management Advisory Service, Volume 6, Number 9. [3] Appendix H: Some Characteristics and Limitations of Ordinal Scales in Risk Analyses, in Effective Risk Management, Edmund Conrow , AIAA, 2003. [4] Although the use of ordinal values is simple it is fraught w ith problems. Ordinal are a standard approach to riskranking. If ordinal scales are used, their values must be derived fromthe underlying probability data or be calibrated w ith actualprobability data. This is a complex topic best addressed in a book length manner. Appendix H and Appendix J of Effective Risk Management, E. H. Conrow are the best sources. [5] Risk Management Guide for DOD Acquisition, pp. 88.