SlideShare uma empresa Scribd logo
1 de 47
Baixar para ler offline
Integrated Cost / Schedule Risk Analysis

               A presentation to the
                   PM Challenge
               February 6-7, 2007
           Moody Gardens, Galveston, TX

               David T. Hulett, Ph.D.
                Hulett & Associates, LLC
                    Los Angeles, CA
         (310) 476-7699 / info@projectrisk.com
                 www.projectrisk.com

              © 2007 Hulett & Associates, LLC.   1
Agenda
• Schedule Risk Analysis
  – One-path schedule, two paths and the “merge bias”
  – Highest risk path – risk criticality
  – Probabilistic branching
• Integrated Cost – Schedule Risk Analysis
  – Basics – risks in time-related and time-independent
    costs
  – Schedule in Project, Costs in Excel
  – Resources in the schedule – integrated simulations
    using Monte Carlo and Pertmaster on Primavera P3
    schedules      © 2007 Hulett & Associates, LLC.       2
Risk of an Individual Activity
• Simple activity duration estimates are risky


                                     30d


                Design Unit 1




                  © 2007 Hulett & Associates, LLC.   3
Probability Distributions Available
            Date: 1/13/2003 5:21:27 PM                                                            Date: 1/13/2003 5:18:35 PM
            Samples: 3000                                                                         Samples: 3000
            Unique ID: 3                                                                          Unique ID: 3
            Name: Design Unit                                                                     Name: Design Unit
             0.09                                      1.0                                         0.16                                   1.0
             0.08                                      0.9                                                                                0.9
                                                                                                   0.14




                                                             Cumulative Probability




                                                                                                                                                Cumulative Probability
             0.07                                      0.8                                                                                0.8
                                                                                                   0.12
                                                       0.7                                                                                0.7
             0.06
Frequency




                                                                                      Frequency
                                                       0.6                                         0.10                                   0.6
             0.05
                                                       0.5                                         0.08                                   0.5
             0.04
                                                       0.4                                         0.06                                   0.4
             0.03                                      0.3                                                                                0.3
             0.02                                                                                  0.04
                                                       0.2                                                                                0.2
             0.01                                      0.1                                         0.02                                   0.1

                    6/21           7/3          7/15                                                      6/21          7/2        7/15
                           Completion Date                                                                       Completion Date
            Uniform Distribution                                                                  Triangular Distribution




                           Uniform                                                                               Triangular

                                             © 2007 Hulett & Associates, LLC.                                                                                            4
Probability Distributions Available
                                              (continued)
            Date: 7/10/2002 3:19:37 PM                                                         Date: 7/10/2002 3:20:30 PM
            Samples: 3000                                                                      Samples: 3000
            Unique ID: 3                                                                       Unique ID: 3
            Name: Design Unit                                                                  Name: Design Unit

             0.20                                   1.0                                         0.22                                   1.0
             0.18                                   0.9                                         0.20                                   0.9




                                                          Cumulative Probability




                                                                                                                                             Cumulative Probability
             0.16                                   0.8                                         0.17                                   0.8
             0.14                                   0.7                                                                                0.7
Frequency




                                                                                   Frequency
                                                                                                0.15
             0.12                                   0.6                                                                                0.6
                                                                                                0.13
             0.10                                   0.5                                                                                0.5
                                                                                                0.10
             0.08                                   0.4                                                                                0.4
                                                    0.3                                         0.08                                   0.3
             0.06
             0.04                                   0.2                                         0.05                                   0.2
             0.02                                   0.1                                         0.03                                   0.1

                    6/21          7/3        7/15                                                      6/21         7/1         7/13
                           Completion Date                                                                    Completion Date
            Normal Distribution                                                                Beta Distribution



                            Normal                                                                                 BETA

                                         © 2007 Hulett & Associates, LLC.                                                                                             5
Comparison of Four Distributions
• The three distributions have different characteristics
   – The uniform expresses most risk (mean, Standard deviation)
   – Triangular is fairly conservative
   – The Beta is the least risky

            Comparison of Probability Distributions
                      (20d, 30d, 45d)
                       Mean           Standard Deviation
  Uniform               33d                   7.2d
  Triangular            32d                   5.1d
  Normal                33d                   4.1d
  Beta                  31d                   3.4d
                     © 2007 Hulett & Associates, LLC.             6
Risk Along a Contiguous Schedule Path

• Path risk is the combination of the risks of its
  activities



            Design           Build                Test
 Start                                                   Finish
            Unit             Unit                 Unit




                     © 2007 Hulett & Associates, LLC.             7
Really Simple Schedule
    • This schedule finishes on September 3
        – 7-day weeks, like a model changeover, refinery turnaround
ID Task Name         Duration      Start       Finish   May         June         July    August      Septembe
1   Project           95 d         6/1         9/3
2      Start          0d           6/1         6/1                   6/1
3      Design Unit    30 d         6/1         6/30           6/1                6/30
4      Build Unit     40 d         7/1         8/9                         7/1                 8/9
5      Test Unit      25 d         8/10        9/3                                      8/10          9/3
6      Finish         0d           9/3         9/3                                                    9/3




    • If we can get into trouble with this simple schedule, we can
      get into trouble with real project schedules
                                © 2007 Hulett & Associates, LLC.                                            8
Add Duration Risk to the Schedule
           using Triangular Distributions

ID        Task Name   Rept ID     Min Rdur        ML Rdur   Max Rdur   Curve
 1   Project           2           0d              0d        0d         0
2       Start          0           0d              0d        0d         0
3       Design Unit    0           20 d            30 d      45 d       2
4       Build Unit     0           35 d            40 d      50 d       2
5       Test Unit      0           20 d            25 d      50 d       2
6       Finish         0           0d              0d        0d         0




                       © 2007 Hulett & Associates, LLC.                     9
What is a Simulation?
• How do you find total project results?
   – Cannot add distributions
   – Must combine distributions
• Combining distributions using simulation
   – Almost all possible combinations of durations
   – “Perform” the project many times



                   © 2007 Hulett & Associates, LLC.   10
Combine Distributions by Simulation
• Monte Carlo simulation
   – Very General
   – 50-year old method
• Computer “performs” project many times
   – Exercise is a “simulation”
   – Each calculation is an “iteration”
• Brute force solution
   – All combinations of possible costs or durations
                    © 2007 Hulett & Associates, LLC.   11
Monte Carlo Simulation Results
                            for Really Simple Schedule
            CPM date is not even the most likely – That’s about 9/10
            Date: 2/18/2006 3:56:56 P M                                                     Com pletion S td Deviation: 8.75 d
            S am ples : 3000                                                                95% Confidenc e Interval: 0.31 d
            Unique ID: 2                                                                    E ac h bar repres ents 3 d
            Nam e: P rojec t

             0.14                                            1.0                             Com pletion P robability Table
                                                             0.9




                                                                   Cumulative Probability
             0.12                                                                           P rob   Date       P rob    Date
                                                             0.8
                                                                                            0.05    8/31       0.55     9/14
             0.10                                            0.7                            0.10    9/2        0.60     9/16
Frequency




                                                             0.6                            0.15    9/4        0.65     9/17
             0.08
                                                             0.5                            0.20    9/6        0.70     9/18
             0.06                                            0.4                            0.25    9/7        0.75     9/19
                                                             0.3                            0.30    9/8        0.80     9/21
             0.04
                                                                                            0.35    9/10       0.85     9/23
                                                             0.2
             0.02                                                                           0.40    9/11       0.90     9/25
                                                             0.1                            0.45    9/12       0.95     9/29
                    8/21           9/13              10/10
                                                                                            0.50    9/13       1.00     10/10
                            C o mp le tio n D a te

                                                                                                                       80% Target is
                                           CPM date is&<15% Likely to be met
                                            © 2007 Hulett Associates, LLC.                                                9/21 12
Risk at Merge Points:
                 The “Merge Bias”
   • Many parallel paths merge in a real schedule
   • Finish driven by the latest converging path
   • Merge Bias has been understood for 40 years


            Design Unit 1           Build Unit 1           Test Unit 1


Start
                                                                         Finish
            Design Unit 2           Build Unit 2           Test Unit 2



                            © 2007 Hulett & Associates, LLC.                  13
This Schedule has
                            Three Parallel Paths

ID     Task Name       Rept ID   Min Rdur   ML Rdur    Max Rdur   Curve    May         June         July    August      Septemb
1 Project               2        0d          0d         0d          0
2   Start               0        0d          0d         0d          0                   6/1
3    Unit 1             1        0d          0d         0d          0
4       Design Unit     0        20 d        30 d       45 d        2            6/1                6/30
5       Build Unit 1    0        35 d        40 d       50 d        2                         7/1                 8/9
6       Test Unit 1     0        20 d        25 d       50 d        2                                      8/10          9/3
7    Unit 2             1        0d          0d         0d          0
11   Unit 3             1        0d          0d         0d          0
15   Finish             0        0d          0d         0d          0                                                    9/3



                      Two paths are collapsed
               Each path has exactly the same structure

                                        © 2007 Hulett & Associates, LLC.                                                14
Evidence of the Merge Bias
        Date: 2/18/2006 4:04:12 PM                                                            Date: 2/18/2006 3:56:56 PM
        Samples: 3000                                                                         Samples: 3000
        Unique ID: 2                                                                          Unique ID: 2
        Name: Project                                                                         Name: Project

            0.16                                       1.0                                        0.14                                     1.0
                                                       0.9                                                                                 0.9
            0.14




                                                             Cumulative Probability




                                                                                                                                                 Cumulative Probability
                                                                                                  0.12
                                                       0.8                                                                                 0.8
            0.12
                                                       0.7                                        0.10                                     0.7
Frequency




                                                                                      Frequency
            0.10                                       0.6                                                                                 0.6
                                                                                                  0.08
            0.08                                       0.5                                                                                 0.5
                                                       0.4                                        0.06                                     0.4
            0.06
                                                       0.3                                        0.04                                     0.3
            0.04
                                                       0.2                                                                                 0.2
            0.02                                                                                  0.02
                                                       0.1                                                                                 0.1

                   8/31          9/21          10/14                                                     8/21         9/13         10/10
                            Completion Date                                                                      Completion Date

                          Three Path Project                                                                    One Path Project
                                          © 2007 Hulett & Associates, LLC.                                                                       15
Evidence of Merge Bias (continued)
C o m p le t io n S t d D e via t io n : 6 . 9 5 d         C o m p le t io n S t d D e via t io n : 8 . 9 3 d
9 5 % C o n fid e n c e In t e rva l: 0 . 2 5 d            9 5 % C o n fid e n c e In t e rva l: 0 . 3 2 d
E a c h b a r re p re s e n t s 3 d                        E a c h b a r re p re s e n t s 3 d


  C o m p le t io n P ro b a b ilit y Ta b le                C o m p le t io n P ro b a b ilit y Ta b le
P ro b     D ate            P ro b      Date               P ro b     D ate            P ro b      D ate
0.05       9/10             0.55        9/22               0.05       8/31             0.55        9/14
0.10       9/13             0.60        9/23               0.10       9/3              0.60        9/15
0.15       9/14             0.65        9/24               0.15       9/4              0.65        9/17
0.20       9/15             0.70        9/25               0.20       9/6              0.70        9/18
0.25       9/16             0.75        9/26               0.25       9/7              0.75        9/20
0.30       9/17             0.80        9/27               0.30       9/8              0.80        9/21
0.35       9/18             0.85        9/29               0.35       9/9              0.85        9/23
0.40       9/19             0.90        10/1               0.40       9/11             0.90        9/25
0.45       9/20             0.95        10/3               0.45       9/12             0.95        9/29
0.50       9/21             1.00        10/14              0.50       9/13             1.00        10/15




 Three Path Schedule                                        One Path Schedule
                                 © 2007 Hulett & Associates, LLC.                                           16
Graphical Evidence of the Merge Bias

                                    The "Merge Bias"

            100%

            90%

            80%

            70%                                                                     One
            60%                                                                     Path
       b.
 Cum.Pro




                                                                                    Three
            50%                                                                     Path
            40%                                            Merge Bias
            30%

            20%

            10%

             0%
               8/11   8/21   8/31     9/10          9/20     9/30   10/10   10/20
                                             Date


                             © 2007 Hulett & Associates, LLC.                               17
Cost and Schedule Risk Integration

                       Risk

Project Schedule                              Cost Risk
      Risk
                         “Burn Rate”                  Time Independent
 Time                                                       Costs

        Time Dependent                         Project
             Costs                            Cost Risk
                   © 2007 Hulett & Associates, LLC.                      18
Cost Estimating Basics
• Cost estimates can be constructed by multiplying:
   – Workers assigned
   – Daily rate
   – Duration of task
• Uncertainty in any of these variables leads to
  uncertainty in project cost estimates
• Cost risk estimating can be more accurate and the
  reasons for risk better illuminated when time and
  cost factors are addressed individually rather than
  as one cost uncertainty distribution
                 © 2007 Hulett & Associates, LLC.       19
Cost / Schedule Risk Using a Schedule
    • Simple schedule
    • Starts June 1, finishes without risk on September 6


ID Task Name                Duration    Start      Finish   May         June      July   August        SeptembO
0   Integrated Cost-Sched   98 d        6/1        9/6
1      Start                0d          6/1        6/1                   6/1
2      Design               28 d        6/1        6/28           6/1             6/28
3      Build                45 d        6/29       8/12                    6/29                 8/12
4      Test                 25 d        8/13       9/6                                   8/13           9/6
5      Finish               0d          9/6        9/6                                                   9/6




                                   © 2007 Hulett & Associates, LLC.                                            20
Add Resources to the Simple Schedule
• Designers, builders and testers are assigned and cost
  data are specified
 ID   Task Name                       Duration      Start        Finish   Resource Names
 0    Integrated Cost-Schedule         98 d         6/1          9/6
 1        Start                         0d          6/1          6/1
 2        Design                       28 d         6/1          6/28     Designers[5]
 3        Build                        45 d         6/29         8/12     Builders[10]
 4        Test                         25 d         8/13         9/6      Testers[8]
 5        Finish                        0d          9/6          9/6


            Resource Name                     Type of Resource               Rate

            Designers                               Work                   $90/hr
            Builders                                Work                   $80/hr
            Testers                                 Work                  $105/hr
                            © 2007 Hulett & Associates, LLC.                             21
Computing Schedule Risk when Time and
       Resources are in MS Project
• Using Risk+, simulate the MS Project schedule,
  collecting cost results for the project
• Inputs
  – 3-point estimates for duration of tasks
• Outputs
  – Pairs of cost and date for each iteration
• Note: the cost of each resource per time period
  is fixed in this method
                  © 2007 Hulett & Associates, LLC.   22
Inputs to Schedule Risk Analysis


ID      Task Name       Rept       Min Rd       ML Rdu   Max Rd   Curve
0 Integrated Cost-        2         0d           0d      0d       0
1   Start                 0         0d           0d      0d       0
2    Design               0         20 d         28 d    40 d     2
3    Build                0         35 d         45 d    60 d     2
4    Test                 0         15 d         25 d    40 d     2
5    Finish               0         0d           0d      0d       0




                    © 2007 Hulett & Associates, LLC.                  23
Schedule Risk Analysis: Dates
                      Date: 2/18/2006 9:49:40 AM                                              Completion Std Deviation: 8.25 d
                      Samples: 3000                                                           95% Confidence Interval: 0.29 d
                      Unique ID: 0                                                            Each bar represents 3 d
                      Name: Integrated Cost-Schedule

                       0.14                                    1.0                            Completion Probability Table
                                                               0.9




                                                                     Cumulative Probability
                       0.12                                                                   Prob   Date     Prob    Date
                                                               0.8
                                                                                              0.05   8/29     0.55    9/12
                       0.10                                    0.7                            0.10   8/31     0.60    9/13
          Frequency




                                                               0.6                            0.15   9/2      0.65    9/14
                       0.08
                                                               0.5                            0.20   9/4      0.70    9/16
                       0.06                                    0.4                            0.25   9/5      0.75    9/17
                                                               0.3                            0.30   9/7      0.80    9/18
                       0.04
                                                                                              0.35   9/8      0.85    9/20
Source:                                                        0.2
                                                                                              0.40   9/9      0.90    9/22
                       0.02
Risk+®                                                         0.1                            0.45   9/10     0.95    9/25
                              8/17        9/11          10/7
                                                                                              0.50   9/11     1.00    10/7
                                     Completion Date

Sept. 6 is 25 – 30% likely. 80th percentile is Sept. 20 for a 2-week contingency
                                           © 2007 Hulett & Associates, LLC.                                                      24
All Resource Types are “Work”
• Each resource is assumed to work on a daily basis
   – Baseline cost is $556,800
   – Each extra day of work is extra cost, dollar for dollar
• Cost risk is determined by uncertain durations only
   ID   Task Name                              Duration   Total Cost
    0   Integrated Cost-Schedule                 98 d     $556,800
    1       Start                                 0d         $0
    2       Design                               28 d     $100,800
    3       Build                                45 d     $288,000
    4       Test                                 25 d     $168,000
    5       Finish                                0d         $0
                     © 2007 Hulett & Associates, LLC.                  25
All Resource Types are “Work” (2)
            Date: 2/18/2006 9:49:40 AM                                             Cost Standard Deviation: $49,645
            Samples: 3000                                                          95% Confidence Interval: $1,777
            Unique ID: 0                                                           Each bar represents $25,000
            Name: Integrated Cost-Schedule

             0.20                                   1.0                                    Cost Probability Table
             0.18                                   0.9




                                                          Cumulative Probability
                                                                                   Prob   Cost          Prob    Cost
             0.16                                   0.8
                                                                                   0.05   $503,329      0.55    $589,111
             0.14                                   0.7                            0.10   $519,541      0.60    $595,793
Frequency




             0.12                                   0.6                            0.15   $530,895      0.65    $602,967
             0.10                                   0.5                            0.20   $539,706      0.70    $610,397
             0.08                                   0.4                            0.25   $547,195      0.75    $617,877
             0.06                                   0.3                            0.30   $555,041      0.80    $626,705
                                                                                   0.35   $562,138      0.85    $636,646
             0.04                                   0.2
                                                                                   0.40   $569,210      0.90    $649,900
             0.02                                   0.1                            0.45   $575,955      0.95    $667,044
                $432,397     $583,479        $736,369
                                                                                   0.50   $583,082      1.00    $736,369
                               Cost


               Cost risk results differ because activity duration risks differ
                                 © 2007 Hulett & Associates, LLC.                                                          26
With Work-Type Resources,
         Cost and Time are Highly Correlated
                    Scatter Plot of Time and Cost for Work-Type Resources

       800,000


       700,000


       600,000


       500,000
Cost




       400,000


       300,000


       200,000


       100,000


            0
             8/11         8/21        8/31        9/10       9/20      9/30   10/10
                                                  Date
                                 © 2007 Hulett & Associates, LLC.                     27
Uncertainty in the “Burn Rate”
• Usually resources are found in a spreadsheet
• This enables us to deal with uncertain burn rates
• Cost estimates are often at a less detailed level
  than the schedule
• We also will often need schedule risk analysis for a
  summary task



                  © 2007 Hulett & Associates, LLC.   28
Cost Estimates are in a Spreadsheet /
        Schedules are in Scheduling Package
• Process when schedule is in MS Project and costs
  are in MS Excel
• Use schedule risk results from Risk+ for Project and
  Crystal Ball for Excel
   –   Simulate MS Project with Risk+ for duration, not dates
   –   Read the detailed iteration results into a spreadsheet
   –   Estimate the Crystal Ball function that fits the best
   –   Use that function in the cost estimate to represent
       uncertain duration in Crystal Ball simulation of cost risk
                      © 2007 Hulett & Associates, LLC.              29
The Cost Estimate may be at a
 Higher Level than the Schedule
               Summary Cost Estimate

Cost Element                                Value

Average Workers                                          8


Hourly Rate                                             88


Hours/Day                                                8


Days                                                    98


Total Cost                                          556,800


               © 2007 Hulett & Associates, LLC.               30
Determine the Best Crystal Ball Distribution
for the Uncertain Schedule Risk Duration: Beta




Source: Crystal Ball®
                        © 2007 Hulett & Associates, LLC.   31
Distribution Parameters




    © 2007 Hulett & Associates, LLC.   32
Insert Uncertain Burn Rate into Cost Model
                      Summary Cost Estimate

Cost Element      Value         Minimum           Most Likely        Maximum

Average Workers             8                 6                 8              12


Hourly Rate                88               84                  88             100


Hours/Day                   8


Days                       98 Fitted Beta Distribution


Total Cost           556,800



                    © 2007 Hulett & Associates, LLC.                            33
Adding Uncertainty in Burn Rate
                           Uncertain Duration, Workers and Rate per Hour

               1,200,000



               1,000,000



                800,000
        Cost




                600,000



                400,000



                200,000
  More Scatter, Less
 Tightly Correlated due
                0
                 8/11       8/21        8/31        9/10         9/20      9/30   10/10
to Uncertain Burn Rate                              Date




                             © 2007 Hulett & Associates, LLC.                             34
Consider More Realism:
           Time-Independent Resources
• Some resources’ costs are not determined by time
   – E.g., test equipment, materials
• These are “use-type” or “material-type” resources
• Their costs may not be known with certainty but
  they are not determined by activity durations




                   © 2007 Hulett & Associates, LLC.   35
Add Test Equipment @ $200,000
                                Time and Material Resources

Resource                    Type                    Hourly Rate               Rate per Use

Designers                   Work                                     $90/hr                      N/A
Builders                    Work                                     $80/hr                      N/A
Testers                     Work                                    $105/hr                      N/A
Test Equipment              Material                                   N/A                   $200,000


ID   Task Name                  Duration    Start          Finish         Cost    Resource Names
0    Integrated Cost-Schedule   98 d        6/1            9/6          $756,800
1       Start                    0d         6/1            6/1            $0
2       Design                  28 d        6/1            6/28         $100,800 Designers[5]
3       Build                   45 d        6/29           8/12         $288,000 Builders[10]
4       Test                    25 d        8/13           9/6          $368,000 Testers[8],Test Equipme
5       Finish                   0d         9/6            9/6            $0

                                © 2007 Hulett & Associates, LLC.                                    36
Add Risky Materials Cost
                      Independent of Time
                          Summary Cost Estimate

Cost Element           Value         Minimum          Most Likely        Maximum

Average Workers                  8                6                 8              12

Hourly Rate                     88               84                 88             100

Hours/Day                        8

Days                            98 Beta Distribution

Time-Related Cost         556,800

Test Equipment            200,000          160,000           200,000         280,000

Total Cost                756,800



                        © 2007 Hulett & Associates, LLC.                            37
Adding Materials with Time-Independent Risk
                              Adding Time-Independent Equipment Cost Risk

                  1,400,000


                  1,200,000


                  1,000,000


                   800,000
           Cost




                                                                                    Series1
                   600,000


                   400,000



More Scatter, 200,000 tightly
              Less
   Correlated due to0
Uncertain Burn Rate and 8/21
                     8/11               8/31      9/10      9/20     9/30   10/10
                                                  Date
Risky Time-Independent
     Material Cost
                                  © 2007 Hulett & Associates, LLC.                            38
Computing Schedule Risk when Cost and
    Schedule are in the Scheduling Program
• Resources are identified and their hourly or daily cost are
  input into the scheduling software
• Resources are assigned to tasks and costs of those tasks
  and the total project are computed
• Uncertainty can be added by:
   – Probability distribution of the duration
   – Probability distribution of the burn rate
   – Use or material resources can also be risky and their costs varied
• Jointly simulate the cost and schedule in the program

                      © 2007 Hulett & Associates, LLC.               39
Hardware / Software Build and Integrate




     Build the Schedule in Primavera Project Planner (P3)
                 © 2007 Hulett & Associates, LLC.           40
Modern Approach to Integrated C/S Risk:
  Import P3 Schedule to Pertmaster




           © 2007 Hulett & Associates, LLC.   41
Pertmaster Risk from P3 Schedules




           Duration Risk Range


         © 2007 Hulett & Associates, LLC.   42
Pertmaster Risk from P3 Schedules (2)




Time-Independent Risk Range                      Burn Rate Risk Range



                  © 2007 Hulett & Associates, LLC.                      43
Integrated Cost and Schedule Risk Results

                                                         Overrun both
                                                          Cost and
                                                          Schedule




  Date and Cost Scatter plot from Pertmaster® schedule risk software
                      © 2007 Hulett & Associates, LLC.                  44
Summary of Main Principles
• Schedule Risk depends on the schedule logic and
  uncertainty in the activity durations
• Monte Carlo simulation is the accepted method of
  estimating the uncertainty from all risks
  simultaneously
• Simulation software allows Monte Carlo for
  schedules in several packages (e.g. Project, P3)


                 © 2007 Hulett & Associates, LLC.    45
Summary of Main Principles (2)
• Cost risk depends in large part on elements of
  schedule uncertainty
   – The cost estimate is not secure if the schedule is
     slipping
• Uncertain burn rates for time-dependent costs
• Uncertain costs for time-independent costs



                    © 2007 Hulett & Associates, LLC.      46
Integrated Cost / Schedule Risk Analysis

               A presentation to the
                   PM Challenge
               February 6-7, 2007
           Moody Gardens, Galveston, TX

               David T. Hulett, Ph.D.
                Hulett & Associates, LLC
                    Los Angeles, CA
         (310) 476-7699 / info@projectrisk.com
                 www.projectrisk.com

              © 2007 Hulett & Associates, LLC.   47

Mais conteúdo relacionado

Mais procurados

២១ ខេត្តតាកែវ
២១ ខេត្តតាកែវ២១ ខេត្តតាកែវ
២១ ខេត្តតាកែវsam seyla hun
 
១៣ ខេត្តព្រះវិហារ
១៣ ខេត្តព្រះវិហារ១៣ ខេត្តព្រះវិហារ
១៣ ខេត្តព្រះវិហារsam seyla hun
 
Open Garden for AndroidOpen
Open Garden for AndroidOpenOpen Garden for AndroidOpen
Open Garden for AndroidOpenMicha Benoliel
 
Resource plan report stage 1 - final
Resource plan report   stage 1 - finalResource plan report   stage 1 - final
Resource plan report stage 1 - finalAjay Zitshi
 
LinkedIn's Q1 2012 Earnings
LinkedIn's Q1 2012 EarningsLinkedIn's Q1 2012 Earnings
LinkedIn's Q1 2012 EarningsLinkedIn
 
Analytics Www.Informaticabiomedica.Com.Br 20080101 20091120 (Keywords Report)
Analytics Www.Informaticabiomedica.Com.Br 20080101 20091120 (Keywords Report)Analytics Www.Informaticabiomedica.Com.Br 20080101 20091120 (Keywords Report)
Analytics Www.Informaticabiomedica.Com.Br 20080101 20091120 (Keywords Report)Raony Guimarães
 
A Cheaper Hospital In Five Days
A Cheaper Hospital In Five DaysA Cheaper Hospital In Five Days
A Cheaper Hospital In Five DaysJay Arthur
 

Mais procurados (9)

២១ ខេត្តតាកែវ
២១ ខេត្តតាកែវ២១ ខេត្តតាកែវ
២១ ខេត្តតាកែវ
 
១៣ ខេត្តព្រះវិហារ
១៣ ខេត្តព្រះវិហារ១៣ ខេត្តព្រះវិហារ
១៣ ខេត្តព្រះវិហារ
 
Open Garden for AndroidOpen
Open Garden for AndroidOpenOpen Garden for AndroidOpen
Open Garden for AndroidOpen
 
Resource plan report stage 1 - final
Resource plan report   stage 1 - finalResource plan report   stage 1 - final
Resource plan report stage 1 - final
 
LinkedIn's Q1 2012 Earnings
LinkedIn's Q1 2012 EarningsLinkedIn's Q1 2012 Earnings
LinkedIn's Q1 2012 Earnings
 
Capacidade Planejada
Capacidade PlanejadaCapacidade Planejada
Capacidade Planejada
 
Julee mineral water
Julee mineral waterJulee mineral water
Julee mineral water
 
Analytics Www.Informaticabiomedica.Com.Br 20080101 20091120 (Keywords Report)
Analytics Www.Informaticabiomedica.Com.Br 20080101 20091120 (Keywords Report)Analytics Www.Informaticabiomedica.Com.Br 20080101 20091120 (Keywords Report)
Analytics Www.Informaticabiomedica.Com.Br 20080101 20091120 (Keywords Report)
 
A Cheaper Hospital In Five Days
A Cheaper Hospital In Five DaysA Cheaper Hospital In Five Days
A Cheaper Hospital In Five Days
 

Destaque

Coonce.tom
Coonce.tomCoonce.tom
Coonce.tomNASAPMC
 
Hazen michael
Hazen michaelHazen michael
Hazen michaelNASAPMC
 
Terry.cooke davies
Terry.cooke daviesTerry.cooke davies
Terry.cooke daviesNASAPMC
 
Backup ronniegoodinchampionsinventors
Backup ronniegoodinchampionsinventorsBackup ronniegoodinchampionsinventors
Backup ronniegoodinchampionsinventorsNASAPMC
 
Canga.m.wood.j
Canga.m.wood.jCanga.m.wood.j
Canga.m.wood.jNASAPMC
 
Ann over
Ann overAnn over
Ann overNASAPMC
 
Baldwin.kristen
Baldwin.kristenBaldwin.kristen
Baldwin.kristenNASAPMC
 
Backup hesenperger kottmeyer
Backup hesenperger kottmeyerBackup hesenperger kottmeyer
Backup hesenperger kottmeyerNASAPMC
 
Ipao great houseetc-programmatic analysis ll
Ipao great houseetc-programmatic analysis llIpao great houseetc-programmatic analysis ll
Ipao great houseetc-programmatic analysis llNASAPMC
 
Patterson.donna
Patterson.donnaPatterson.donna
Patterson.donnaNASAPMC
 
Pollitt.julie
Pollitt.juliePollitt.julie
Pollitt.julieNASAPMC
 
Gena.henderson
Gena.hendersonGena.henderson
Gena.hendersonNASAPMC
 
Al.worden
Al.wordenAl.worden
Al.wordenNASAPMC
 
Fayssal.safie
Fayssal.safieFayssal.safie
Fayssal.safieNASAPMC
 
Newman.steve
Newman.steveNewman.steve
Newman.steveNASAPMC
 
Cathy.carr
Cathy.carrCathy.carr
Cathy.carrNASAPMC
 
Hartford.wayne wh1
Hartford.wayne wh1Hartford.wayne wh1
Hartford.wayne wh1NASAPMC
 
James.hale
James.haleJames.hale
James.haleNASAPMC
 
Louis.cioletti
Louis.ciolettiLouis.cioletti
Louis.ciolettiNASAPMC
 

Destaque (20)

Coonce.tom
Coonce.tomCoonce.tom
Coonce.tom
 
Hazen michael
Hazen michaelHazen michael
Hazen michael
 
Terry.cooke davies
Terry.cooke daviesTerry.cooke davies
Terry.cooke davies
 
Backup ronniegoodinchampionsinventors
Backup ronniegoodinchampionsinventorsBackup ronniegoodinchampionsinventors
Backup ronniegoodinchampionsinventors
 
Canga.m.wood.j
Canga.m.wood.jCanga.m.wood.j
Canga.m.wood.j
 
Ann over
Ann overAnn over
Ann over
 
Baldwin.kristen
Baldwin.kristenBaldwin.kristen
Baldwin.kristen
 
Backup hesenperger kottmeyer
Backup hesenperger kottmeyerBackup hesenperger kottmeyer
Backup hesenperger kottmeyer
 
Ipao great houseetc-programmatic analysis ll
Ipao great houseetc-programmatic analysis llIpao great houseetc-programmatic analysis ll
Ipao great houseetc-programmatic analysis ll
 
Patterson.donna
Patterson.donnaPatterson.donna
Patterson.donna
 
Taube
TaubeTaube
Taube
 
Pollitt.julie
Pollitt.juliePollitt.julie
Pollitt.julie
 
Gena.henderson
Gena.hendersonGena.henderson
Gena.henderson
 
Al.worden
Al.wordenAl.worden
Al.worden
 
Fayssal.safie
Fayssal.safieFayssal.safie
Fayssal.safie
 
Newman.steve
Newman.steveNewman.steve
Newman.steve
 
Cathy.carr
Cathy.carrCathy.carr
Cathy.carr
 
Hartford.wayne wh1
Hartford.wayne wh1Hartford.wayne wh1
Hartford.wayne wh1
 
James.hale
James.haleJames.hale
James.hale
 
Louis.cioletti
Louis.ciolettiLouis.cioletti
Louis.cioletti
 

Semelhante a Hulett david

ST.Monteiro-EmbeddedFeatureSelection.pdf
ST.Monteiro-EmbeddedFeatureSelection.pdfST.Monteiro-EmbeddedFeatureSelection.pdf
ST.Monteiro-EmbeddedFeatureSelection.pdfgrssieee
 
Why we don’t know how many colors there are
Why we don’t know how many colors there areWhy we don’t know how many colors there are
Why we don’t know how many colors there areJan Morovic
 
Miltenburg M Sc Presentation Tu Delft
Miltenburg   M Sc Presentation Tu DelftMiltenburg   M Sc Presentation Tu Delft
Miltenburg M Sc Presentation Tu Delftimiltenburg
 
Quantitative methods schedule
Quantitative methods scheduleQuantitative methods schedule
Quantitative methods scheduleJohn Goodpasture
 
Shape contexts
Shape contextsShape contexts
Shape contextshuebesao
 
Calvert, Do ‘normal’ traffic conditions really exist? Why modelling variation...
Calvert, Do ‘normal’ traffic conditions really exist? Why modelling variation...Calvert, Do ‘normal’ traffic conditions really exist? Why modelling variation...
Calvert, Do ‘normal’ traffic conditions really exist? Why modelling variation...flmkessels
 
Ukázkový report - SolidVision
Ukázkový report - SolidVisionUkázkový report - SolidVision
Ukázkový report - SolidVision3dskenovani
 
Forecast Modelling (Single Variable)
Forecast Modelling (Single Variable)Forecast Modelling (Single Variable)
Forecast Modelling (Single Variable)Mohd Paub
 
Jun 2009 Tatum Survey
Jun 2009 Tatum SurveyJun 2009 Tatum Survey
Jun 2009 Tatum Surveyfnapoli
 
3D Combined Footing Design
3D Combined Footing Design3D Combined Footing Design
3D Combined Footing DesignMario Galvez
 
Feasible study of a light weight prediction system in China
Feasible study of a light weight prediction system in ChinaFeasible study of a light weight prediction system in China
Feasible study of a light weight prediction system in ChinaOsamu Masutani
 
Aug 2009 Tatum Survey
Aug 2009 Tatum SurveyAug 2009 Tatum Survey
Aug 2009 Tatum Surveyfnapoli
 
Datasheet - Nuclear and Power
Datasheet - Nuclear and PowerDatasheet - Nuclear and Power
Datasheet - Nuclear and PowerGagan Sood
 
GOwind_extendedversion_v3
GOwind_extendedversion_v3GOwind_extendedversion_v3
GOwind_extendedversion_v3jpdmaeye
 

Semelhante a Hulett david (20)

ST.Monteiro-EmbeddedFeatureSelection.pdf
ST.Monteiro-EmbeddedFeatureSelection.pdfST.Monteiro-EmbeddedFeatureSelection.pdf
ST.Monteiro-EmbeddedFeatureSelection.pdf
 
MRV – SISA
MRV – SISAMRV – SISA
MRV – SISA
 
Why we don’t know how many colors there are
Why we don’t know how many colors there areWhy we don’t know how many colors there are
Why we don’t know how many colors there are
 
Miltenburg M Sc Presentation Tu Delft
Miltenburg   M Sc Presentation Tu DelftMiltenburg   M Sc Presentation Tu Delft
Miltenburg M Sc Presentation Tu Delft
 
Quantitative methods schedule
Quantitative methods scheduleQuantitative methods schedule
Quantitative methods schedule
 
Gregoire H&N
Gregoire H&NGregoire H&N
Gregoire H&N
 
DCT_TR802
DCT_TR802DCT_TR802
DCT_TR802
 
DCT_TR802
DCT_TR802DCT_TR802
DCT_TR802
 
DCT_TR802
DCT_TR802DCT_TR802
DCT_TR802
 
Modeling & Simulation
Modeling & SimulationModeling & Simulation
Modeling & Simulation
 
Shape contexts
Shape contextsShape contexts
Shape contexts
 
Calvert, Do ‘normal’ traffic conditions really exist? Why modelling variation...
Calvert, Do ‘normal’ traffic conditions really exist? Why modelling variation...Calvert, Do ‘normal’ traffic conditions really exist? Why modelling variation...
Calvert, Do ‘normal’ traffic conditions really exist? Why modelling variation...
 
Ukázkový report - SolidVision
Ukázkový report - SolidVisionUkázkový report - SolidVision
Ukázkový report - SolidVision
 
Forecast Modelling (Single Variable)
Forecast Modelling (Single Variable)Forecast Modelling (Single Variable)
Forecast Modelling (Single Variable)
 
Jun 2009 Tatum Survey
Jun 2009 Tatum SurveyJun 2009 Tatum Survey
Jun 2009 Tatum Survey
 
3D Combined Footing Design
3D Combined Footing Design3D Combined Footing Design
3D Combined Footing Design
 
Feasible study of a light weight prediction system in China
Feasible study of a light weight prediction system in ChinaFeasible study of a light weight prediction system in China
Feasible study of a light weight prediction system in China
 
Aug 2009 Tatum Survey
Aug 2009 Tatum SurveyAug 2009 Tatum Survey
Aug 2009 Tatum Survey
 
Datasheet - Nuclear and Power
Datasheet - Nuclear and PowerDatasheet - Nuclear and Power
Datasheet - Nuclear and Power
 
GOwind_extendedversion_v3
GOwind_extendedversion_v3GOwind_extendedversion_v3
GOwind_extendedversion_v3
 

Mais de NASAPMC

Bejmuk bo
Bejmuk boBejmuk bo
Bejmuk boNASAPMC
 
Baniszewski john
Baniszewski johnBaniszewski john
Baniszewski johnNASAPMC
 
Yew manson
Yew mansonYew manson
Yew mansonNASAPMC
 
Wood frank
Wood frankWood frank
Wood frankNASAPMC
 
Wood frank
Wood frankWood frank
Wood frankNASAPMC
 
Wessen randi (cd)
Wessen randi (cd)Wessen randi (cd)
Wessen randi (cd)NASAPMC
 
Vellinga joe
Vellinga joeVellinga joe
Vellinga joeNASAPMC
 
Trahan stuart
Trahan stuartTrahan stuart
Trahan stuartNASAPMC
 
Stock gahm
Stock gahmStock gahm
Stock gahmNASAPMC
 
Snow lee
Snow leeSnow lee
Snow leeNASAPMC
 
Smalley sandra
Smalley sandraSmalley sandra
Smalley sandraNASAPMC
 
Seftas krage
Seftas krageSeftas krage
Seftas krageNASAPMC
 
Sampietro marco
Sampietro marcoSampietro marco
Sampietro marcoNASAPMC
 
Rudolphi mike
Rudolphi mikeRudolphi mike
Rudolphi mikeNASAPMC
 
Roberts karlene
Roberts karleneRoberts karlene
Roberts karleneNASAPMC
 
Rackley mike
Rackley mikeRackley mike
Rackley mikeNASAPMC
 
Paradis william
Paradis williamParadis william
Paradis williamNASAPMC
 
Osterkamp jeff
Osterkamp jeffOsterkamp jeff
Osterkamp jeffNASAPMC
 
O'keefe william
O'keefe williamO'keefe william
O'keefe williamNASAPMC
 
Muller ralf
Muller ralfMuller ralf
Muller ralfNASAPMC
 

Mais de NASAPMC (20)

Bejmuk bo
Bejmuk boBejmuk bo
Bejmuk bo
 
Baniszewski john
Baniszewski johnBaniszewski john
Baniszewski john
 
Yew manson
Yew mansonYew manson
Yew manson
 
Wood frank
Wood frankWood frank
Wood frank
 
Wood frank
Wood frankWood frank
Wood frank
 
Wessen randi (cd)
Wessen randi (cd)Wessen randi (cd)
Wessen randi (cd)
 
Vellinga joe
Vellinga joeVellinga joe
Vellinga joe
 
Trahan stuart
Trahan stuartTrahan stuart
Trahan stuart
 
Stock gahm
Stock gahmStock gahm
Stock gahm
 
Snow lee
Snow leeSnow lee
Snow lee
 
Smalley sandra
Smalley sandraSmalley sandra
Smalley sandra
 
Seftas krage
Seftas krageSeftas krage
Seftas krage
 
Sampietro marco
Sampietro marcoSampietro marco
Sampietro marco
 
Rudolphi mike
Rudolphi mikeRudolphi mike
Rudolphi mike
 
Roberts karlene
Roberts karleneRoberts karlene
Roberts karlene
 
Rackley mike
Rackley mikeRackley mike
Rackley mike
 
Paradis william
Paradis williamParadis william
Paradis william
 
Osterkamp jeff
Osterkamp jeffOsterkamp jeff
Osterkamp jeff
 
O'keefe william
O'keefe williamO'keefe william
O'keefe william
 
Muller ralf
Muller ralfMuller ralf
Muller ralf
 

Último

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKJago de Vreede
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 

Último (20)

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 

Hulett david

  • 1. Integrated Cost / Schedule Risk Analysis A presentation to the PM Challenge February 6-7, 2007 Moody Gardens, Galveston, TX David T. Hulett, Ph.D. Hulett & Associates, LLC Los Angeles, CA (310) 476-7699 / info@projectrisk.com www.projectrisk.com © 2007 Hulett & Associates, LLC. 1
  • 2. Agenda • Schedule Risk Analysis – One-path schedule, two paths and the “merge bias” – Highest risk path – risk criticality – Probabilistic branching • Integrated Cost – Schedule Risk Analysis – Basics – risks in time-related and time-independent costs – Schedule in Project, Costs in Excel – Resources in the schedule – integrated simulations using Monte Carlo and Pertmaster on Primavera P3 schedules © 2007 Hulett & Associates, LLC. 2
  • 3. Risk of an Individual Activity • Simple activity duration estimates are risky 30d Design Unit 1 © 2007 Hulett & Associates, LLC. 3
  • 4. Probability Distributions Available Date: 1/13/2003 5:21:27 PM Date: 1/13/2003 5:18:35 PM Samples: 3000 Samples: 3000 Unique ID: 3 Unique ID: 3 Name: Design Unit Name: Design Unit 0.09 1.0 0.16 1.0 0.08 0.9 0.9 0.14 Cumulative Probability Cumulative Probability 0.07 0.8 0.8 0.12 0.7 0.7 0.06 Frequency Frequency 0.6 0.10 0.6 0.05 0.5 0.08 0.5 0.04 0.4 0.06 0.4 0.03 0.3 0.3 0.02 0.04 0.2 0.2 0.01 0.1 0.02 0.1 6/21 7/3 7/15 6/21 7/2 7/15 Completion Date Completion Date Uniform Distribution Triangular Distribution Uniform Triangular © 2007 Hulett & Associates, LLC. 4
  • 5. Probability Distributions Available (continued) Date: 7/10/2002 3:19:37 PM Date: 7/10/2002 3:20:30 PM Samples: 3000 Samples: 3000 Unique ID: 3 Unique ID: 3 Name: Design Unit Name: Design Unit 0.20 1.0 0.22 1.0 0.18 0.9 0.20 0.9 Cumulative Probability Cumulative Probability 0.16 0.8 0.17 0.8 0.14 0.7 0.7 Frequency Frequency 0.15 0.12 0.6 0.6 0.13 0.10 0.5 0.5 0.10 0.08 0.4 0.4 0.3 0.08 0.3 0.06 0.04 0.2 0.05 0.2 0.02 0.1 0.03 0.1 6/21 7/3 7/15 6/21 7/1 7/13 Completion Date Completion Date Normal Distribution Beta Distribution Normal BETA © 2007 Hulett & Associates, LLC. 5
  • 6. Comparison of Four Distributions • The three distributions have different characteristics – The uniform expresses most risk (mean, Standard deviation) – Triangular is fairly conservative – The Beta is the least risky Comparison of Probability Distributions (20d, 30d, 45d) Mean Standard Deviation Uniform 33d 7.2d Triangular 32d 5.1d Normal 33d 4.1d Beta 31d 3.4d © 2007 Hulett & Associates, LLC. 6
  • 7. Risk Along a Contiguous Schedule Path • Path risk is the combination of the risks of its activities Design Build Test Start Finish Unit Unit Unit © 2007 Hulett & Associates, LLC. 7
  • 8. Really Simple Schedule • This schedule finishes on September 3 – 7-day weeks, like a model changeover, refinery turnaround ID Task Name Duration Start Finish May June July August Septembe 1 Project 95 d 6/1 9/3 2 Start 0d 6/1 6/1 6/1 3 Design Unit 30 d 6/1 6/30 6/1 6/30 4 Build Unit 40 d 7/1 8/9 7/1 8/9 5 Test Unit 25 d 8/10 9/3 8/10 9/3 6 Finish 0d 9/3 9/3 9/3 • If we can get into trouble with this simple schedule, we can get into trouble with real project schedules © 2007 Hulett & Associates, LLC. 8
  • 9. Add Duration Risk to the Schedule using Triangular Distributions ID Task Name Rept ID Min Rdur ML Rdur Max Rdur Curve 1 Project 2 0d 0d 0d 0 2 Start 0 0d 0d 0d 0 3 Design Unit 0 20 d 30 d 45 d 2 4 Build Unit 0 35 d 40 d 50 d 2 5 Test Unit 0 20 d 25 d 50 d 2 6 Finish 0 0d 0d 0d 0 © 2007 Hulett & Associates, LLC. 9
  • 10. What is a Simulation? • How do you find total project results? – Cannot add distributions – Must combine distributions • Combining distributions using simulation – Almost all possible combinations of durations – “Perform” the project many times © 2007 Hulett & Associates, LLC. 10
  • 11. Combine Distributions by Simulation • Monte Carlo simulation – Very General – 50-year old method • Computer “performs” project many times – Exercise is a “simulation” – Each calculation is an “iteration” • Brute force solution – All combinations of possible costs or durations © 2007 Hulett & Associates, LLC. 11
  • 12. Monte Carlo Simulation Results for Really Simple Schedule CPM date is not even the most likely – That’s about 9/10 Date: 2/18/2006 3:56:56 P M Com pletion S td Deviation: 8.75 d S am ples : 3000 95% Confidenc e Interval: 0.31 d Unique ID: 2 E ac h bar repres ents 3 d Nam e: P rojec t 0.14 1.0 Com pletion P robability Table 0.9 Cumulative Probability 0.12 P rob Date P rob Date 0.8 0.05 8/31 0.55 9/14 0.10 0.7 0.10 9/2 0.60 9/16 Frequency 0.6 0.15 9/4 0.65 9/17 0.08 0.5 0.20 9/6 0.70 9/18 0.06 0.4 0.25 9/7 0.75 9/19 0.3 0.30 9/8 0.80 9/21 0.04 0.35 9/10 0.85 9/23 0.2 0.02 0.40 9/11 0.90 9/25 0.1 0.45 9/12 0.95 9/29 8/21 9/13 10/10 0.50 9/13 1.00 10/10 C o mp le tio n D a te 80% Target is CPM date is&<15% Likely to be met © 2007 Hulett Associates, LLC. 9/21 12
  • 13. Risk at Merge Points: The “Merge Bias” • Many parallel paths merge in a real schedule • Finish driven by the latest converging path • Merge Bias has been understood for 40 years Design Unit 1 Build Unit 1 Test Unit 1 Start Finish Design Unit 2 Build Unit 2 Test Unit 2 © 2007 Hulett & Associates, LLC. 13
  • 14. This Schedule has Three Parallel Paths ID Task Name Rept ID Min Rdur ML Rdur Max Rdur Curve May June July August Septemb 1 Project 2 0d 0d 0d 0 2 Start 0 0d 0d 0d 0 6/1 3 Unit 1 1 0d 0d 0d 0 4 Design Unit 0 20 d 30 d 45 d 2 6/1 6/30 5 Build Unit 1 0 35 d 40 d 50 d 2 7/1 8/9 6 Test Unit 1 0 20 d 25 d 50 d 2 8/10 9/3 7 Unit 2 1 0d 0d 0d 0 11 Unit 3 1 0d 0d 0d 0 15 Finish 0 0d 0d 0d 0 9/3 Two paths are collapsed Each path has exactly the same structure © 2007 Hulett & Associates, LLC. 14
  • 15. Evidence of the Merge Bias Date: 2/18/2006 4:04:12 PM Date: 2/18/2006 3:56:56 PM Samples: 3000 Samples: 3000 Unique ID: 2 Unique ID: 2 Name: Project Name: Project 0.16 1.0 0.14 1.0 0.9 0.9 0.14 Cumulative Probability Cumulative Probability 0.12 0.8 0.8 0.12 0.7 0.10 0.7 Frequency Frequency 0.10 0.6 0.6 0.08 0.08 0.5 0.5 0.4 0.06 0.4 0.06 0.3 0.04 0.3 0.04 0.2 0.2 0.02 0.02 0.1 0.1 8/31 9/21 10/14 8/21 9/13 10/10 Completion Date Completion Date Three Path Project One Path Project © 2007 Hulett & Associates, LLC. 15
  • 16. Evidence of Merge Bias (continued) C o m p le t io n S t d D e via t io n : 6 . 9 5 d C o m p le t io n S t d D e via t io n : 8 . 9 3 d 9 5 % C o n fid e n c e In t e rva l: 0 . 2 5 d 9 5 % C o n fid e n c e In t e rva l: 0 . 3 2 d E a c h b a r re p re s e n t s 3 d E a c h b a r re p re s e n t s 3 d C o m p le t io n P ro b a b ilit y Ta b le C o m p le t io n P ro b a b ilit y Ta b le P ro b D ate P ro b Date P ro b D ate P ro b D ate 0.05 9/10 0.55 9/22 0.05 8/31 0.55 9/14 0.10 9/13 0.60 9/23 0.10 9/3 0.60 9/15 0.15 9/14 0.65 9/24 0.15 9/4 0.65 9/17 0.20 9/15 0.70 9/25 0.20 9/6 0.70 9/18 0.25 9/16 0.75 9/26 0.25 9/7 0.75 9/20 0.30 9/17 0.80 9/27 0.30 9/8 0.80 9/21 0.35 9/18 0.85 9/29 0.35 9/9 0.85 9/23 0.40 9/19 0.90 10/1 0.40 9/11 0.90 9/25 0.45 9/20 0.95 10/3 0.45 9/12 0.95 9/29 0.50 9/21 1.00 10/14 0.50 9/13 1.00 10/15 Three Path Schedule One Path Schedule © 2007 Hulett & Associates, LLC. 16
  • 17. Graphical Evidence of the Merge Bias The "Merge Bias" 100% 90% 80% 70% One 60% Path b. Cum.Pro Three 50% Path 40% Merge Bias 30% 20% 10% 0% 8/11 8/21 8/31 9/10 9/20 9/30 10/10 10/20 Date © 2007 Hulett & Associates, LLC. 17
  • 18. Cost and Schedule Risk Integration Risk Project Schedule Cost Risk Risk “Burn Rate” Time Independent Time Costs Time Dependent Project Costs Cost Risk © 2007 Hulett & Associates, LLC. 18
  • 19. Cost Estimating Basics • Cost estimates can be constructed by multiplying: – Workers assigned – Daily rate – Duration of task • Uncertainty in any of these variables leads to uncertainty in project cost estimates • Cost risk estimating can be more accurate and the reasons for risk better illuminated when time and cost factors are addressed individually rather than as one cost uncertainty distribution © 2007 Hulett & Associates, LLC. 19
  • 20. Cost / Schedule Risk Using a Schedule • Simple schedule • Starts June 1, finishes without risk on September 6 ID Task Name Duration Start Finish May June July August SeptembO 0 Integrated Cost-Sched 98 d 6/1 9/6 1 Start 0d 6/1 6/1 6/1 2 Design 28 d 6/1 6/28 6/1 6/28 3 Build 45 d 6/29 8/12 6/29 8/12 4 Test 25 d 8/13 9/6 8/13 9/6 5 Finish 0d 9/6 9/6 9/6 © 2007 Hulett & Associates, LLC. 20
  • 21. Add Resources to the Simple Schedule • Designers, builders and testers are assigned and cost data are specified ID Task Name Duration Start Finish Resource Names 0 Integrated Cost-Schedule 98 d 6/1 9/6 1 Start 0d 6/1 6/1 2 Design 28 d 6/1 6/28 Designers[5] 3 Build 45 d 6/29 8/12 Builders[10] 4 Test 25 d 8/13 9/6 Testers[8] 5 Finish 0d 9/6 9/6 Resource Name Type of Resource Rate Designers Work $90/hr Builders Work $80/hr Testers Work $105/hr © 2007 Hulett & Associates, LLC. 21
  • 22. Computing Schedule Risk when Time and Resources are in MS Project • Using Risk+, simulate the MS Project schedule, collecting cost results for the project • Inputs – 3-point estimates for duration of tasks • Outputs – Pairs of cost and date for each iteration • Note: the cost of each resource per time period is fixed in this method © 2007 Hulett & Associates, LLC. 22
  • 23. Inputs to Schedule Risk Analysis ID Task Name Rept Min Rd ML Rdu Max Rd Curve 0 Integrated Cost- 2 0d 0d 0d 0 1 Start 0 0d 0d 0d 0 2 Design 0 20 d 28 d 40 d 2 3 Build 0 35 d 45 d 60 d 2 4 Test 0 15 d 25 d 40 d 2 5 Finish 0 0d 0d 0d 0 © 2007 Hulett & Associates, LLC. 23
  • 24. Schedule Risk Analysis: Dates Date: 2/18/2006 9:49:40 AM Completion Std Deviation: 8.25 d Samples: 3000 95% Confidence Interval: 0.29 d Unique ID: 0 Each bar represents 3 d Name: Integrated Cost-Schedule 0.14 1.0 Completion Probability Table 0.9 Cumulative Probability 0.12 Prob Date Prob Date 0.8 0.05 8/29 0.55 9/12 0.10 0.7 0.10 8/31 0.60 9/13 Frequency 0.6 0.15 9/2 0.65 9/14 0.08 0.5 0.20 9/4 0.70 9/16 0.06 0.4 0.25 9/5 0.75 9/17 0.3 0.30 9/7 0.80 9/18 0.04 0.35 9/8 0.85 9/20 Source: 0.2 0.40 9/9 0.90 9/22 0.02 Risk+® 0.1 0.45 9/10 0.95 9/25 8/17 9/11 10/7 0.50 9/11 1.00 10/7 Completion Date Sept. 6 is 25 – 30% likely. 80th percentile is Sept. 20 for a 2-week contingency © 2007 Hulett & Associates, LLC. 24
  • 25. All Resource Types are “Work” • Each resource is assumed to work on a daily basis – Baseline cost is $556,800 – Each extra day of work is extra cost, dollar for dollar • Cost risk is determined by uncertain durations only ID Task Name Duration Total Cost 0 Integrated Cost-Schedule 98 d $556,800 1 Start 0d $0 2 Design 28 d $100,800 3 Build 45 d $288,000 4 Test 25 d $168,000 5 Finish 0d $0 © 2007 Hulett & Associates, LLC. 25
  • 26. All Resource Types are “Work” (2) Date: 2/18/2006 9:49:40 AM Cost Standard Deviation: $49,645 Samples: 3000 95% Confidence Interval: $1,777 Unique ID: 0 Each bar represents $25,000 Name: Integrated Cost-Schedule 0.20 1.0 Cost Probability Table 0.18 0.9 Cumulative Probability Prob Cost Prob Cost 0.16 0.8 0.05 $503,329 0.55 $589,111 0.14 0.7 0.10 $519,541 0.60 $595,793 Frequency 0.12 0.6 0.15 $530,895 0.65 $602,967 0.10 0.5 0.20 $539,706 0.70 $610,397 0.08 0.4 0.25 $547,195 0.75 $617,877 0.06 0.3 0.30 $555,041 0.80 $626,705 0.35 $562,138 0.85 $636,646 0.04 0.2 0.40 $569,210 0.90 $649,900 0.02 0.1 0.45 $575,955 0.95 $667,044 $432,397 $583,479 $736,369 0.50 $583,082 1.00 $736,369 Cost Cost risk results differ because activity duration risks differ © 2007 Hulett & Associates, LLC. 26
  • 27. With Work-Type Resources, Cost and Time are Highly Correlated Scatter Plot of Time and Cost for Work-Type Resources 800,000 700,000 600,000 500,000 Cost 400,000 300,000 200,000 100,000 0 8/11 8/21 8/31 9/10 9/20 9/30 10/10 Date © 2007 Hulett & Associates, LLC. 27
  • 28. Uncertainty in the “Burn Rate” • Usually resources are found in a spreadsheet • This enables us to deal with uncertain burn rates • Cost estimates are often at a less detailed level than the schedule • We also will often need schedule risk analysis for a summary task © 2007 Hulett & Associates, LLC. 28
  • 29. Cost Estimates are in a Spreadsheet / Schedules are in Scheduling Package • Process when schedule is in MS Project and costs are in MS Excel • Use schedule risk results from Risk+ for Project and Crystal Ball for Excel – Simulate MS Project with Risk+ for duration, not dates – Read the detailed iteration results into a spreadsheet – Estimate the Crystal Ball function that fits the best – Use that function in the cost estimate to represent uncertain duration in Crystal Ball simulation of cost risk © 2007 Hulett & Associates, LLC. 29
  • 30. The Cost Estimate may be at a Higher Level than the Schedule Summary Cost Estimate Cost Element Value Average Workers 8 Hourly Rate 88 Hours/Day 8 Days 98 Total Cost 556,800 © 2007 Hulett & Associates, LLC. 30
  • 31. Determine the Best Crystal Ball Distribution for the Uncertain Schedule Risk Duration: Beta Source: Crystal Ball® © 2007 Hulett & Associates, LLC. 31
  • 32. Distribution Parameters © 2007 Hulett & Associates, LLC. 32
  • 33. Insert Uncertain Burn Rate into Cost Model Summary Cost Estimate Cost Element Value Minimum Most Likely Maximum Average Workers 8 6 8 12 Hourly Rate 88 84 88 100 Hours/Day 8 Days 98 Fitted Beta Distribution Total Cost 556,800 © 2007 Hulett & Associates, LLC. 33
  • 34. Adding Uncertainty in Burn Rate Uncertain Duration, Workers and Rate per Hour 1,200,000 1,000,000 800,000 Cost 600,000 400,000 200,000 More Scatter, Less Tightly Correlated due 0 8/11 8/21 8/31 9/10 9/20 9/30 10/10 to Uncertain Burn Rate Date © 2007 Hulett & Associates, LLC. 34
  • 35. Consider More Realism: Time-Independent Resources • Some resources’ costs are not determined by time – E.g., test equipment, materials • These are “use-type” or “material-type” resources • Their costs may not be known with certainty but they are not determined by activity durations © 2007 Hulett & Associates, LLC. 35
  • 36. Add Test Equipment @ $200,000 Time and Material Resources Resource Type Hourly Rate Rate per Use Designers Work $90/hr N/A Builders Work $80/hr N/A Testers Work $105/hr N/A Test Equipment Material N/A $200,000 ID Task Name Duration Start Finish Cost Resource Names 0 Integrated Cost-Schedule 98 d 6/1 9/6 $756,800 1 Start 0d 6/1 6/1 $0 2 Design 28 d 6/1 6/28 $100,800 Designers[5] 3 Build 45 d 6/29 8/12 $288,000 Builders[10] 4 Test 25 d 8/13 9/6 $368,000 Testers[8],Test Equipme 5 Finish 0d 9/6 9/6 $0 © 2007 Hulett & Associates, LLC. 36
  • 37. Add Risky Materials Cost Independent of Time Summary Cost Estimate Cost Element Value Minimum Most Likely Maximum Average Workers 8 6 8 12 Hourly Rate 88 84 88 100 Hours/Day 8 Days 98 Beta Distribution Time-Related Cost 556,800 Test Equipment 200,000 160,000 200,000 280,000 Total Cost 756,800 © 2007 Hulett & Associates, LLC. 37
  • 38. Adding Materials with Time-Independent Risk Adding Time-Independent Equipment Cost Risk 1,400,000 1,200,000 1,000,000 800,000 Cost Series1 600,000 400,000 More Scatter, 200,000 tightly Less Correlated due to0 Uncertain Burn Rate and 8/21 8/11 8/31 9/10 9/20 9/30 10/10 Date Risky Time-Independent Material Cost © 2007 Hulett & Associates, LLC. 38
  • 39. Computing Schedule Risk when Cost and Schedule are in the Scheduling Program • Resources are identified and their hourly or daily cost are input into the scheduling software • Resources are assigned to tasks and costs of those tasks and the total project are computed • Uncertainty can be added by: – Probability distribution of the duration – Probability distribution of the burn rate – Use or material resources can also be risky and their costs varied • Jointly simulate the cost and schedule in the program © 2007 Hulett & Associates, LLC. 39
  • 40. Hardware / Software Build and Integrate Build the Schedule in Primavera Project Planner (P3) © 2007 Hulett & Associates, LLC. 40
  • 41. Modern Approach to Integrated C/S Risk: Import P3 Schedule to Pertmaster © 2007 Hulett & Associates, LLC. 41
  • 42. Pertmaster Risk from P3 Schedules Duration Risk Range © 2007 Hulett & Associates, LLC. 42
  • 43. Pertmaster Risk from P3 Schedules (2) Time-Independent Risk Range Burn Rate Risk Range © 2007 Hulett & Associates, LLC. 43
  • 44. Integrated Cost and Schedule Risk Results Overrun both Cost and Schedule Date and Cost Scatter plot from Pertmaster® schedule risk software © 2007 Hulett & Associates, LLC. 44
  • 45. Summary of Main Principles • Schedule Risk depends on the schedule logic and uncertainty in the activity durations • Monte Carlo simulation is the accepted method of estimating the uncertainty from all risks simultaneously • Simulation software allows Monte Carlo for schedules in several packages (e.g. Project, P3) © 2007 Hulett & Associates, LLC. 45
  • 46. Summary of Main Principles (2) • Cost risk depends in large part on elements of schedule uncertainty – The cost estimate is not secure if the schedule is slipping • Uncertain burn rates for time-dependent costs • Uncertain costs for time-independent costs © 2007 Hulett & Associates, LLC. 46
  • 47. Integrated Cost / Schedule Risk Analysis A presentation to the PM Challenge February 6-7, 2007 Moody Gardens, Galveston, TX David T. Hulett, Ph.D. Hulett & Associates, LLC Los Angeles, CA (310) 476-7699 / info@projectrisk.com www.projectrisk.com © 2007 Hulett & Associates, LLC. 47