1. Capability Maturity Model® (CMM®) Integrationsm
Appraisals Methods
วรวุฒ ิ รามจันทร์
เทคโนโลยีสารสนเทศและการจัดการ

2. AGENDAS
 SCAMPI คื ออะไร?
 ใครเป็ นใครในกระบวนการ SCAMPI
 ขอบเขตและแผนงาน
 การสั มภาษณ์
 การชี แจงและตอบคําถาม
 Q&A
2

3. “The Standard CMMI Appraisal Method for
Process Improvement (SCAMPI) is an
invaluable tool for organizations seeking to
drive quantifiable improvements in systems and
software engineering. ”
CMMI SCAMPI Distilled: Appraisals for
Process Improvement
By
Dennis M. Ahern
Jim Armstrong
Aaron Clouse
Jack Ferguson
Will Hayes
Kenneth Nidiffer
3

4. Definitions
 Appraisal
 An examination of one or more processes by a
trained team of professionals using a model as a
basis for determining strengths and weaknesses
 SCAMPI
 Standard CMMI® Appraisal Method for Process
Improvement
4

5. Appraisal Principles
 Start with a Process Reference Model
 Use a Defined Appraisal Method
 Involve Senior Management as Appraisal
Sponsors
 Observe Non-Attribution
 Approach the Appraisal Collaboratively
 Focus on Action
5

6. Basic Appraisal Precepts
 Non-Attribution
 Nothing seen or heard during an appraisal will be
attributed to a person or project
 Confidentiality
 All artifacts provided to the team during the appraisal will
either be returned to the appraised organization,
destroyed, or deleted
Appraisal findings are the property of the appraisal
sponsor(s) and will not be divulged or used outside the
context of the appraisal without the specific permission of
the sponsor(s)
6

7. Appraisal Method Classes
7

8. CMMI® -DEV v1.2
8

9. Continuous Representation
•Organizational Process •Project Planning •Requirements Mgmt. •Configuration Mgmt.
Focus •Project Monitoring and •Requirements Dept. •Process and Product
•Organizational Process Control •Technical Solution Quality Assurance
Definition •Supplier Agreement Mgmt. •Product Integration • Measurement &
•Organizational Training •Integrated Project Mgmt. •Verification Analysis
•Organizational Process •Risk Management •Validation •Decision Analysis and
Performance •Quantitative Project Mgmt. Resolution
•Organizational Innovation • Causal Analysis and
and Deployment Resolution
9

10. Reasons for Appraisals
 Generating Maturity Level or Capability Level
Ratings (A)
Status of Process Implementation (B)
 Evaluation for Award or Incentive Fee (B)
 Internal Snapshot, Mini-Appraisal (B/C)
 Education, Gap Analysis (B/C)
 Contract Monitoring (B/C)
Planning an Improvement Strategy (C)
10

11. Resource Requirements - 1
 Certified Lead Appraiser or Team Leader
 Qualified Team Members
 Training Requirements
• Introduction to CMMI®
• SCAMPI Team Training
 Team Knowledge/Experience Requirements
• 5 Yrs Engineering, 3 Yrs Management
• Domain Knowledge is necessary and At Least Half of the
team should have appraisal experience
 Logistic Support at the Appraisal Site
11

12. Resource Requirements - 2
 Travel
 Resource Requirements depend on:
 Mode of Evidence Review (Discovery or Verification)
 Scope
 Other Sponsor Information Requirements
Scope Determines:
 Team Size and Composition
 Time Required
12

13. Typical Appraisal Activities
 Planning and Preparation
 Appraisal Input and Plan
 Team Selection and Training
 Readiness Review
 Conduct Appraisal
 Document Review
 Interviews
 Collation of Findings
Preliminary Findings Presentation
 Report Results
 Final Findings Presentation
 Executive Level Outbrief
Appraisal Disclosure Statement
13

14. Generic SCAMPI C Timeline
14

15. Preliminary Steps
With the Appraisal Sponsor:
 Review and discuss program work requirements
in terms of processes
 Decide which Process Areas are most critical to
the success of the program and should be appraised
 Other important Program Information Needs
15

16. What is Scope?
 Scope is
 The Number of Process Areas to be Appraised and
 Other important Program Information Needs
 Scope should include
 Process Areas most critical to the success of the program
 Whatever else the sponsor wants, e.g.,
• Strengths and Weaknesses
• Observations
• Recommendations for Implementation
• Process Improvement Plan
 Scope Determines:
 Appraisal Team Size and Composition
 Time Required
16

17. Scope: “You Must Decide”
 Business and Technical Objectives
 Program Risks
 Where Failure Is Unacceptable
 What Is Negotiable/Not-Negotiable
 Dependencies and Constraints
 Historical Information
 Other Program Information Needs
17

18. SCAMPI Process Flow - Plan & Prepare
Plan for Obtain/analyze initial
appraisal objective evidence (OE)
scope, appraisal plan 1 questionnaires, mapping, documents,
2 PII (mapping) database,
Prepare appraisal team
Prepare to collect OE
& participants
trained team, participants readiness review, data collection plan
oriented
Conduct appraisal
1 Questionnaires - optional
2 PII = practice implementation indicator
18

19. SCAMPI Process Flow - Conduct
Examine OE Validate practice
implementation gaps
Questionnaire results, PII database,
documents, interviews Prelim. findings, findings feedback
Verify OE Document OE
Direct & indirect artifacts, affirmations, gap Recorded/updated appraisal data (e.g.,
observations, strengths tagged notes, PII database, gaps)
Characterize Generate assessment
implementation of results
practices Final findings, ratings
Instantiation-level & organizational unit
-level characterizations
Report results
Note: Verify & validate data is an iterative process
19

20. SCAMPI Process Flow - Report Results
Conduct appraisal
Deliver appraisal
results
Findings presentation, * final report
Package & archive
appraisal results
Lessons learned, appraisal record (sponsor),
appraisal report/feedback (SEI)
* Final report is optional
20

21. Role of Interviews
 Draw on existing expertise and knowledge of
resident management, engineering, and support
professionals
 Supplement knowledge gained from review of
organizational and project documents
 Start the thinking process about what it would
really take to further improve the organization's
development capabilities
 Obtain buy-in of discussion participants in
assessment outcome
21

22. Types of Interviews
 Project Leader interviews
 If multiple projects are being appraised in an
organization, one session for each project
 Functional area interviews
 Management group or groups
 Engineering group or groups
 Support group or groups
 Process group or groups
 Organizational Roles
 Senior/Middle Managers
 Project Leaders
 Practitioners
22

23. Format of Interviews
 Who will be there?
 For some interviews, the entire team will be present; for
others, a team sub-set will be present
 Follow-up interviews may be with a team sub-set
 What to bring with you?
 You may bring a few items that are particularly helpful in
your daily work, or that typify what you produce
 What kind of questions will be asked?
 There may be some broad, general questions; however,
interview questions will generally be narrowly focused and
rather detailed
23

24. About Interviews
 It is OK to say
 I don’t know.
 We are not at that stage yet
 The only bad answer is a
disingenuous answer
24

25. Characterizing Practice Implementation
• Assign characterization values reflecting the extent of practice
implementation for each instance
– For practices implemented by projects, an
instance = each project
– For practices implemented organization-wide,
the instance
• Aggregate practice characterizations to organizational unit
(OU) level using defined method aggregation rules
25

26. Rules for Characterizing Practice Implementation –
Instantiation Level
Label Meaning
Fully Implemented (FI) Direct artifacts present & appropriate
• Supported by indirect artifact &/or
affirmation
• No weaknesses noted
Largely Implemented • Direct artifacts present & appropriate
(LI) • Supported by indirect artifact &/or
affirmation
• One or more weaknesses noted
Partially Implemented Direct artifacts absent or judged inadequate
(PI) • Artifacts or affirmations indicate some
aspects of the practice are implemented
• One or more weaknesses noted
Not implemented (NI) Any situation not covered by above
26

27. Rules for Aggregating Practice Implementation - *OU Level
Condition Outcome Remarks
All X (e.g., all LI) X All instantiations have the same
characterization.
All (LI or FI) LI All instantiations are characterized LI
or higher.
Any PI, No NI LI or PI Team judgment is applied to choose LI
or PI for the OU.
Any NI NI, PI, or Team judgment is applied to choose
LI NI, PI, or LI for the OU.
* OU = organizational unit
27

28. 28

29. Rules
 Short answers
 Trade answer sheets and grade your
neighbor
 Top 4 go to the tie-breaker rounds
 Top 2 go to the final tie-breaker
29

30. Ready?
30

31. Questions
1. Name the seven Level 2 Process areas in the
Staged Presentation of CMMI® (1 pt per correct
answer)
2. How does any organization get a Maturity Level 3
Rating? (2 points)
3. What are the 3 phases of a SCAMPI Appraisal?
4. Name the 3 hard prerequisites for being a
SCAMPI Appraisal Team Member
31

32. Answers
1. REQM, PP, PMC, CM, SAM, MA, and PPQA (1 pt per
correct answer)
2. Successfully pass a SCAMPI Class A Appraisal (1)
3. Plan and Prepare, Execute, Report Findings (1 pt/correct
answer)
4. Intro to CMMI Course, 5 years of Engineering Experience
and 3 years of Management Experience (2 pts/correct
answer)
Perfect Score = 20
32

33. Tie Breakers Round 1
1. What three things comprise the scope of
an appraisal
2. What is the sunset date for CMMI® v1.2?
33

34. Tie-Breaker Answers
First question:
 The projects or instantiations to be
appraised
 The process areas to be appraised and
to what level
 Additional products requested by the
sponsor
34

35. CMMI ML3 Certified Company
35

36. Q&A
36

37. THE END
 นักศึกษาสามารถดาวน์โหลด เอกสารประกอบการเรี ยน ได้ ที
http://www.rabbitthailand.com
37

38. Q&A
38