SlideShare uma empresa Scribd logo
1 de 92
Teaching Six Sigma Using Six Sigma a
DMAIC Approach
Brandon Theiss
Brandon.Theiss@gmail.com
2013 QMOD Conference
About Me
• Academics
– MS Industrial Engineering Rutgers University
– BS Electrical & Computer Engineering Rutgers University
– BA Physics Rutgers University
• Awards
– ASQ Top 40 Leader in Quality Under 40
– ASQ National Education Quality Excellence Award Finalist
– IIE Early Career Achievement Award Winner 2013
• Professional
– Principal Industrial Engineer -Medrtonic
– Master Black belt- American Standard Brands
– Systems Engineer- Johnson Scale Co
• Licenses
– Licensed Engineer – State of Vermont
– Registered to Practice before the US Patent and Trademark Office
• Certifications
– ASQ Certified Manager of Quality/ Org Excellence Cert # 13788
– ASQ Certified Quality Auditor Cert # 41232
– ASQ Certified Quality Engineer Cert # 56176
– ASQ Certified Reliability Engineer Cert #7203
– ASQ Certified Six Sigma Green Belt Cert # 3962
– ASQ Certified Six Sigma Black Belt Cert # 9641
– ASQ Certified Software Quality Engineer Cert # 4941
• Publications
– Going with the Flow- The importance of collecting data without holding up your processes- Quality Progress March
2011
– "Numbers Are Not Enough: Improved Manufacturing Comes From Using Quality Data the Right Way" (cover story).
Industrial Engineering Magazine- Journal of the Institute of Industrial Engineers September (2011): 28-33. Print
Learning Objectives
• Apply Six Sigma to the Teaching of Six Sigma
• Create Practitioner Academic Partnerships
• Uniquely Apply SPC Charts
• Use Statistical Hypothesis testing to improve
learning outcomes
Motivation
• Teaching the tools, techniques and Methods of Lean Six
Sigma is inherently difficult in academic setting.
• When taught in a industrial setting students have a
common motivation (the improved welfare of the
company), similar levels of education and knowledge of
domain specific information. Students are encouraged to
learn by applying the material to their daily activities.
• This is not possible in an academic setting particularly in a
mixed environment that includes everything from
undergraduate juniors through senior PhD researchers.
• In addition undergraduate students tend either lack
professional or have experience in Fields that are not
traditionally thought of as benefiting or implementing Six
Sigma (waitressing, check out clerk etc.)
5
Putting some numbers to the motivation
• Lean Six Sigma is a commonly adopted business
improvement technique which integrates, the scientific method,
statistics and defect reduction to obtain tangible results.
•Within 50 miles of Rutgers there are 2,249 active job listings
for the phrase “six sigma green belt”
•Non University Affiliated Classes are available however are
prohibitively expensive for most students ~$2,000.
•ASQ de facto industry standard for Greenbelt Certification
•Current Industrial Engineering Undergraduate and Graduate
programs do not prepare students to effectively implement the
Six Sigma toolkit.
•Salary Report indicates Certified Green belts earn $12,000
more per year
Class Demographics
• 71 Students Registered
– 57 At Student Tuition Rate ($296)
– 14 At Professional Tuition Rate ($495)
0.0%
5.0%
10.0%
15.0%
20.0%
25.0%
30.0%
35.0%
40.0%
Junior Year Senior
Year
BA/BS Some
Grdudate
MA/MS/JD PhD/PE
Highest Accademic Grade
Completed
24222018161412108642
20
15
10
5
0
Years Of Work Exprience
Frequency
3
Histogram of Years Of Work Exprience
Solution
• The beauty of the Six Sigma Methodology is that it can be applied
to any process.
• The definition of a process is quite broad and can be reduced to any
verb- noun combination.
• Therefore the collective process which the class studied and
improved was to
Pass [the]
ASQ
Certified Six Sigma Green
Belt Exam
• Therefore the foundational Six Sigma Concept of DMAIC (Define
Measure Analyze Improve Control) represents both the material
covered in the course as well as the pedagogical method used for
instruction
Theoretical Pedagogical Support
• Knowles' Theory of Andragogy is based upon six fundamental assumptions
related to motivation in adult learning:
– Adults become aware of their "need to know" and make a case for the value of
learning.(Need to Know)
• the students in the class have self selected to enroll in the course, which was
marketed solely to prepare students to pass the certification exam.
– Adults approach learning with different experiences furthermore the richest resource
for learning resides in adults themselves (Foundation).
• for each topic introduced there is a tactical application applying the tool or
technique to the process of preparing for the ASQ CSSGB exam.
– Adults need to be responsible for their decisions on education; They need to be seen
and treated as capable and self-directed. (Self-concept).
• no formal grades are given in the course and no homework is assigned. Students
are responsible for gauging what additional preparation was required in addition to
the 3-hour weekly course
Theoretical Pedagogical Support
(continued)
– Adults are most interested in learning subjects having immediate relevance to cope
effectively with the present real-life situations (Readiness).
• the course culminated in students taking the actual ASQ CSSGB exam, thus for the
11 weeks of the course students were constantly driving towards a relevant and
timely goal
– Adult learning is problem-centered rather than content-oriented they want to learn
what will help them perform tasks or deal with problems they confront in everyday
situations and those presented in the context of application to real-life (Orientation).
• each activity throughout the course is driven at solving a problem with only a mild
suggestion of which tool to use.
– Adults respond better to internal versus external motivators (Motivation).
• the motivation for the students to take the course was entirely self originating.
About the Course & Partnership
• Offered as a Non-Credit extracurricular course
at Rutgers University in Piscataway NJ
• Co-Sponsored by the Rutgers Student Chapter
of the Institute for Industrial Engineers (IIE) and
the Princeton NJ section of American Society for
Quality (ASQ)
• Open and advertised to all members of the
Rutgers Community (students, staff and faculty)
as well as the surrounding public
• Objective of the course was to train students to
pass the June 2nd 2012 administration of the
ASQ Certified Six Sigma Green Belt Exam
Course Syllabus
1. Introduction, Sample Exam
2. Review Exam, Define 1
3. Define 2, Measure 1
4. Measure 2, Measure 3
5. Measure 4, Sample 50 Question
Exam
6. Review Exam, Analyze 1
7. Analyze 2, Analyze 3
8. Improve 1, Sample 50 Question Exam
9. Review Exam, Control 1
10. Sample 100 Question Exam
11. Review Exam, Additional Questions
Define Measure Analyze Improve Control
• Project Definition
• Team Dynamics
• Brainstorming
• Process Mapping
• Measurement
Systems
• Histograms
• Box Plots
• Dot Plots
• Probability
Plots
• Control Charts
• Inferential
Statistics
• Confidence
Intervals
• Hypothesis
Tests
• Regression
Analysis
• Pareto Charts
• Process
Capability
• Lean
Pre Test
• On the first night of classes students were
given an introductory survey of Six Sigma
by means of a worked example applying
DMAIC to the Starbucks Experience from a
Customers Prospective.
• Students were then given a copy of the
Certified Six Sigma Green Belt Handbook by
Roderick A. Munro
• Then given a 50 Question Multiple Choice
Test representative of the ASQ CSSGB Exam
• The Test was administered on two
successive nights (Monday and Tuesday)
Measurement System
• An Apperson GradeMaster™ 600 Test
Scanner was utilized which enabled test to
be scored and returned immediately upon
student submission at the exam site.
• In addition all of each answer to every
question was downloaded to connected
computer enabling further detailed analysis
MONDAY RESULTS
Test Scores
84.00%72.00%60.00%48.00%36.00%
9
8
7
6
5
4
3
2
1
0
Test Scores
Frequency
Mean 0.5589
StDev 0.1177
N 35
Histogram of Test Scores
Normal
Test for Normality
1.00.90.80.70.60.50.40.30.2
99
95
90
80
70
60
50
40
30
20
10
5
1
Test Score
Percent
Mean 0.5589
StDev 0.1177
N 35
AD 0.396
P-Value 0.352
Probability Plot of Test Score
Normal - 95% CI
Is process in Control?
343128252219161310741
1.0
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
Observation
IndividualValue
_
X=0.5589
UCL=0.9468
LCL=0.1709
I Chart of Test Score
Is the Process Capable?
0.840.720.600.480.36
LSL
LSL 0.78
Target *
USL *
Sample Mean 0.558857
Sample N 35
StDev (Within) 0.120985
StDev (O v erall) 0.117718
Process Data
C p *
C PL -0.61
C PU *
C pk -0.61
Pp *
PPL -0.63
PPU *
Ppk -0.63
C pm *
O v erall C apability
Potential (Within) C apability
PPM < LSL 971428.57
PPM > USL *
PPM Total 971428.57
O bserv ed Performance
PPM < LSL 966214.72
PPM > USL *
PPM Total 966214.72
Exp. Within Performance
PPM < LSL 969849.40
PPM > USL *
PPM Total 969849.40
Exp. O v erall Performance
Within
Overall
Process Capability of Test Scores
overall standard
deviation for the
entire study
overall standard deviation for
the entire study if special
cause eliminated
based on variation
within subgroups
Are there bad questions?
464136312621161161
1.0
0.8
0.6
0.4
0.2
0.0
Sample
Proportion
_
P=0.441
UCL=0.693
LCL=0.189
1
1
1
1
1
1
11
11
P Chart of Wrong
Does the order the exams are turned in effect the
score?
3330272421181512963
0.9
0.8
0.7
0.6
0.5
0.4
0.3
Index
TestScore
MAPE 15.9381
MAD 0.0840
MSD 0.0124
Accuracy Measures
Actual
Fits
Variable
Trend Analysis Plot for Test Score
Linear Trend Model
Yt = 0.5018 + 0.00317*t
TUESDAY RESULTS
Test Scores
Test for Normality
Is the process in Control?
28252219161310741
90.00%
80.00%
70.00%
60.00%
50.00%
40.00%
30.00%
20.00%
Observation
IndividualValue
_
X=55.93%
UCL=84.62%
LCL=27.25%
1
I Chart of Scores
Is the process capable?
Are there Bad Questions?
464136312621161161
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
Sample
Proportion
_
P=0.441
UCL=0.717
LCL=0.164
1
1
1
11
1
1
1
P Chart of Incorrect
272421181512963
0.9
0.8
0.7
0.6
0.5
0.4
Index
Scores
MAPE 13.9747
MAD 0.0779
MSD 0.0100
Accuracy Measures
Actual
Fits
Variable
Trend Analysis Plot for Scores
Linear Trend Model
Yt = 0.5614 - 0.000138*t
Does the order exams are turned in
effect test scores?
COMBINED RESULTS
Combined Test Scores
0.840.720.600.480.36
20
15
10
5
0
Combined
Frequency
Mean 0.5591
StDev 0.1099
N 64
Histogram of Combined
Normal
Test Scores
0.84
0.72
0.60
0.48
0.36
9
8
7
6
5
4
3
2
1
0
84.00%
72.00%
60.00%
48.00%
36.00%
9
8
7
6
5
4
3
2
1
0
Monday
Frequency
Tuesday
Mean 0.5589
StDev 0.1177
N 35
Monday
Mean 0.5593
StDev 0.1018
N 29
Tuesday
Histogram of Monday, Tuesday
Normal
Is there a difference Between Classes?
0.9
0.8
0.7
0.6
0.5
0.4
0.3
Monday Tuesday
Boxplot of Monday, Tuesday
Is there a statistical Difference?
Anova: Single Factor
SUMMARY
Groups Count Sum Average Variance
Monday 35 19.56 0.558857 0.013857
Tuesday 29 16.22 0.55931 0.010357
ANOVA
Source of Variation SS df MS F P-value F crit
Between Groups 3.26E-06 1 3.26E-06 0.000265 0.987056 3.995887
Within Groups 0.76114 62 0.012276
Total 0.761144 63
Is the variation different?
34
464136312621161161
1.0
0.8
0.6
0.4
0.2
0.0
Sample
Proportion
_
P=0.441
UCL=0.627
LCL=0.255
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
P Chart of Wrong
What Can we See from the Out of
Control Points?
Brainstorming Techniques
• At the beginning of class students were asked as a group to
brainstorm ideas for why they failed the pre-test
– Only 4 ideas were proposed
• Students were taught the different brainstorming techniques
contained in the CSSGB Body of Knowledge
– Nominal Group Technique
– Multi-Voting
– Affinity Diagrams
– Force Field Analysis
– Tree Diagrams
– Cause and Effect Diagrams
• Students were then broken up into 6 different groups, assigned one
of the brainstorming techniques and given the task to brainstorm
why they failed the pre-test
Brainstorming Techniques Continued
• Students then presented their results to the
Group
Brainstorming Results
Cause and Effect (Fishbone)
Affinity Diagram
Brainstorming Results
Tree Diagram
Force Field Analysis
Brainstorming Results
Multi-Voting
Nominal Group Technique
Brainstorming Continued
• Students then told to return to their groups
and apply their “favorite” of the brainstorming
techniques to the task how can you Pass the
midterm exam
• Students Found the positive formulation of
the task much more challenging and most
groups stayed with the same technique they
used for the Negative version.
Team Dynamics
• The 3rd weeks lesson began with an
introduction of the Tuckman cycle of team
dynamics
• Students were asked
to reflect upon their
experience in the
brainstorming activity
to see if their
experiences paralleled
those predicted by the
model
Process Mapping
• The second portion of the 3rd Class was spent
introducing the process mapping strategies in
the CSSGB BoK
– SIPOC (Suppliers Inputs Process Outputs Customers)
– Process Mapping
– Value Stream
Mapping
Process Mapping Continued
• Students were again divided into 6 groups. Each group was assigned a map type and
told to Map the Exam Taking Process at either a Micro or Macro Level
• Micro Level Groups Handled the Physical steps of taking the exam such as reading
the question, locating the answer and filling in the bubbles
• Macro Groups Handled the all of the preparation leading up to taking the exam
• The point was to emphasize that the same tools techniques and methods can be
used on the very micro level (an operator tightening a bolt) to the very macro level
(the operations of a fortune 500 company)
44
SIPOC at a even higher level
Input
• Students
• Body of
Knowledge
• Instructor
• Textbook
• Facilities
Supplier
•ASQ Princeton
•ASQ Corporate
•Rutgers University
Output
• Knowledge
• Certification
Customers
• Future Employers
• Current Employers
• Students
• Rutgers University
• ASQ Princeton
• Rutgers IIE
Educate
Students in Six
Sigma
Process
Identify Educational
Shortcoming
Create Course
Develop
Methodology
Locate Students
Teach Students
Administer Test
Control Charts
• Class 4 Introduced Students to the Control Charts Covered in the
CSSGB BoK
– I-MR
– X Bar-R
– X Bar- S
– P
– NP
– U
– C
• Students were emailed prior to class a Microsoft Excel Workbook
containing the test results and told to bring their laptops to class
• Students were asked to do the following by hand (with Excel
helping for the calculations):
– I-MR Chart for Test Scores
– P Chart testing for “Bad Questions”
– NP Chart testing for “Bad Questions”
– C Chart for the number of wrong responses per exam
– U Chart for the number of wrong responses per exam
Control Charts Results
NP Chart
C Chart
Midterm Analysis
Midterm Exam Results
Pre Class Exam Results
Comparison
Does a T-Test Indicate there was improvement?
t-Test: Two-Sample Assuming Unequal Variances
Mid Pre
Mean 0.607234 0.561702
Variance 0.014373 0.01111
Observations 47 47
Hypothesized Mean Difference 0
df 91
t Stat 1.955429
P(T<=t) one-tail 0.0268
t Critical one-tail 1.661771
P(T<=t) two-tail 0.0536
t Critical two-tail 1.986377
Does ANOVA Indicate there was
Improvement?
Anova: Single Factor
SUMMARY
Groups Count Sum Average Variance
Pre Total 64 35.78 0.559063 0.012082
Mid Total 53 31.72 0.598491 0.013705
ANOVA
Source of Variation SS df MS F P-value F crit
Between Groups 0.045069 1 0.045069 3.516685 0.06329 3.923599
Within Groups 1.473823 115 0.012816
Total 1.518892 116
Change in Scores
Is the Change in Control?
-15
-10
-5
0
5
10
15
C Chart of Change in # of Correct Responses
UCL = 8.29
LCL = -3.74
Mid= 2.28
Is the change in Scores Significant?
t-Test: Paired Two Sample for Means
Mid Pre
Mean 0.607234043 0.561702
Variance 0.014372618 0.01111
Observations 47 47
Pearson Correlation 0.689206844
Hypothesized Mean Difference 0
df 46
t Stat 3.475995635
P(T<=t) one-tail 0.000560995
t Critical one-tail 1.678660414
P(T<=t) two-tail 0.00112199
t Critical two-tail 2.012895599
Not all Material on the Exam has been
Covered in Class
Midterm Comparison
Pre Test Comparison
Comparison of Results for Material
that has been Covered
Mid CoveredPre Covered
1.0
0.9
0.8
0.7
0.6
0.5
0.4
0.3
Subscripts
CoveredScores
Boxplot of Covered Scores
Comparison of Covered Material
0.90.80.70.60.50.40.3
12
10
8
6
4
2
0
0.90.80.70.60.50.40.3
Pre Covered
Frequency
Mid Covered
Mean 0.5785
StDev 0.1252
N 64
Pre Covered
Mean 0.6516
StDev 0.1174
N 53
Mid Covered
Histogram of Pre Covered, Mid Covered
Normal
Does ANOVA Indicate there was
improvement?
Anova: Single Factor
SUMMARY
Groups Count Sum Average Variance
Pre Covered 64 37.02632 0.578536 0.015686
Mid Covered 53 34.53333 0.651572 0.013785
ANOVA
Source of Variation SS df MS F P-value F crit
Between Groups 0.154648 1 0.154648 10.43065 0.001616 3.923599
Within Groups 1.70503 115 0.014826
Total 1.859678 116
Comparison of Results for Material
that has not been Covered
Mid Not CoveredPre Not Covered
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
Subscripts
Scores
Boxplot of Scores
Comparison of Material Not Covered
Does ANOVA indicate the Exam was
harder?
Anova: Single Factor
SUMMARY
Groups Count Sum Average Variance
Pre Not Covered 64 31.83333 0.497396 0.01785
Mid Not Covered 53 27.5 0.518868 0.024926
ANOVA
Source of Variation SS df MS F P-value F crit
Between Groups 0.013367 1 0.013367 0.635003 0.427168 3.923599
Within Groups 2.420698 115 0.02105
Total 2.434065 116
Is the Exam Taking Process Capable?
Control Charts with Minitab
• Students were emailed a Microsoft Excel Workbook with the Mid-
Term data set
• It was heavily suggested that students purchase the Minitab
academic license and bring their laptops to class.
• Students then divided themselves into groups around those who
purchased the software and created the analysis control charts on
the preceding slides.
Hypothesis Testing Exercises
• In week 8 students were introduced to the hypothesis tests covered
in CSSGB BoK
– Z Test
– Student T
– Two Sample T (known variance)
– Two Sample T (unknown variance)
– Paired T Test
– ANOVA
– Chi Squared T
– F Test
• Students were emailed a data set containing both the Pre-Test and
Mid-Term data and asked to perform each of the listed test using
either Minitab or Microsoft Excel. The emphasis was placed on the
conclusions from the data
Confidence Intervals
• Not all students took the Mid-Term that took the
pre-test.
• This enabled students to utilize inferential
statistics to draw conclusions about the
population parameters (mean and variance
particularly)
• By using the class data set provided students
were able to calculate their confidence in the
overall population parameters for the average
test score as well as the standard deviation of the
entire class
Was the Pre-Test a Predictor of the
Mid Term Scores?
Improve-Control
“Improve” and “Control” phase represent a
small fraction of the material covered on the
ASQ CSSGB exam
Within the Body of Knowledge there are the
following :
• Gantt Chart
• Activity Network Diagrams
• Critical Path Method
• Program (or Project) Evaluation and
Review Technique.
Final Exam Analysis
Exam Scores
Doesn’t Look Normal
It’s Bi-Modal!
Did the scores Improve?
Was The Difference Significant?
Anova: Single Factor
SUMMARY
Groups Count Sum Average Variance
Pre 64 35.78 0.559063 0.012082
Mid 47 28.54 0.607234 0.014373
Final 40 30.43 0.76075 0.020084
ANOVA
Source of Variation SS df MS F P-value F crit
Between Groups 1.029282 2 0.514641 34.534 4.91E-13 3.057197
Within Groups 2.205562 148 0.014902
Total 3.234844 150
Individual Improvement
Variable N N* Mean StDev Minimum Q1 Median Q3
Change 36 0 0.1939 0.1419 -0.0600 0.0675 0.2000 0.2875
Was the Individual Improvement
Significant?
t-Test: Paired Two Sample for Means
Final Pre
Mean 0.750556 0.556667
Variance 0.019743 0.010023
Observations 36 36
Pearson Correlation 0.342582
Hypothesized Mean Difference 0
df 35
t Stat 8.199954
P(T<=t) one-tail 5.8E-10
t Critical one-tail 1.689572
P(T<=t) two-tail 1.16E-09
t Critical two-tail 2.030108
Where there Hard Questions?
Pareto Chart on Topic
Count 3 3 2 2 2 1 1 1
Percent 20.0 20.0 13.3 13.3 13.3 6.7 6.7 6.7
Cum % 20.0 40.0 53.3 66.7 80.0 86.7 93.3 100.0
Question Topic
FM
EA
Control Charts
Confidence
Interval
Team
s
Process
Capablity
Error
Hypothesis
Basic
Stats
16
14
12
10
8
6
4
2
0
100
80
60
40
20
0
Count
Percent
Pareto Chart of Question Topic
Initial Process Capability
Final Process Capability
Results
• Ruba Amarin
• Margit Barot
• Miriam Bicej
• Matthew Brown
• Salem El-Nimri
• William Ewart
• Elizabeth Fuschetti
• Robert Gaglione
• Thomas Hansen
• Tarun Jada
• Javier Jaramillo
• Michael Kagan
• Anoop Krishnamurthy
• Timothy Lin
• Helen Liou
• Rebecca Marzec
• Charles Ott
• Sneha Patil
• Eugene Reshetov
• Matthew Rodis
• Thomas Schleicher
• Dante Triana
• Albert Tseng
• Bond Wann
• Paul White
• Sun Wong
• Shih Yen
• Jacob Ziegler
28 out of 37 Students that took the June 2nd Exam Passed the June 2nd Exam
Nationally 788 out of 1160 individuals passed the exam
Was the Result Significant?
Rutgers ASQ
Results
• Students test scores improved on average
19.4%
• 76% of Students Passed the exam compared
to 68% National Average
• Increased ASQ Princeton Membership by 62
members
• Largest Ever Fund Raiser for the Rutgers IIE
86
Added Benefit
• From the funds generated by the course Rutgers was
able to send 21 Students to the national IIE
Conference in Orlando (shown above)
87
It took a team
• Nate Manco
– ASQ Princeton Education Chair
• Richard Herczeg
– ASQ Princeton Section President
• Jeff Metzler
– Rutgers IIE President
• Dr. James Luxhoj
– Rutgers Industrial and Systems Eng
• Brandon Theiss
– Instructor
• Cindy Ielmini
– Rutgers Industrial and Systems Eng
Lessons Learned
• Using the passing the exam process as a class example
for the implementation of the tools and techniques of
Six Sigma is an effective methodology
• There is demand for teaching Six Sigma in an academic
setting
• The joint venture between Rutgers and ASQ is feasible
and mutually beneficial.
• Having a diverse student population increases the
overall performance of the group.
• Students need to be adequately qualified to sit for ASQ
exam prior to taking the course.
89
We are sharing the Results
• Presented results at Institute of Industrial Engineers Lean and Six Sigma
Conference
• Will be presented at the ASQ International Conference on Quality
90
Progress continues onward
• Course Scheduled to Run again in the Spring through Official Continuing
Education Office
• First of its kind joint meeting with ASQ Princeton and Rutgers IIE in
which the course results were presented.
Questions?
• Contact info
– Brandon Theiss
– Brandon.theiss@gmail.com
– Connect to me on LinkedIn
2013 QMOD Presentation

Mais conteúdo relacionado

Mais procurados

Wsu guest lecture_2015_czlv_v3
Wsu guest lecture_2015_czlv_v3Wsu guest lecture_2015_czlv_v3
Wsu guest lecture_2015_czlv_v3Catherine Zhao
 
SHEILA Results – Conference 5 June 2018
SHEILA Results – Conference 5 June 2018SHEILA Results – Conference 5 June 2018
SHEILA Results – Conference 5 June 2018LACE Project
 
Ncea and standards based education
Ncea and standards based educationNcea and standards based education
Ncea and standards based educationdhousden
 
Learning Analytics for Student Support
Learning Analytics for Student Support Learning Analytics for Student Support
Learning Analytics for Student Support EADTU
 
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Blackboard APAC
 
Value, quality and use of OER – preliminary results of an empirical study in ...
Value, quality and use of OER – preliminary results of an empirical study in ...Value, quality and use of OER – preliminary results of an empirical study in ...
Value, quality and use of OER – preliminary results of an empirical study in ...The Open Education Consortium
 
Hendrix College Faculty Technology Survey 2013
Hendrix College Faculty Technology Survey 2013Hendrix College Faculty Technology Survey 2013
Hendrix College Faculty Technology Survey 2013David J. Hinson
 
Collaborating with Teachers to Make Great Referrals: Identifying treatment me...
Collaborating with Teachers to Make Great Referrals: Identifying treatment me...Collaborating with Teachers to Make Great Referrals: Identifying treatment me...
Collaborating with Teachers to Make Great Referrals: Identifying treatment me...Bilinguistics
 
EDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online EducationEDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online EducationPaul Gruhn
 
SWPBS Technical Assistance: SWOT
SWPBS Technical Assistance:  SWOTSWPBS Technical Assistance:  SWOT
SWPBS Technical Assistance: SWOTMichael Welch
 
Triangulating TEL: What's happening; what do students want; and what do staff...
Triangulating TEL: What's happening; what do students want; and what do staff...Triangulating TEL: What's happening; what do students want; and what do staff...
Triangulating TEL: What's happening; what do students want; and what do staff...Peter Reed
 
Measuring Grit - 2013 SmarterMeasure Presentation
Measuring Grit - 2013 SmarterMeasure PresentationMeasuring Grit - 2013 SmarterMeasure Presentation
Measuring Grit - 2013 SmarterMeasure PresentationSmarterServices Owen
 
A Design Methodology for Learning Analytics Information Systems HICSS 2020 An...
A Design Methodology for Learning Analytics Information Systems HICSS 2020 An...A Design Methodology for Learning Analytics Information Systems HICSS 2020 An...
A Design Methodology for Learning Analytics Information Systems HICSS 2020 An...Andy Nguyen
 
Trends in-research-aemr-sgd-2013-slideshare
Trends in-research-aemr-sgd-2013-slideshareTrends in-research-aemr-sgd-2013-slideshare
Trends in-research-aemr-sgd-2013-slideshareSanjeev Deshmukh
 

Mais procurados (20)

Academic and administrative audit (AAA)
Academic and administrative audit (AAA)Academic and administrative audit (AAA)
Academic and administrative audit (AAA)
 
Wsu guest lecture_2015_czlv_v3
Wsu guest lecture_2015_czlv_v3Wsu guest lecture_2015_czlv_v3
Wsu guest lecture_2015_czlv_v3
 
NAAC Criterion VII
NAAC Criterion VIINAAC Criterion VII
NAAC Criterion VII
 
Simulated Learning Environments
Simulated Learning EnvironmentsSimulated Learning Environments
Simulated Learning Environments
 
SHEILA Results – Conference 5 June 2018
SHEILA Results – Conference 5 June 2018SHEILA Results – Conference 5 June 2018
SHEILA Results – Conference 5 June 2018
 
Ncea and standards based education
Ncea and standards based educationNcea and standards based education
Ncea and standards based education
 
Learning Analytics for Student Support
Learning Analytics for Student Support Learning Analytics for Student Support
Learning Analytics for Student Support
 
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
 
Value, quality and use of OER – preliminary results of an empirical study in ...
Value, quality and use of OER – preliminary results of an empirical study in ...Value, quality and use of OER – preliminary results of an empirical study in ...
Value, quality and use of OER – preliminary results of an empirical study in ...
 
IFPRI - NAIP - Impact of Capacity Building under NAIP
IFPRI -  NAIP - Impact of Capacity Building under NAIPIFPRI -  NAIP - Impact of Capacity Building under NAIP
IFPRI - NAIP - Impact of Capacity Building under NAIP
 
Hendrix College Faculty Technology Survey 2013
Hendrix College Faculty Technology Survey 2013Hendrix College Faculty Technology Survey 2013
Hendrix College Faculty Technology Survey 2013
 
Collaborating with Teachers to Make Great Referrals: Identifying treatment me...
Collaborating with Teachers to Make Great Referrals: Identifying treatment me...Collaborating with Teachers to Make Great Referrals: Identifying treatment me...
Collaborating with Teachers to Make Great Referrals: Identifying treatment me...
 
Naac criterion 6 Governance, leadership and Management
Naac criterion 6 Governance, leadership and ManagementNaac criterion 6 Governance, leadership and Management
Naac criterion 6 Governance, leadership and Management
 
EDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online EducationEDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online Education
 
SWPBS Technical Assistance: SWOT
SWPBS Technical Assistance:  SWOTSWPBS Technical Assistance:  SWOT
SWPBS Technical Assistance: SWOT
 
Triangulating TEL: What's happening; what do students want; and what do staff...
Triangulating TEL: What's happening; what do students want; and what do staff...Triangulating TEL: What's happening; what do students want; and what do staff...
Triangulating TEL: What's happening; what do students want; and what do staff...
 
Measuring Grit - 2013 SmarterMeasure Presentation
Measuring Grit - 2013 SmarterMeasure PresentationMeasuring Grit - 2013 SmarterMeasure Presentation
Measuring Grit - 2013 SmarterMeasure Presentation
 
Lak20 drill down recommendation
Lak20 drill down recommendationLak20 drill down recommendation
Lak20 drill down recommendation
 
A Design Methodology for Learning Analytics Information Systems HICSS 2020 An...
A Design Methodology for Learning Analytics Information Systems HICSS 2020 An...A Design Methodology for Learning Analytics Information Systems HICSS 2020 An...
A Design Methodology for Learning Analytics Information Systems HICSS 2020 An...
 
Trends in-research-aemr-sgd-2013-slideshare
Trends in-research-aemr-sgd-2013-slideshareTrends in-research-aemr-sgd-2013-slideshare
Trends in-research-aemr-sgd-2013-slideshare
 

Destaque

All About Me Story Outline
All About Me Story OutlineAll About Me Story Outline
All About Me Story Outlinejj_edge00
 
Six sigma green belt training (autosaved)
Six sigma green belt training (autosaved)Six sigma green belt training (autosaved)
Six sigma green belt training (autosaved)Uppiliappan Gopalan
 
Healthcare Six Sigma Project
Healthcare Six Sigma ProjectHealthcare Six Sigma Project
Healthcare Six Sigma ProjectMichael Floriani
 
Lean Six Sigma Course Training Material Part 9
Lean Six Sigma Course Training Material Part 9Lean Six Sigma Course Training Material Part 9
Lean Six Sigma Course Training Material Part 9Lean Insight
 
Lean Six Sigma Awareness Handouts
Lean Six Sigma Awareness HandoutsLean Six Sigma Awareness Handouts
Lean Six Sigma Awareness Handoutsguest0981f4
 
All About Me Example
All About Me   ExampleAll About Me   Example
All About Me Exampleajredaelli
 
Lean six sigma Yellow Belt Complete training
Lean six sigma Yellow Belt Complete trainingLean six sigma Yellow Belt Complete training
Lean six sigma Yellow Belt Complete trainingAnkit Sharma
 
Lean Six sigma Black Belt Training Part 6
Lean Six sigma Black Belt Training Part 6Lean Six sigma Black Belt Training Part 6
Lean Six sigma Black Belt Training Part 6Lean Insight
 
All About Me Powerpoint
All About Me PowerpointAll About Me Powerpoint
All About Me PowerpointAmber Bauerly
 

Destaque (10)

All About Me Story Outline
All About Me Story OutlineAll About Me Story Outline
All About Me Story Outline
 
Six sigma green belt training (autosaved)
Six sigma green belt training (autosaved)Six sigma green belt training (autosaved)
Six sigma green belt training (autosaved)
 
Rutgers Green Belt
Rutgers Green BeltRutgers Green Belt
Rutgers Green Belt
 
Healthcare Six Sigma Project
Healthcare Six Sigma ProjectHealthcare Six Sigma Project
Healthcare Six Sigma Project
 
Lean Six Sigma Course Training Material Part 9
Lean Six Sigma Course Training Material Part 9Lean Six Sigma Course Training Material Part 9
Lean Six Sigma Course Training Material Part 9
 
Lean Six Sigma Awareness Handouts
Lean Six Sigma Awareness HandoutsLean Six Sigma Awareness Handouts
Lean Six Sigma Awareness Handouts
 
All About Me Example
All About Me   ExampleAll About Me   Example
All About Me Example
 
Lean six sigma Yellow Belt Complete training
Lean six sigma Yellow Belt Complete trainingLean six sigma Yellow Belt Complete training
Lean six sigma Yellow Belt Complete training
 
Lean Six sigma Black Belt Training Part 6
Lean Six sigma Black Belt Training Part 6Lean Six sigma Black Belt Training Part 6
Lean Six sigma Black Belt Training Part 6
 
All About Me Powerpoint
All About Me PowerpointAll About Me Powerpoint
All About Me Powerpoint
 

Semelhante a 2013 QMOD Presentation

Teaching Six Sigma Using Six Sigma
Teaching Six Sigma Using Six SigmaTeaching Six Sigma Using Six Sigma
Teaching Six Sigma Using Six SigmaBrandon Theiss, PE
 
Assessment for Online and Distance Learning: the six critical areas to address
Assessment for Online and Distance Learning: the six critical areas to addressAssessment for Online and Distance Learning: the six critical areas to address
Assessment for Online and Distance Learning: the six critical areas to addressUniversity of Newcastle, NSW.
 
Assurance of Learning - The ECU Story
Assurance of Learning - The ECU StoryAssurance of Learning - The ECU Story
Assurance of Learning - The ECU StoryANGRAD
 
A Pathway to Continuous Improvement in Computer-Based Testing
A Pathway to Continuous Improvement in Computer-Based TestingA Pathway to Continuous Improvement in Computer-Based Testing
A Pathway to Continuous Improvement in Computer-Based TestingExamSoft
 
Using ExamSoft Data to Prepare For and Ease the Accreditation Process
Using ExamSoft Data to Prepare For and Ease the Accreditation ProcessUsing ExamSoft Data to Prepare For and Ease the Accreditation Process
Using ExamSoft Data to Prepare For and Ease the Accreditation ProcessExamSoft
 
P a g e 1 Sy l l a b u s L a s t U p d a t e d 5 30 .docx
P a g e    1  Sy l l a b u s  L a s t  U p d a t e d  5 30 .docxP a g e    1  Sy l l a b u s  L a s t  U p d a t e d  5 30 .docx
P a g e 1 Sy l l a b u s L a s t U p d a t e d 5 30 .docxgerardkortney
 
Klaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessmentKlaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessmentEADTU
 
Academic Council No.177 DkIT's Employability Statement and Graduate Attribute...
Academic Council No.177 DkIT's Employability Statement and Graduate Attribute...Academic Council No.177 DkIT's Employability Statement and Graduate Attribute...
Academic Council No.177 DkIT's Employability Statement and Graduate Attribute...Embedding Employability
 
Facuity Initiatve for Enhancement and Assurance
Facuity Initiatve for Enhancement and AssuranceFacuity Initiatve for Enhancement and Assurance
Facuity Initiatve for Enhancement and Assurancemanjula191772
 
Self-Assessment: Concept and Process
Self-Assessment: Concept and Process Self-Assessment: Concept and Process
Self-Assessment: Concept and Process Md. Nazrul Islam
 
2016 Conference - GCSE reforms: helping you choose the right exam board
2016 Conference - GCSE reforms: helping you choose the right exam board2016 Conference - GCSE reforms: helping you choose the right exam board
2016 Conference - GCSE reforms: helping you choose the right exam boardYouth Sport Trust
 
Training_Self Assessment Report
Training_Self Assessment ReportTraining_Self Assessment Report
Training_Self Assessment Reportsaba khan
 
EDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEllen Wagner
 
EM 101 ORIENTATION.pptx
EM 101 ORIENTATION.pptxEM 101 ORIENTATION.pptx
EM 101 ORIENTATION.pptxGeorgeGomez31
 

Semelhante a 2013 QMOD Presentation (20)

Teaching Six Sigma Using Six Sigma
Teaching Six Sigma Using Six SigmaTeaching Six Sigma Using Six Sigma
Teaching Six Sigma Using Six Sigma
 
Assessment for Online and Distance Learning: the six critical areas to address
Assessment for Online and Distance Learning: the six critical areas to addressAssessment for Online and Distance Learning: the six critical areas to address
Assessment for Online and Distance Learning: the six critical areas to address
 
New naac
New naacNew naac
New naac
 
STF 2013 Fall-Final
STF 2013 Fall-FinalSTF 2013 Fall-Final
STF 2013 Fall-Final
 
Assurance of Learning - The ECU Story
Assurance of Learning - The ECU StoryAssurance of Learning - The ECU Story
Assurance of Learning - The ECU Story
 
A Pathway to Continuous Improvement in Computer-Based Testing
A Pathway to Continuous Improvement in Computer-Based TestingA Pathway to Continuous Improvement in Computer-Based Testing
A Pathway to Continuous Improvement in Computer-Based Testing
 
Using ExamSoft Data to Prepare For and Ease the Accreditation Process
Using ExamSoft Data to Prepare For and Ease the Accreditation ProcessUsing ExamSoft Data to Prepare For and Ease the Accreditation Process
Using ExamSoft Data to Prepare For and Ease the Accreditation Process
 
P a g e 1 Sy l l a b u s L a s t U p d a t e d 5 30 .docx
P a g e    1  Sy l l a b u s  L a s t  U p d a t e d  5 30 .docxP a g e    1  Sy l l a b u s  L a s t  U p d a t e d  5 30 .docx
P a g e 1 Sy l l a b u s L a s t U p d a t e d 5 30 .docx
 
Klaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessmentKlaus Dieter Rossade online assessment
Klaus Dieter Rossade online assessment
 
Academic Council No.177 DkIT's Employability Statement and Graduate Attribute...
Academic Council No.177 DkIT's Employability Statement and Graduate Attribute...Academic Council No.177 DkIT's Employability Statement and Graduate Attribute...
Academic Council No.177 DkIT's Employability Statement and Graduate Attribute...
 
Academic Council No.176 - Update
Academic Council No.176 - UpdateAcademic Council No.176 - Update
Academic Council No.176 - Update
 
Facuity Initiatve for Enhancement and Assurance
Facuity Initiatve for Enhancement and AssuranceFacuity Initiatve for Enhancement and Assurance
Facuity Initiatve for Enhancement and Assurance
 
Self-Assessment: Concept and Process
Self-Assessment: Concept and Process Self-Assessment: Concept and Process
Self-Assessment: Concept and Process
 
2016 Conference - GCSE reforms: helping you choose the right exam board
2016 Conference - GCSE reforms: helping you choose the right exam board2016 Conference - GCSE reforms: helping you choose the right exam board
2016 Conference - GCSE reforms: helping you choose the right exam board
 
Six sigma project
Six sigma projectSix sigma project
Six sigma project
 
CoLT 2017 - Prof. Dr. Vishna Devi Nadarajah
CoLT 2017 - Prof. Dr. Vishna Devi NadarajahCoLT 2017 - Prof. Dr. Vishna Devi Nadarajah
CoLT 2017 - Prof. Dr. Vishna Devi Nadarajah
 
Training_Self Assessment Report
Training_Self Assessment ReportTraining_Self Assessment Report
Training_Self Assessment Report
 
EDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINAL
 
Sloan-C Quality Score Card
Sloan-C Quality Score Card Sloan-C Quality Score Card
Sloan-C Quality Score Card
 
EM 101 ORIENTATION.pptx
EM 101 ORIENTATION.pptxEM 101 ORIENTATION.pptx
EM 101 ORIENTATION.pptx
 

Mais de Brandon Theiss, PE

A Six Sigma Analysis of Mobile Data Usage
A Six Sigma Analysis of Mobile Data UsageA Six Sigma Analysis of Mobile Data Usage
A Six Sigma Analysis of Mobile Data UsageBrandon Theiss, PE
 
Six Sigma Analysis of Daily Cycling Commute
Six Sigma Analysis of Daily Cycling Commute Six Sigma Analysis of Daily Cycling Commute
Six Sigma Analysis of Daily Cycling Commute Brandon Theiss, PE
 
Teaching tactical industrial engineering to high school students
Teaching tactical industrial engineering to high school studentsTeaching tactical industrial engineering to high school students
Teaching tactical industrial engineering to high school studentsBrandon Theiss, PE
 
Is the Rate of Events of Terrorism Increasing?
Is the Rate of Events of Terrorism Increasing?Is the Rate of Events of Terrorism Increasing?
Is the Rate of Events of Terrorism Increasing?Brandon Theiss, PE
 
15th QMOD conference on Quality and Service Sciences 9/07/2012
15th QMOD conference on Quality and Service Sciences 9/07/201215th QMOD conference on Quality and Service Sciences 9/07/2012
15th QMOD conference on Quality and Service Sciences 9/07/2012Brandon Theiss, PE
 
Rutgers Governor School - Six Sigma
Rutgers Governor School - Six Sigma  Rutgers Governor School - Six Sigma
Rutgers Governor School - Six Sigma Brandon Theiss, PE
 

Mais de Brandon Theiss, PE (12)

A Six Sigma Analysis of Mobile Data Usage
A Six Sigma Analysis of Mobile Data UsageA Six Sigma Analysis of Mobile Data Usage
A Six Sigma Analysis of Mobile Data Usage
 
Six Sigma Analysis of Daily Cycling Commute
Six Sigma Analysis of Daily Cycling Commute Six Sigma Analysis of Daily Cycling Commute
Six Sigma Analysis of Daily Cycling Commute
 
Teaching tactical industrial engineering to high school students
Teaching tactical industrial engineering to high school studentsTeaching tactical industrial engineering to high school students
Teaching tactical industrial engineering to high school students
 
Is the Rate of Events of Terrorism Increasing?
Is the Rate of Events of Terrorism Increasing?Is the Rate of Events of Terrorism Increasing?
Is the Rate of Events of Terrorism Increasing?
 
Starbucks Wait Time Analysis
Starbucks Wait Time AnalysisStarbucks Wait Time Analysis
Starbucks Wait Time Analysis
 
Neqc poster
Neqc posterNeqc poster
Neqc poster
 
Greenbelt review
Greenbelt reviewGreenbelt review
Greenbelt review
 
15th QMOD conference on Quality and Service Sciences 9/07/2012
15th QMOD conference on Quality and Service Sciences 9/07/201215th QMOD conference on Quality and Service Sciences 9/07/2012
15th QMOD conference on Quality and Service Sciences 9/07/2012
 
SQC Guest Lecture- Starbucks
SQC Guest Lecture- StarbucksSQC Guest Lecture- Starbucks
SQC Guest Lecture- Starbucks
 
Rutgers Governor School - Six Sigma
Rutgers Governor School - Six Sigma  Rutgers Governor School - Six Sigma
Rutgers Governor School - Six Sigma
 
IIE Conference Presentation
IIE Conference PresentationIIE Conference Presentation
IIE Conference Presentation
 
Starbucks Wait Time Analysis
Starbucks Wait Time AnalysisStarbucks Wait Time Analysis
Starbucks Wait Time Analysis
 

Último

Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 

Último (20)

Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 

2013 QMOD Presentation

  • 1. Teaching Six Sigma Using Six Sigma a DMAIC Approach Brandon Theiss Brandon.Theiss@gmail.com 2013 QMOD Conference
  • 2. About Me • Academics – MS Industrial Engineering Rutgers University – BS Electrical & Computer Engineering Rutgers University – BA Physics Rutgers University • Awards – ASQ Top 40 Leader in Quality Under 40 – ASQ National Education Quality Excellence Award Finalist – IIE Early Career Achievement Award Winner 2013 • Professional – Principal Industrial Engineer -Medrtonic – Master Black belt- American Standard Brands – Systems Engineer- Johnson Scale Co • Licenses – Licensed Engineer – State of Vermont – Registered to Practice before the US Patent and Trademark Office • Certifications – ASQ Certified Manager of Quality/ Org Excellence Cert # 13788 – ASQ Certified Quality Auditor Cert # 41232 – ASQ Certified Quality Engineer Cert # 56176 – ASQ Certified Reliability Engineer Cert #7203 – ASQ Certified Six Sigma Green Belt Cert # 3962 – ASQ Certified Six Sigma Black Belt Cert # 9641 – ASQ Certified Software Quality Engineer Cert # 4941 • Publications – Going with the Flow- The importance of collecting data without holding up your processes- Quality Progress March 2011 – "Numbers Are Not Enough: Improved Manufacturing Comes From Using Quality Data the Right Way" (cover story). Industrial Engineering Magazine- Journal of the Institute of Industrial Engineers September (2011): 28-33. Print
  • 3. Learning Objectives • Apply Six Sigma to the Teaching of Six Sigma • Create Practitioner Academic Partnerships • Uniquely Apply SPC Charts • Use Statistical Hypothesis testing to improve learning outcomes
  • 4. Motivation • Teaching the tools, techniques and Methods of Lean Six Sigma is inherently difficult in academic setting. • When taught in a industrial setting students have a common motivation (the improved welfare of the company), similar levels of education and knowledge of domain specific information. Students are encouraged to learn by applying the material to their daily activities. • This is not possible in an academic setting particularly in a mixed environment that includes everything from undergraduate juniors through senior PhD researchers. • In addition undergraduate students tend either lack professional or have experience in Fields that are not traditionally thought of as benefiting or implementing Six Sigma (waitressing, check out clerk etc.)
  • 5. 5 Putting some numbers to the motivation • Lean Six Sigma is a commonly adopted business improvement technique which integrates, the scientific method, statistics and defect reduction to obtain tangible results. •Within 50 miles of Rutgers there are 2,249 active job listings for the phrase “six sigma green belt” •Non University Affiliated Classes are available however are prohibitively expensive for most students ~$2,000. •ASQ de facto industry standard for Greenbelt Certification •Current Industrial Engineering Undergraduate and Graduate programs do not prepare students to effectively implement the Six Sigma toolkit. •Salary Report indicates Certified Green belts earn $12,000 more per year
  • 6. Class Demographics • 71 Students Registered – 57 At Student Tuition Rate ($296) – 14 At Professional Tuition Rate ($495) 0.0% 5.0% 10.0% 15.0% 20.0% 25.0% 30.0% 35.0% 40.0% Junior Year Senior Year BA/BS Some Grdudate MA/MS/JD PhD/PE Highest Accademic Grade Completed 24222018161412108642 20 15 10 5 0 Years Of Work Exprience Frequency 3 Histogram of Years Of Work Exprience
  • 7. Solution • The beauty of the Six Sigma Methodology is that it can be applied to any process. • The definition of a process is quite broad and can be reduced to any verb- noun combination. • Therefore the collective process which the class studied and improved was to Pass [the] ASQ Certified Six Sigma Green Belt Exam • Therefore the foundational Six Sigma Concept of DMAIC (Define Measure Analyze Improve Control) represents both the material covered in the course as well as the pedagogical method used for instruction
  • 8. Theoretical Pedagogical Support • Knowles' Theory of Andragogy is based upon six fundamental assumptions related to motivation in adult learning: – Adults become aware of their "need to know" and make a case for the value of learning.(Need to Know) • the students in the class have self selected to enroll in the course, which was marketed solely to prepare students to pass the certification exam. – Adults approach learning with different experiences furthermore the richest resource for learning resides in adults themselves (Foundation). • for each topic introduced there is a tactical application applying the tool or technique to the process of preparing for the ASQ CSSGB exam. – Adults need to be responsible for their decisions on education; They need to be seen and treated as capable and self-directed. (Self-concept). • no formal grades are given in the course and no homework is assigned. Students are responsible for gauging what additional preparation was required in addition to the 3-hour weekly course
  • 9. Theoretical Pedagogical Support (continued) – Adults are most interested in learning subjects having immediate relevance to cope effectively with the present real-life situations (Readiness). • the course culminated in students taking the actual ASQ CSSGB exam, thus for the 11 weeks of the course students were constantly driving towards a relevant and timely goal – Adult learning is problem-centered rather than content-oriented they want to learn what will help them perform tasks or deal with problems they confront in everyday situations and those presented in the context of application to real-life (Orientation). • each activity throughout the course is driven at solving a problem with only a mild suggestion of which tool to use. – Adults respond better to internal versus external motivators (Motivation). • the motivation for the students to take the course was entirely self originating.
  • 10. About the Course & Partnership • Offered as a Non-Credit extracurricular course at Rutgers University in Piscataway NJ • Co-Sponsored by the Rutgers Student Chapter of the Institute for Industrial Engineers (IIE) and the Princeton NJ section of American Society for Quality (ASQ) • Open and advertised to all members of the Rutgers Community (students, staff and faculty) as well as the surrounding public • Objective of the course was to train students to pass the June 2nd 2012 administration of the ASQ Certified Six Sigma Green Belt Exam
  • 11. Course Syllabus 1. Introduction, Sample Exam 2. Review Exam, Define 1 3. Define 2, Measure 1 4. Measure 2, Measure 3 5. Measure 4, Sample 50 Question Exam 6. Review Exam, Analyze 1 7. Analyze 2, Analyze 3 8. Improve 1, Sample 50 Question Exam 9. Review Exam, Control 1 10. Sample 100 Question Exam 11. Review Exam, Additional Questions Define Measure Analyze Improve Control • Project Definition • Team Dynamics • Brainstorming • Process Mapping • Measurement Systems • Histograms • Box Plots • Dot Plots • Probability Plots • Control Charts • Inferential Statistics • Confidence Intervals • Hypothesis Tests • Regression Analysis • Pareto Charts • Process Capability • Lean
  • 12. Pre Test • On the first night of classes students were given an introductory survey of Six Sigma by means of a worked example applying DMAIC to the Starbucks Experience from a Customers Prospective. • Students were then given a copy of the Certified Six Sigma Green Belt Handbook by Roderick A. Munro • Then given a 50 Question Multiple Choice Test representative of the ASQ CSSGB Exam • The Test was administered on two successive nights (Monday and Tuesday)
  • 13. Measurement System • An Apperson GradeMaster™ 600 Test Scanner was utilized which enabled test to be scored and returned immediately upon student submission at the exam site. • In addition all of each answer to every question was downloaded to connected computer enabling further detailed analysis
  • 15. Test Scores 84.00%72.00%60.00%48.00%36.00% 9 8 7 6 5 4 3 2 1 0 Test Scores Frequency Mean 0.5589 StDev 0.1177 N 35 Histogram of Test Scores Normal
  • 16. Test for Normality 1.00.90.80.70.60.50.40.30.2 99 95 90 80 70 60 50 40 30 20 10 5 1 Test Score Percent Mean 0.5589 StDev 0.1177 N 35 AD 0.396 P-Value 0.352 Probability Plot of Test Score Normal - 95% CI
  • 17. Is process in Control? 343128252219161310741 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 Observation IndividualValue _ X=0.5589 UCL=0.9468 LCL=0.1709 I Chart of Test Score
  • 18. Is the Process Capable? 0.840.720.600.480.36 LSL LSL 0.78 Target * USL * Sample Mean 0.558857 Sample N 35 StDev (Within) 0.120985 StDev (O v erall) 0.117718 Process Data C p * C PL -0.61 C PU * C pk -0.61 Pp * PPL -0.63 PPU * Ppk -0.63 C pm * O v erall C apability Potential (Within) C apability PPM < LSL 971428.57 PPM > USL * PPM Total 971428.57 O bserv ed Performance PPM < LSL 966214.72 PPM > USL * PPM Total 966214.72 Exp. Within Performance PPM < LSL 969849.40 PPM > USL * PPM Total 969849.40 Exp. O v erall Performance Within Overall Process Capability of Test Scores overall standard deviation for the entire study overall standard deviation for the entire study if special cause eliminated based on variation within subgroups
  • 19. Are there bad questions? 464136312621161161 1.0 0.8 0.6 0.4 0.2 0.0 Sample Proportion _ P=0.441 UCL=0.693 LCL=0.189 1 1 1 1 1 1 11 11 P Chart of Wrong
  • 20. Does the order the exams are turned in effect the score? 3330272421181512963 0.9 0.8 0.7 0.6 0.5 0.4 0.3 Index TestScore MAPE 15.9381 MAD 0.0840 MSD 0.0124 Accuracy Measures Actual Fits Variable Trend Analysis Plot for Test Score Linear Trend Model Yt = 0.5018 + 0.00317*t
  • 24. Is the process in Control? 28252219161310741 90.00% 80.00% 70.00% 60.00% 50.00% 40.00% 30.00% 20.00% Observation IndividualValue _ X=55.93% UCL=84.62% LCL=27.25% 1 I Chart of Scores
  • 25. Is the process capable?
  • 26. Are there Bad Questions? 464136312621161161 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0.0 Sample Proportion _ P=0.441 UCL=0.717 LCL=0.164 1 1 1 11 1 1 1 P Chart of Incorrect
  • 27. 272421181512963 0.9 0.8 0.7 0.6 0.5 0.4 Index Scores MAPE 13.9747 MAD 0.0779 MSD 0.0100 Accuracy Measures Actual Fits Variable Trend Analysis Plot for Scores Linear Trend Model Yt = 0.5614 - 0.000138*t Does the order exams are turned in effect test scores?
  • 29. Combined Test Scores 0.840.720.600.480.36 20 15 10 5 0 Combined Frequency Mean 0.5591 StDev 0.1099 N 64 Histogram of Combined Normal
  • 31. Is there a difference Between Classes? 0.9 0.8 0.7 0.6 0.5 0.4 0.3 Monday Tuesday Boxplot of Monday, Tuesday
  • 32. Is there a statistical Difference? Anova: Single Factor SUMMARY Groups Count Sum Average Variance Monday 35 19.56 0.558857 0.013857 Tuesday 29 16.22 0.55931 0.010357 ANOVA Source of Variation SS df MS F P-value F crit Between Groups 3.26E-06 1 3.26E-06 0.000265 0.987056 3.995887 Within Groups 0.76114 62 0.012276 Total 0.761144 63
  • 33. Is the variation different?
  • 35. Brainstorming Techniques • At the beginning of class students were asked as a group to brainstorm ideas for why they failed the pre-test – Only 4 ideas were proposed • Students were taught the different brainstorming techniques contained in the CSSGB Body of Knowledge – Nominal Group Technique – Multi-Voting – Affinity Diagrams – Force Field Analysis – Tree Diagrams – Cause and Effect Diagrams • Students were then broken up into 6 different groups, assigned one of the brainstorming techniques and given the task to brainstorm why they failed the pre-test
  • 36. Brainstorming Techniques Continued • Students then presented their results to the Group
  • 37. Brainstorming Results Cause and Effect (Fishbone) Affinity Diagram
  • 40. Brainstorming Continued • Students then told to return to their groups and apply their “favorite” of the brainstorming techniques to the task how can you Pass the midterm exam • Students Found the positive formulation of the task much more challenging and most groups stayed with the same technique they used for the Negative version.
  • 41. Team Dynamics • The 3rd weeks lesson began with an introduction of the Tuckman cycle of team dynamics • Students were asked to reflect upon their experience in the brainstorming activity to see if their experiences paralleled those predicted by the model
  • 42. Process Mapping • The second portion of the 3rd Class was spent introducing the process mapping strategies in the CSSGB BoK – SIPOC (Suppliers Inputs Process Outputs Customers) – Process Mapping – Value Stream Mapping
  • 43. Process Mapping Continued • Students were again divided into 6 groups. Each group was assigned a map type and told to Map the Exam Taking Process at either a Micro or Macro Level • Micro Level Groups Handled the Physical steps of taking the exam such as reading the question, locating the answer and filling in the bubbles • Macro Groups Handled the all of the preparation leading up to taking the exam • The point was to emphasize that the same tools techniques and methods can be used on the very micro level (an operator tightening a bolt) to the very macro level (the operations of a fortune 500 company)
  • 44. 44 SIPOC at a even higher level Input • Students • Body of Knowledge • Instructor • Textbook • Facilities Supplier •ASQ Princeton •ASQ Corporate •Rutgers University Output • Knowledge • Certification Customers • Future Employers • Current Employers • Students • Rutgers University • ASQ Princeton • Rutgers IIE Educate Students in Six Sigma Process Identify Educational Shortcoming Create Course Develop Methodology Locate Students Teach Students Administer Test
  • 45. Control Charts • Class 4 Introduced Students to the Control Charts Covered in the CSSGB BoK – I-MR – X Bar-R – X Bar- S – P – NP – U – C • Students were emailed prior to class a Microsoft Excel Workbook containing the test results and told to bring their laptops to class • Students were asked to do the following by hand (with Excel helping for the calculations): – I-MR Chart for Test Scores – P Chart testing for “Bad Questions” – NP Chart testing for “Bad Questions” – C Chart for the number of wrong responses per exam – U Chart for the number of wrong responses per exam
  • 46. Control Charts Results NP Chart C Chart
  • 49. Pre Class Exam Results
  • 51. Does a T-Test Indicate there was improvement? t-Test: Two-Sample Assuming Unequal Variances Mid Pre Mean 0.607234 0.561702 Variance 0.014373 0.01111 Observations 47 47 Hypothesized Mean Difference 0 df 91 t Stat 1.955429 P(T<=t) one-tail 0.0268 t Critical one-tail 1.661771 P(T<=t) two-tail 0.0536 t Critical two-tail 1.986377
  • 52. Does ANOVA Indicate there was Improvement? Anova: Single Factor SUMMARY Groups Count Sum Average Variance Pre Total 64 35.78 0.559063 0.012082 Mid Total 53 31.72 0.598491 0.013705 ANOVA Source of Variation SS df MS F P-value F crit Between Groups 0.045069 1 0.045069 3.516685 0.06329 3.923599 Within Groups 1.473823 115 0.012816 Total 1.518892 116
  • 54. Is the Change in Control? -15 -10 -5 0 5 10 15 C Chart of Change in # of Correct Responses UCL = 8.29 LCL = -3.74 Mid= 2.28
  • 55. Is the change in Scores Significant? t-Test: Paired Two Sample for Means Mid Pre Mean 0.607234043 0.561702 Variance 0.014372618 0.01111 Observations 47 47 Pearson Correlation 0.689206844 Hypothesized Mean Difference 0 df 46 t Stat 3.475995635 P(T<=t) one-tail 0.000560995 t Critical one-tail 1.678660414 P(T<=t) two-tail 0.00112199 t Critical two-tail 2.012895599
  • 56. Not all Material on the Exam has been Covered in Class
  • 59. Comparison of Results for Material that has been Covered Mid CoveredPre Covered 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 Subscripts CoveredScores Boxplot of Covered Scores
  • 60. Comparison of Covered Material 0.90.80.70.60.50.40.3 12 10 8 6 4 2 0 0.90.80.70.60.50.40.3 Pre Covered Frequency Mid Covered Mean 0.5785 StDev 0.1252 N 64 Pre Covered Mean 0.6516 StDev 0.1174 N 53 Mid Covered Histogram of Pre Covered, Mid Covered Normal
  • 61. Does ANOVA Indicate there was improvement? Anova: Single Factor SUMMARY Groups Count Sum Average Variance Pre Covered 64 37.02632 0.578536 0.015686 Mid Covered 53 34.53333 0.651572 0.013785 ANOVA Source of Variation SS df MS F P-value F crit Between Groups 0.154648 1 0.154648 10.43065 0.001616 3.923599 Within Groups 1.70503 115 0.014826 Total 1.859678 116
  • 62. Comparison of Results for Material that has not been Covered Mid Not CoveredPre Not Covered 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0.0 Subscripts Scores Boxplot of Scores
  • 63. Comparison of Material Not Covered
  • 64. Does ANOVA indicate the Exam was harder? Anova: Single Factor SUMMARY Groups Count Sum Average Variance Pre Not Covered 64 31.83333 0.497396 0.01785 Mid Not Covered 53 27.5 0.518868 0.024926 ANOVA Source of Variation SS df MS F P-value F crit Between Groups 0.013367 1 0.013367 0.635003 0.427168 3.923599 Within Groups 2.420698 115 0.02105 Total 2.434065 116
  • 65. Is the Exam Taking Process Capable?
  • 66. Control Charts with Minitab • Students were emailed a Microsoft Excel Workbook with the Mid- Term data set • It was heavily suggested that students purchase the Minitab academic license and bring their laptops to class. • Students then divided themselves into groups around those who purchased the software and created the analysis control charts on the preceding slides.
  • 67. Hypothesis Testing Exercises • In week 8 students were introduced to the hypothesis tests covered in CSSGB BoK – Z Test – Student T – Two Sample T (known variance) – Two Sample T (unknown variance) – Paired T Test – ANOVA – Chi Squared T – F Test • Students were emailed a data set containing both the Pre-Test and Mid-Term data and asked to perform each of the listed test using either Minitab or Microsoft Excel. The emphasis was placed on the conclusions from the data
  • 68. Confidence Intervals • Not all students took the Mid-Term that took the pre-test. • This enabled students to utilize inferential statistics to draw conclusions about the population parameters (mean and variance particularly) • By using the class data set provided students were able to calculate their confidence in the overall population parameters for the average test score as well as the standard deviation of the entire class
  • 69. Was the Pre-Test a Predictor of the Mid Term Scores?
  • 70. Improve-Control “Improve” and “Control” phase represent a small fraction of the material covered on the ASQ CSSGB exam Within the Body of Knowledge there are the following : • Gantt Chart • Activity Network Diagrams • Critical Path Method • Program (or Project) Evaluation and Review Technique.
  • 75. Did the scores Improve?
  • 76. Was The Difference Significant? Anova: Single Factor SUMMARY Groups Count Sum Average Variance Pre 64 35.78 0.559063 0.012082 Mid 47 28.54 0.607234 0.014373 Final 40 30.43 0.76075 0.020084 ANOVA Source of Variation SS df MS F P-value F crit Between Groups 1.029282 2 0.514641 34.534 4.91E-13 3.057197 Within Groups 2.205562 148 0.014902 Total 3.234844 150
  • 77. Individual Improvement Variable N N* Mean StDev Minimum Q1 Median Q3 Change 36 0 0.1939 0.1419 -0.0600 0.0675 0.2000 0.2875
  • 78. Was the Individual Improvement Significant? t-Test: Paired Two Sample for Means Final Pre Mean 0.750556 0.556667 Variance 0.019743 0.010023 Observations 36 36 Pearson Correlation 0.342582 Hypothesized Mean Difference 0 df 35 t Stat 8.199954 P(T<=t) one-tail 5.8E-10 t Critical one-tail 1.689572 P(T<=t) two-tail 1.16E-09 t Critical two-tail 2.030108
  • 79. Where there Hard Questions?
  • 80. Pareto Chart on Topic Count 3 3 2 2 2 1 1 1 Percent 20.0 20.0 13.3 13.3 13.3 6.7 6.7 6.7 Cum % 20.0 40.0 53.3 66.7 80.0 86.7 93.3 100.0 Question Topic FM EA Control Charts Confidence Interval Team s Process Capablity Error Hypothesis Basic Stats 16 14 12 10 8 6 4 2 0 100 80 60 40 20 0 Count Percent Pareto Chart of Question Topic
  • 83. Results • Ruba Amarin • Margit Barot • Miriam Bicej • Matthew Brown • Salem El-Nimri • William Ewart • Elizabeth Fuschetti • Robert Gaglione • Thomas Hansen • Tarun Jada • Javier Jaramillo • Michael Kagan • Anoop Krishnamurthy • Timothy Lin • Helen Liou • Rebecca Marzec • Charles Ott • Sneha Patil • Eugene Reshetov • Matthew Rodis • Thomas Schleicher • Dante Triana • Albert Tseng • Bond Wann • Paul White • Sun Wong • Shih Yen • Jacob Ziegler 28 out of 37 Students that took the June 2nd Exam Passed the June 2nd Exam Nationally 788 out of 1160 individuals passed the exam
  • 84. Was the Result Significant? Rutgers ASQ
  • 85. Results • Students test scores improved on average 19.4% • 76% of Students Passed the exam compared to 68% National Average • Increased ASQ Princeton Membership by 62 members • Largest Ever Fund Raiser for the Rutgers IIE
  • 86. 86 Added Benefit • From the funds generated by the course Rutgers was able to send 21 Students to the national IIE Conference in Orlando (shown above)
  • 87. 87 It took a team • Nate Manco – ASQ Princeton Education Chair • Richard Herczeg – ASQ Princeton Section President • Jeff Metzler – Rutgers IIE President • Dr. James Luxhoj – Rutgers Industrial and Systems Eng • Brandon Theiss – Instructor • Cindy Ielmini – Rutgers Industrial and Systems Eng
  • 88. Lessons Learned • Using the passing the exam process as a class example for the implementation of the tools and techniques of Six Sigma is an effective methodology • There is demand for teaching Six Sigma in an academic setting • The joint venture between Rutgers and ASQ is feasible and mutually beneficial. • Having a diverse student population increases the overall performance of the group. • Students need to be adequately qualified to sit for ASQ exam prior to taking the course.
  • 89. 89 We are sharing the Results • Presented results at Institute of Industrial Engineers Lean and Six Sigma Conference • Will be presented at the ASQ International Conference on Quality
  • 90. 90 Progress continues onward • Course Scheduled to Run again in the Spring through Official Continuing Education Office • First of its kind joint meeting with ASQ Princeton and Rutgers IIE in which the course results were presented.
  • 91. Questions? • Contact info – Brandon Theiss – Brandon.theiss@gmail.com – Connect to me on LinkedIn

Notas do Editor

  1. Six Sigma is a problem solving tool kit that seeks to improve the quality of process outputs by identifying and removing the causes of defects (errors) and minimizing variability in manufacturing and business processes.Six Sigma Green Belts are the tactical leads on improving functions within a job function that are able to apply the Lean Sigma Concepts to their daily work.The methods are universally applicable to anything where a customer is being serviced.
  2. The cost of the course for students included the textbook and ASQ student membershipThe professional rate only included the text.The ASQ Certified Six Sigma Green Belt Requires 3 or more years of work experience in one of more areas of the Body of Knowledge. There was a very long and at times heated exchange with the ASQ certification committee about what constitutes work experience. A compromise was ultimately reached however there were still a large number of qualified students that were denied the right to sit for the exam
  3. This is a unique pedagogical approach and from philosophically is quite “meta”. The objective under examination is in fact the actor performing the examination.The most brilliant of teacher can write the most profound equation on a chalkboard, and the most diligent of students can take pristine notes. However learning only occurs when the student is able to apply the material. Johann Wolfgang von Goethe was correct when he said “Knowing is not enough; we must apply.”Given the diversity of the composition of the students in terms of education, life experience, income and industry finding a common task in which to apply the LSS would have been impossible. The only true commonality between the group was that they were all humans and wanted to earn their greenbelt. We were able to leverage this fact in developing the instructional roadmap for course.Also the utilization of Shewhart Control Charts which are used to differentiate between common cause and special cause variation, is fairly novel in academic settings.
  4. The instructor for the course, Brandon Theiss, is a Senior Member of ASQ and a Graduate student at Rutgers University. Currently there is not a course offered in the undergraduate Industrial and Systems Engineering Program at Rutgers. This course provided an opportunity for students to not only be exposed to the material but also to earn a nationally recognized certification in the tools techniques and methods of Six Sigma. It represented a first of its kind partnership between the student chapter of the IIE and ASQ Princeton section. Part of the proceeds for the course were used to fund the IIE trip to their national conference in Orlando.
  5. The course met once per week over an 11 week period from 6:30 to 9:30PM. There were two sessions per week and students were free to attend either the Monday or Tuesday class based upon which ever was more convenient for their schedule
  6. Students were notified via email prior to the first night of the course that an exam would be administered on the first night.This provided both a baseline for the future improvement as well as showing students directly the level of mastery they would need to obtain to become certified.
  7. Feedback in any system is critically important. With a course that only meets once per week, having students wait a week would be to long. By providing students immediate feedback they were able to best utilize their time to study as well as not mis-learn material thinking that they had been correct on a question when in fact they were not.
  8. A simple histogram of the exam results from the Monday section with a normal distribution fit. It does appear to be normal but has a very large standard deviation 11.8%
  9. The probability plot indicates that there is insufficient data to reject the null hypothesis that the data is normally distributed. This is indicated by the P value which indicates the probability that the difference between the measured data and the model occurred by pure chance. The null hypothesis of normality would have been rejected if the value had been less than alpha (5%) representing a 95% confidence level.
  10. It is technically debatable if the test scores are continuous or discrete variable and if a I chart is appropriate. However the point is to introduce students to control charts and an Individuals chart.Since no point lies about the Upper or Lower Control Limit, the process is in a state of “statistical control”. However common sense shows that this is nonsensical as the range of the limits is between 17% and 95%. This was caused by the large standard deviation observed.This was used as an opportunity to discuss the difference between statistical significance and actual significance. This reinforces the concept that the math does not know where the numbers came from and can at best direct teams to derive the true underlying meaning.
  11. Again there is a technical point if the test scores are discrete or continuous. The above Process Capability study requires that the data be considered continuous. Process capability is essentially the probability of producing a product that will meet your customers specification. In this case the passing score (78%) sets that limit. As you can see in the above chart for every 1,000,000 students from the Monday population that took the pre-test exam ~970,000 students will fail.
  12. Everyone has taken a test where the test taker believes there was a question that either had the wrong answer or was too difficult. By using a NP (or P) control chart, one can easily distinguish if a question was statistically significantly too difficult above the UCL or too easy below the LCL
  13. There were several students who handed in their exams very quickly. We wanted to see if the amount of time a student spent on the exam effected their scores. And for the Monday data set it appears it did.
  14. A histogram of the Tuesday data set
  15. Again the data is normal as indicated by a P value greater than 5%. It is however notable in the above plot that there is a clear outlier.
  16. Again we can see that there is clearly an outlier in the data set.
  17. The Tuesday process is very similar in its inability to produce a unit meeting customers expectations and again will generate ~970,000 failures for every million students from the population that take the exam
  18. In the above graph it does appear that there were questions that a statistically significant number of students got wrong.
  19. Interestingly, the order in which a student turned in their exam did not have an effect on the Tuesday data set.
  20. Combined Histogram of the results
  21. Both distributions look somewhat similar.
  22. The above shows a box plot comparing the two classes. The median appears to be higher in the Tuesday class. However is the difference significant?
  23. An ANOVA analysis was performed which results in a very high p value which means that there is not a statistically significant difference between the two population means.
  24. A Pareto Chart of the topic involved for each of the Out of Control Data points from the combined P Chart
  25. Nominal Group -&gt; when individuals over power a groupMulti-Voting -&gt; Reduce a large list of items to a workable number quicklyAffinity Diagram -&gt; Group solutionsForce Field Analysis -&gt; Overcome Resistance to ChangeTree Diagram -&gt; Breaks complex into simpleCause- Effect Diagram -&gt; identify root causes
  26. Most Common Model of group Development was proposed by Bruce Tuckman in 1965.In order for the team to grow, to face up to challenges, to tackle problems, to find solutions, to plan work, and to deliver results. They must go through the cycleFormingTeam members getting to know each otherTrying to please each otherMay tend to agree too much on initial discussion topicsNot much work accomplishedMembers orientation on the team goalsGroup is going through “honeymoon period”StormingVoice their ideaUnderstand project scope and responsibilitiesIdeas and understanding cause conflictNot much work gets accomplishedDisagreement slows down the teamNormingResolve own conflictsCome to mutually agreed planSome work gets doneStart to trust each otherPerformingLarge amount of work gets doneSynergy realized Competent and autonomous decisions are madeAdjourningTeam is disbanded, restructured or project re-scoped.Regression to Forming stage
  27. Control Charts are used to differentiate between common cause (normal) and special cause (abnormal) variation.
  28. There does not appear to be a large change between the Pre Test and the Mid Term
  29. A T-Test indicates that there is significant improvement, as indicated by the one tail P value.
  30. ANOVA on the other hand indicates that there is not a difference between the two means.
  31. Displays a histogram of the changes in scores, about 40% of the students went down and 60% increased their score.
  32. This is a somewhat novel adaptation of a C chart that allows for negative values. However there appear to be students that did much better and much worse than the other students.
  33. Looking at a Paired-T test there was absolutely a statistically significant improvement.
  34. Why did the test scores not improve more dramatically? Well the exams cover all of the material in the CSSGB BoK the course was only half complete. When we looked at the material covered up to the midterm on both the pre-test and the mid term the above pie charts show the percentage of the covered material on each exam.
  35. Not surprisingly students performed better on the material that was covered as compared to the material that was not covered.
  36. However the students also scored better on that same material on the pre test.
  37. So was there actual improvement?
  38. The change in the means indicates a ~8% improvement. However is that statistically significant?
  39. ANOVA does indicates that there is a difference in the means. The students did in fact learn the material that was covered.
  40. There does not appear to be a difference in the scores in the material that was not covered yet in the course.
  41. There was a small increase in the means ~2% is that significant?
  42. No. There is not a statistically significant difference between the pre-test and mid-term scores on the material that was not covered. As a result it would indicate that the exams were roughly the same difficulty.
  43. The process is still incapable of generating a passing score on the test.
  44. Minitab is the de facto industry standard for statistical process control. Unfortunately the undergraduate program at Rutgers does not include any training in the software suite. It is fairly intuitive however students needed additional instruction.
  45. The above histogram does not quite look normal and has a very large standard deviation 14%.
  46. A dot plot again shows a strange pattern.
  47. The distribution is in fact bimodal. Unfortunately due to ASQ’s interpretation of the meaning of work, a large number of qualified application were unable to sit for the actual Greenbelt exam and became disenchanted with the course and represent the lower distribution. This assumption was supported by a post hoc online survey.
  48. However the test scores did appear to approve (even with the lower distribution)
  49. And the improvement was very significant as indicated P value of 4.91 x 10^-13
  50. On average the students improved 19.4% only a few students scores decreased,
  51. The Paired T Test Results also confirm that the students test scores improved!
  52. A P Chart was again used to detect difficult questions.
  53. A Pareto Chart above shows the topics that generated that special cause variation in the prior P chart.
  54. The initial process capability was quite poor, producing defects ~970,000 failures per 1,000,0000
  55. The final process capability though still not best in class, is much better, producing 475,000 failures per million (the observed is used since the data was already proven to be non normal as it is bimodal)
  56. *Actual data has not yet been released for the national average yetAs Confucius says “I hear and I forget. I see and I remember. I do and I understand.”