3. Case Study in xAPI
• Domestic Natural Gas Production
Company
• Colorado, Louisiana, Oklahoma,
New Mexico, Texas & Wyoming
• 300,000 BE/Day ~ 45% liquid
• ~ 5,500 employees This Photo by Unknown Author is licensed under CC BY-SA
4. Current State of Training
• SCORM Content with Embedded
Test
• 70% to pass
• Limited item analysis
• No tie back to learning objectives
This Photo by Unknown Author is licensed under CC BY
5. Current State of Safety
• Incident Tracking
• Behavior-based Safety
Observations
No correlation between training and
performance. This Photo by Unknown Author is licensed under CC BY-NC-ND
6. Catalyst for Change
• Executive Leadership Support
“If taking time to test on
objectives that are important to
safely do a job, then it makes
sense to utilize or data to follow
up on missed objectives.” This Photo by Unknown Author is licensed under CC BY-ND
7. Path to Solution
• Content – Do assessments accurately gauge mastery of an
objective?
– SME & ISD Review & Update
• Data – What are our sources?
– Learning Content – xAPI Enabled Testing
– Safety/Performance Data
• Visualizations – How do we tell the story?
• Action – What is the intervention Necessary?
• Results – Are we affecting change?
8. Informing Business Processes
This Photo by Unknown Author is licensed
under CC BY-NC
This Photo by Unknown Author is licensed under CC BY-SA This Photo by Unknown Author is licensed
under CC BY-NC
This Photo by Unknown Author is licensed under CC BY-SA-NC
This Photo by Unknown Author is licensed
under CC BY-NC
This Photo by Unknown Author is licensed under CC BY
Learning Incident Tracking BBS Observations
9. Informing Business Processes
This Photo by Unknown Author is licensed
under CC BY-NC
This Photo by Unknown Author is licensed
under CC BY-NC
LRS
Reporting Database BBS ObservationsLMS
This Photo by Unknown Author is licensed
under CC BY-NC
This Photo by Unknown Author is licensed
under CC BY-NC
Incident Reporting
This Photo by Unknown Author is licensed
under CC BY-NC
MS Flow MS Flow
This Photo by Unknown Author is licensed under CC BY-SA-NC
Data Visualization
MSPowerBI
10. Results & Next Steps
• Identify Content & Assessment Gaps
• Identify Competency Gaps
• Focused SME Intervention on Failed
Objectives
• Improved, Consistent Communication
• Correlated Observation and Incident
Trending
“As we focus more and more on analytics, it makes sense to
delve into what our learning data can tell us.”
It’s worthwhile to spend a little bit of time talking about what happens when we live in a SCORM world (which we all do) and how xAPI is different.
Otherwise, what I’ve found is that people try to re-create SCORM using xAPI, instead of thinking bigger.