Training+Job+Career: Tracking Learning in Practice for 15 Years
1. Training + Job + Career
Tracking Learning in Practice for 15 Years
July 21 2015 -- xAPI Camp Amazon
Ben Erlandson, MSI CTO
1
2. MSI
McKinsey Social Initiative
independent non-profit organization
founded by McKinsey & Company
❏ expert problem solvers
❏ develop innovative approaches
❏ complex social challenges
2
3. Problem Definition: Generation
Close the skills gap for young people...
We are developing a program to place disconnected young adults in jobs,
giving them the skills and support they need to achieve lifelong personal
and professional success to fundamentally change their life trajectories.
75 million young people
unemployed globally
3x as many underemployed
40% of employers say a
skills shortage is
driving entry-level
vacancies
3
4. Introducing Generation
Watch our video...
1 Million young people trained
and placed into
promising careers
5 Countries
5 Years
methodology to enable others to expand the impact to
millions more youth around the world1
4
generationinitiative.org
6. Four Industry Sectors
Healthcare
Certified Nursing Assistant
Retail
Pharmacy Tech
Unit Leads
Technology
Web Development
Digital Marketing
Trade Skills
TBD
Generation’s approach works in any middle-skill
profession in any city in any part of the world
The Goal...
6
7. Three Types of Impact
❏ Program Impact on Participants
❏ Return on Investment for Employers
❏ Impact of Generation program variations
7
11. Scaling with Technology...
Six Areas of Focus...
Participant Recruitment Learning Content
Delivery Platforms Assessment
Online Community Data Tracking
LOCAL ACCESS
11
12. Four Pillars = People, Info, Tech, Space
Learning⇆Assessment
Learning Systems Design
12
13. Skills Mapping: Tech, Behavior, Mindset
13
Technical Behavioral Mindset
Problem Solving
Workplace Apps
Product Knowledge
Protocols
Physical Stamina
Attitude
Communication
Engagement
Time Management
Personal
Responsibility
ownership, commit
Future Orientation
goals, short-long,
progress checks
Growth
improve over time
Persistence
finish what you start
21. Why is technology critical?
❏ SCALE (general mechanical efficiency,
and...)
❏ Assessment + Analytics
❏ Global Content Management/Delivery
❏ Enterprise MDM Solution
❏ Communications and Operations
21
Global Standards + Local Flexibility
22. (Hopefully Only) Five Versions of Scaling....
USA
Spain
Kenya
India
Mexico
2020...
22
23. Problem Definition (Redux)
❏ 1 million learners (unevenly distributed)
❏ scalable (in)formal learning/assessment
❏ 2-15 years of tracking
❏ 5 countries (3 continents)
MULTIPLE:
stakeholders modalities
institutions
data formats data systems (varied access)
regular 6/12 mo turnover in country teams
23
24. Key Questions
Near- and Mid-Future...
1. How to build for constant ICT
differentiation in countries?
2. How do we create a non-invasive UX
with assured data collection?
3. How do we ensure effectiveness of our
intake process (especially in terms of
baseline measures across modalities)?
24
Participant
Recruitment
Learning
Content
Delivery Platforms Assessment
Online Community Data Tracking
LOCAL ACCESS
My name is Ben Erlandson
CTO of MSI
Happy to be joining everyone today for xAPI Camp!
MSI
Started in late 2014
Generation is the first program/project of MSI
Problem Definition: Generation
Young People = 16 - 24
typically no college -- high school or GED (or similar in other countries)
usually lower SES with slight variations across countries
75 million unemployed globally
40% of employers see a skill shortage
Skills Gap = misalignment between young people and employers
People: There are no jobs!
Companies: There are no employable young people!
We are focusing on getting young people careers, not just jobs
lifelong personal and professional success
Two areas of need for Youth Employment
Replicable Rapidly Scalable Methodology
Measurable ROI for employers & young people
Countries = US, Spain, Kenya, India, Mexico
One methodology for scaling program delivery to 1 million young people and beyond...
Others will pick up the torch and carry it with us!
SHOW VIDEO if there is time.
Our six components
recruitment
comprehensive mobilization, application, and selection process
direct engagement with employers
including buy-in to strategize on curriculum and guarantee interviews
intensive training cohorts across three skills maps
I see these as “proto-work” - structured very similarly to having a job
mentorship
during and after cohort completions
eventually cohort grads serve as mentors as well
community
social learning into and around the workplace
within countries and within industries (globally)
BRIEF
Four current/future sectors...
Healthcare
Retail
Technology
Trade Skills
GOAL
approach/method extensible to any mid-skill profession anywhere in the world
Focus on Impact of Generation
What are the students getting out of the training and mentoring and community, etc?
Are the employers getting a good return on their investment of various resources into Generation programs?
How are the variations in Generation from one place to the next affecting overall impact of Generation’s success?
Basic Approach
For each country/program:
Develop Local Approach
Launch Pilots (POC)
Scale up -- cities and professions
Across Countries...
Some cities will have multiple sites and multiple program types
We discover more and more potential cities every week/month...
From 0-1,000,000 by 2020
Logarithmic growth, essentially
Unevenly distributed across countries -- e.g., India is expected to have an overwhelming majority of students
Six Areas of Focus
Recruitment
Awareness, Management, Review, Selection, Intake
Delivery
LMS, Simulations, Social Platforms, CMS ???
Community
Mentoring, Cohort Comms, Post-Grad
Content
In House, OTS, Sim/Games Framework, Teacher Training
Assessment
Student Performance, Feedback/Guidance, Teacher Support, Learning Analytics for all...
Data Tracking
Students, Cohorts, Teachers, Employers, MSI/Generation: Program Efficacy
ACROSS ALL = LOCAL ACCESS ISSUES (VARIATIONS)
Kenya and India are our two most interesting cases
Four Pillars
Who are the People for whom we are designing?
What is the Information necessary for the Learning?
Which technologies can support the use/production of this Information while Learning?
What are the Spaces where Learning is occurring, and how does it affect People and their use of Technology?
Learning + Assessment
Becoming One..
The Learning Task IS the Assessment Task
The Three Skills Maps
Technical = Job Specific
Can you do THIS JOB?
Behavioral = Workplace Readiness
Can you do ANY JOB? (are you employable)
Mindest = Career/Future Facing
Are you also focused what’s after this job?
Enter xAPI...
Where does it fit in across our challenges?
Setting up the best measures and assessments for the different industry sectors and different components of the Generation framework
ECD/4PA approach to assessment task delivery
4-Space model for simulation-based assessment -- more on this in the breakout session! :)
Problem = defined by domain
Tools = available for solution
Solution = practice-based approached
Response = solution becomes “done”
TWO PHASES of work within a particular context
Here’s a basic time map of any student’s experience of Generation
CLICK to show xAPI graphic
How often can we generate relevant xAPI statements (about what?), and
most interesting: what do the result, context, and attachments look like?
How do we translate each of our skills maps into xAPI statements?
How are these statements connected as patterns of performance?
How are the overlaps relevant as patterns of xAPI statements?
At this point, we’re still mapping the terrain for each of our countries and programs
Accelerated timelines notwithstanding, the terrain is steep and rough. :)
What’s the best approach to building an analytics solution to ensure we’re meeting our goals for all stakeholders?
What are all the ways that xAPI statements can inform our various analytics channels - especially for students, employers, and us at MSI and Generation Global?
Over time, how can we use xAPI to help us differentiate between signal and noise?
Stepping back... our basic program architecture
which aligns with our six areas of focus for scaling Generation with technology
Notice the relationship between UX, assessment/eval, and research
Scaling globally past a certain volume/density of use is really only feasible with the mechanical efficiency of cloud technologies
concerning xAPI, assessment and analytics are most obviously relevant, but one could argue the case of all other areas listed here
As we move forward with Generation programs in each of our five countries, we are finding that scaling requires an approach to Global Standardization that has Flexible Localization at its core
Based on this Global/Local flex, we are anticipating (at a minimum) Five Versions of global scaling
Why?
Cultural issues (UX differentiation between countries)
Economic factors (e.g., India vs. Spain)
Government and Vendor partnership variations across countries and regions
ICT Infrastructure (e.g., SMS-heavy India and Kenya vs. Spain or US)
Click to Show Larger Diagram
In case you’re curious...this is a messier diagram showing backend connectivity
SO...
Back to the problem, with a bit more detail...
READ THE SLIDE
This is our call to action:
A convoluted problem definition for a complex challenge indicating a serious need for assistance.
Our first three key questions
(remember our six areas of focus)
READ THE QUESTIONS
And, question #4: What are we forgetting?
We’re looking for bright people and organizations to join us in our quest!
I’m looking forward to working together today, tomorrow, and through 2020
(If the various QRs don’t work for you, I’ve got regular paper cards too...)