Proving impact isn’t a new challenge for learning and development leaders. It’s a well-known fact that neither the data nor the technology has been capable of providing the insights required to not only demonstrate training ROI, but also determine exactly what needs to be changed to impact results. But this is about to change. Introducing Microlearning + Big Data + Business Data + Machine Learning! For the first time ever, learning leaders can now use this powerful combo to understand the true impact of their efforts — at scale. The best part? No data scientists required! Join Axonify and Bloomingdale’s VP of Loss Prevention and Risk Management, Chad McIntosh, for a webinar on May 24th from 2-3 pm EDT to learn: What “learning attribution” means and how it will fuel the L&D digital transformation. What big learning data you need to quantify business impact and why microlearning closes this gap. How you can measure and understand the impact of your training program — at scale — to continuously improve the effectiveness of your training programs and empower frontline managers to take action. How Bloomingdale’s is using microlearning, big data, business data, and machine learning to understand impact and become agile with its training programs.

1. #WFwebinar
The presentation will begin at the top of the hour.
A dial in number will not be provided.
Listen to today’s webinar using your computer’s
speakers or headphones.
Welcome to the webinar!

2. #WFwebinar
Tools You Can Use
Audio Control
– A dial in number will not
be provided.
– Adjust the volume on
your computer or
headphones

3. #WFwebinar
Questions and Handouts
You can submit questions by
clicking on this icon here.
You can download a PDF of the slide
deck by clicking here.

4. #WFwebinar
1. May I receive a copy of the slides?
YES! Click on the handouts list located on the right portion of
your screen.
2. May I review the webinar recording at a later date?
YES! You may log in again using today’s link to review the
presentation on-demand.
3. Is this webinar HRCI or SHRM certified?
YES! The HRCI and SHRM certification codes will be sent in
the same follow up email as the recording
Frequently
Asked
Ques0ons

5. #WFwebinar
Register
for
the
next
webinar!
Staying Ready for What’s Next: Outcomes vs
Learning
Thursday, June 14, 2018
Webinars start at 2 p.m. Eastern / 11 a.m. Pacific
Register for all upcoming Workforce Webinars at workforce.com/webinars

6. #Axonifynewfrontier
Microlearning
+
Big
Data
+
Machine
Learning:
How
to
Finally
Prove
the
Impact
of
Training

7. #Axonifynewfrontier
Carol
Leaman
President
and
CEO
Axonify
Chad
McIntosh
Vice
President
of
Asset
Protec>on
and
Risk
Management
Bloomingdale’s

8. Agenda
• Impact
Measurement
Problem
• The
Emergence
of
Microlearning
Data
and
Machine
Learning
• What
Measurement
Looks
Like
• Impact
Measurement
at
Bloomingdale’s

9. Proven
brain science
techniques
Diverse
engagement tactics
Adaptive microlearning
Actionable
insights
Anytime, anywhere
access
The Axonify microlearning experience

10. Poll
Do
you
think
that
organiza0ons
should
measure
the
impact
of
learning?
A. Yes
B. No
C. Not
sure

11. How
do
we
really
know
if
training
is
making
a
difference?

12. C-suite
can’t
understand
the value
of training
Businesses lack
insight into
what’s working
#1 challenge
for training
professionals
Businesses can’t
understand the
value of training
92% of CEOs can’t see
the impact
Businesses
spend $140B
per year on
training
$

13. What if you could…
ü Measure and understand the impact
of your training programs on your
business
ü Leverage this understanding to
continuously improve the
effectiveness of your training
programs.
ü Use training as a lever to optimize
business results in real-time
ü Automatically adapt to individual
learning gaps based on an
understanding of what matters.
ü Do all of this AT SCALE – for each and
every program

14. Attribution
The degree of impact an activity has on real business
metrics
LIMITED
ATTRIBUTION
FULL
ATTRIBUTION
Number of
completions
and test scores,
number of
programs
Number of
ads, mailers,
billboards
Customer
satisfaction
/loyalty
Deals,
revenue
Pipeline, wins,
subscribers,
revenue
L&D Support SalesBUSINESS
UNITS
Marketing
MEASUREMENT
METRICS

15. To attribute learning
to business results,
data must exhibit the
5 V’s of Big Data:
1. VELOCITY
2. VARIETY
4. VALUE
5. VOLUME
3. VERACITY
The “streetlight”
effect keeps us
searching for
answers in the wrong
place (event-based
data)
DURATION
COMPLETIONS
GRADES
ATTEMPTS
Training
has
a data
problem

16. The time for training to digitally transform using big data
is here.

17. Demographic Data
Role
Location
Tenure
Team
Department
Axonify Microlearning Data
History
Progress
Confidence
Recency
Engagement
Behavior
Results
+
ATTRIBUTION + ADAPTATION
The key is microlearning data

18. BEHAVIORS + RESULTS
• Positive
• Negative
QUESTION META DATA
• Subject
• Proficiency
• Progress
• Iteration
• Confidence
• Difficulty
QUESTION + TIME
The baseline
measurement
of knowledge
KNOWLEDGE
• Baseline
• Current
• Lift
• Decay
Continuous
microlearning
experience =
Axonify
Microlearning
Data

19. How big is Axonify Microlearning Data
74%
Employee
participation every 30
days
104
Sessions per employee
per year
10
Data points
per question
520
Questions
per employee
per year
x 5200
Data points
per employee
per year
=
593,000 printed pages
250M Data points per organization per year

20. 1. DATA CLEANING
Prepare data by standardizing
millions of learning and
business data points
2. STATISTICAL
CORRELATIONS
Establish statistically
significant connections
between learning and
business data
3. IMPACT
MEASUREMENT
Learning attribution (business
impact) is calculated using machine
learning and the expanded cleaned
and correlated data
5. ACTIONABLE
RECOMMENDATIONS
Automatically adjusts learning
and makes recommendations
to frontline managers
for improvement
4. GAP ANALYSIS
Continuously flags at-risk
business targets daily
MACHINE
LEARNING
Axonify
Impacts:
How It
Works
BUSINESS DATAAXONIFY MICROLEARING DATA

21. Big data and machine learning have transformed
virtually EVERY industry
Retail
To drive transaction
size/volume
Insurance
To mitigate
risk exposure
Banking
To identify and
mitigate credit fraud
Entertainment
To personalize the
user experience

22. Everything changes right now
Axonify
Microlearning
Data
THE BIG DATA
Business
Goals
THE LANGUAGE
Machine
Learning
THE INTELLIGENCE
Learning
attribution
at scale

25. Learning practitioners
can measure and
understand business
impact – at scale
ü Isolate learning to see
exactly how it’s contributing
to business impact
ü Understand individual
program performance
ü Observe business impact
trends over-time
ü Unpack underperforming
programs to determine root
cause

26. Frontline managers
use training as a lever
to optimize business
results
ü Understand which teams
are effectively leveraging
knowledge to drive
business results
ü Rely on data to have
discussions about the
potential impact of
increasing participation
or frequency
ü Enable front-line
managers to quickly
take action

27. Automatically adapt to
individual learning gaps
based on an understanding
of what matters.
ü Automatically pushes the right
training to the right people
when it’s needed the most
• Behavior-based refresher
training
• Targeted impact training

28. 7 Steps of Impact
Upload
Business
Data
Relevant
business
data
suppor>ng
a
defined
business
goal
is
imported
into
Impact,
ranging
from
sales
to
call
handling
to
safety
data.
Set
Thresholds
Thresholds
are
then
set
to
benchmark
if
business
goals
are
on
pace
to
be
reached.
Define
Business
Goals
Set
the
desired
business
results
that
your
organiza>on
is
trying
to
achieve.
Link
Subjects
Once
the
data
is
imported
and
thresholds
are
set,
relevant
subjects
are
then
linked
to
specific
business
goals.
Understand
Impact
Understand
subject
performance
and
impact
of
training
on
the
business.
Take
Ac>on
Con>nuously
improve
the
effec>veness
of
your
training
programs
and
empowering
front-­‐line
managers
to
take
ac>on.
Self-­‐Heal
Learning
Impact
feeds
results
data
into
our
adap>ve
learning
engine
to
push
the
right
training
to
the
right
people
to
drive
the
greatest
business
impact.
1
6
7
4
3
5
2
Impact
7 Steps of Impact™

29.
Introducing Chad McIntosh
VP of AP & Risk Management
Bloomingdale’s

30.
Responsible for the safety of
people, products & facilities at
Bloomingdale’s.

31. 2012 at Bloomingdale’s
Corporate Learning What the Business
Needed
Disconnect

32.
Issues
we
were
having
• Inconsistency from department-to-
department and store-to-store
• Difficulty identifying who was
“getting it”
• Lack of engagement and appeal to
the traditional approach
• No metrics for knowledge and
retention
• Poor compliance, escalating
claims, negative image of training
• Not agile

33.
The
boJom
line
Associates were not
remembering and applying
what they needed to know
to do their jobs and it was
expensive.
• Preventable safety claims
• Lack of understanding of LP
programs

34. In
2012,
we
selected
Axonify
as
our
microlearning
plaOorm.

35. Voluntary
par0cipa0on
Associates
living
and
breathing
our
message
Reduc0on
in
safety
incidents
>90%
15,000
41%
With
Axonify
we
saw….

36. in
boaom-­‐line
impact
since
2012.
Over
$10
Million
And
calculated…

37. In
late
2017,
we
entered
into
the
Axonify
Impact™
early
adopter
program.

38. The
Results
24%
Impact
aJributed
to
worker’s
comp
36%
Impact
aJributed
to
general
liability
$3
Million
in
directly
aJributable
savings
+

39. Where
are
we
going
with
Axonify
Impact?
Proactively adjust
content based on
what’s working or not
Expand the set of
business goals we’re
measuring
Enable leadership at
all levels to act on
these new insights
Business Agility

40. More Resources
Impact Measurement Resources
axonify.com/impact
Microlearning - The Ultimate Guide
axonify.com/microlearning
Bloomingdale’s Story
axonify.com/bloomingdalesimpact

41. #Axonifynewfrontier
Ques0ons