If we could observe all the events in a learning environment, even the most hidden ones, what kind of interventions would become feasible? The presentation finishes with a workshop to manipulate a dataset with R.
What if we could observe all events in a learning environment?
1. Auntie p flickr.com
What if we could observe
all events in a
learning environment?
MUI-TIC, Valladolid, April 2012
Abelardo Pardo
www.slideshare.net/abelardo_pardo
@abelardopardo
2. libraryman flickr.com
Journey to 10 years from now
Abelardo Pardo What if we could observe all events in a learning environment? 2
3. ribarnica flickr.com
Analytics
today
Abelardo Pardo What if we could observe all events in a learning environment? 4
10. Reigh LeBlanc flickr.com
Medical
records
Abelardo Pardo What if we could observe all events in a learning environment? 11
11. (Campbell, De Blois, Oblinger 2007)
C. Elle flickr.com
Refine
Collect
Act The five steps
Report
of analytics
Predict
Abelardo Pardo What if we could observe all events in a learning environment? 12
12. ribarnica flickr.com
Analytics
today
Potential
in
learning
Abelardo Pardo What if we could observe all events in a learning environment? 13
13. Shaylor flickr.com
Did they lea
rn?
Abelardo Pardo What if we could observe all events in a learning environment? 14
15. Biking Nikon SFO flickr.com
If you can not measure it,
you can not improve it.
Abelardo Pardo What if we could observe all events in a learning environment? 16
16. bencrowe flickr.com
“We need better evaluation
to acknowledge and esteem
excellence when it occurs,
as it does.”
John Hattie. Visible Learning: A Synthesis of Over 800
Meta-Analyses Relating to Achievement.
Abelardo Pardo What if we could observe all events in a learning environment? 17
17. bodhithaj flickr.com
Learning analytics improve
the feedback loop
Abelardo Pardo What if we could observe all events in a learning environment? 18
18. (Jones, 2011)
bodhithaj flickr.com
Administration Students
Teachers Researchers
Abelardo Pardo What if we could observe all events in a learning environment? 19
19. Marketingfacts flickr.com
Where is learning analytics?
Abelardo Pardo What if we could observe all events in a learning environment? 20
20. PranceyDog flickr.com
LA as vertical market
Specialized objectives
Specialized audiences
Specialized topic
Abelardo Pardo What if we could observe all events in a learning environment? 21
21. Abelardo Pardo What if we could observe all events in a learning environment? 22
22. ribarnica flickr.com
Analytics
today
Potential
in
learning
Challenges
Abelardo Pardo What if we could observe all events in a learning environment? 23
23. ljubar flickr.com
More detailed observations
Keep the tutor in the loop
Abelardo Pardo What if we could observe all events in a learning environment? 24
24. Pepe Ortuño flickr.com
A clearly identified
environment within
your computer
Abelardo Pardo What if we could observe all events in a learning environment? 25
25. Sean Dreilinger flickr.com
Automatic discovery
of complementary
learning resources
Abelardo Pardo What if we could observe all events in a learning environment? 26
26. IAN RANSLEY DESIGN + ILLUSTRATION flickr.com
Measure engagement in
out-of-class activities
Abelardo Pardo What if we could observe all events in a learning environment? 27
27. Just in time teaching
Abelardo Pardo What if we could observe all events in a learning environment? 28
37. Dru! flickr.com
Interventions!
Data set
Scenario manipulation
Abelardo Pardo What if we could observe all events in a learning environment? 38
38. net_efekt flickr.com
• 15 weeks. Sessions X, F 12-13:30
• 100 students
• 7 score tests per student
• Course notes with 30 “nodes” published
gradually
• 5 events: forum_view, forum_post,
visit_node, use_tool_1, use_tool_2
Make it your own course!
Abelardo Pardo What if we could observe all events in a learning environment? 39
39. jovike flickr.com
Events (events.csv.gz): around 81,000 x 4 matrix
datetime,event_type,user,payload
2011-09-05 15:26:01,use_tool_1,7a869b4d9,block_1
...
Scores (scores.csv.gz): 100 x 7 matrix
user,score_1,score_2,score_3,score_4,...,score_7
7a869b4d9, 6.4, 9.0, 7.9, 7.6, 5.1, 5.5, 6.7
...
Abelardo Pardo What if we could observe all events in a learning environment? 40
41. cesarastudillo flickr.com
Analyze, propose, discuss
Abelardo Pardo What if we could observe all events in a learning environment? 42
42. What did you observe?
theunquietlibrarian flickr.com
1
2 Which data is missing?
3 What would you do?
4 What would the system do?
Which challenge for LA do you envision?
Abelardo Pardo What if we could observe all events in a learning environment? 43
43. paral_lax flickr.com
script.R
1 Load data into “data frames”
2 Show data summaries
3 Change type of column in data frame
4 View sample histogram
5 Add a column with the mean scores
6 Plot scores for one student
7 Separate events into types
8 Merge event counts with scores
Select command + CRTL-Return (Execute)
Abelardo Pardo What if we could observe all events in a learning environment? 44
44. Calsidyrose flickr.com
R cheat sheet
• Data frame: heterogeneous matrix,
“events.csv”
• Data frame column: events.csv$event_type
• Arrays: c(’one’, ’two’, ’three’), c(1, 2, 3),
c(2:8)
• Sequences: 1:5, seq(1, 6)
• Graphics: barplot(), boxplot(), hist(), plot()
• Functions: length(), rownames(),
colnames(), mean()
• cor() (correlation), var() (variance)
• mean(), median(), min(), max(), sum()
Abelardo Pardo What if we could observe all events in a learning environment? 45
45. Calsidyrose flickr.com
R tests
• cor.test(v1, v2)
• wilcox.test(v1, v2)
• shapiro.test(v1)
R help
• help(any function name)
• Various cheatsheets included in workspace
(cheatsheet_*.pdf)
Abelardo Pardo What if we could observe all events in a learning environment? 46
46. References
The personal analytics of my life
Stephen Wolfram
http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/
How waiters read your table
Sara Nassauer
The Wall Street Journal, Feb. 22nd 2012
The illusion of privacy (and what we actually care about)
Seth Godin
http://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html
Academic Analytics
Campbell J., DeBlois P., Oblinger D.
EDUCAUSE White paper, 2007
Visible learning: A synthesis of over 800 meta-analyses related to achievement
Hattie, J. A. C.
Routledge, New York 2009
Learning analytics: Starvation and telling us what we already know?
David Jones
http://davidtjones.wordpress.com/2012/04/01/learning-analytics-starvation-and-telling-us-what-we-already-know/
Abelardo Pardo What if we could observe all events in a learning environment? 47