Activity Metrics: measuring what learners do, not what teachers say they do. Using xAPI statements, stored in a Learner Record Store, and a combination of data sources, including OpenLabyrinth, WordPress, H5P widgets and IFTTT, we have been able to capture a wide range of activity streams during learning activities.

1. Activity Metrics:
measuring what learners do,
not what teachers say they do
David Topps, Corey Albersworth, Rachel Ellaway, Maureen Topps
CHES CoS, Vancouver, October 2016

2. Notices & Disclaimers

3. Problem?

4. Teachers are skilled observers

5. …especially when augmented

6. Teachers are poor judges

7. Some blame the forms…

8. Reading between the lines…
Ginsburg S, Regehr G, Lingard L, Eva KW. Reading between the lines: faculty
interpretations of narrative evaluation comments. Med Educ [Internet]. 2015 Mar
[cited 2016 Feb 19];49(3):296–306. Available from:
http://www.ncbi.nlm.nih.gov/pubmed/25693989

9. Lots of work with virtual patients

10. OpenLabyrinth tracks everything they do…
http://openlabyrinth.ca

11. What’s the fuss about Big Data?
TED talk by Kenneth Cukier
www.ted.com/talks/kenneth_cukier_big_data_is_better_data

12. The story of Charlie
http://openlabyrinth.ca

13. Medbiq
groups
medbiq.org

14. Experience API (xAPI)
• How to tie it all together
• Multiple data sources
• All pulled into a Learning Record Store (LRS)
• All free open-source
• Very simple programming
• Very simple statements
Bob Did This

15. Calgary examples – big Data

16. Scaling up meaning
Activities
EPAs?
Competencies
xAPI affordances arising from
common data standards across
systems & devices

17. Scaling up
Activities
Pre-entrustable
EPAs
Competencies
http://demo.openlabyrinth.ca/renderLabyrinth/index/725

18. Arduino demo
Are you stressed yet?
http://tiny.cc/rushR -- Rushing Roulette
http://tiny.cc/LLarry -- Lackadaisical Larry
http://tiny.cc/ActMet -- Activity Metrics