O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

Lak12 jlsantos-v2

  • Seja o primeiro a comentar

Lak12 jlsantos-v2

  1. 1. http://www.slideshare.net/jlsantoso Goal-oriented visualizations of activitytracking: a case study with engineering students José Luis Santos, StenGovaerts, KatrienVerbert, Erik Duval 1
  2. 2. Motivation 1. Means: Information visualization 2. Goals 1. Awareness 2. Self-reflection 3. Sense-making but even more important… to engage students on these processes. 2
  3. 3. Related workLAMS DOKEOS MOODLE KHAN ACADEMY 3
  4. 4. 1. Upton et al. Narcissus: Group and Individual Models to Support Small Group Work. UMAP’09 http://goo.gl/ZzNbF2. Derick et al. GLASS: A first look through a Learning Analytics System. LAK’12 http://goo.gl/eY4w23. Mazza et al. Exploring usage analysis in learning systems. Workshop at AIED’05 http://goo.gl/ycrFQ 4
  5. 5. 1. Santos et al. Visualizing PLE usage. EFEPLE’11 workshop. http://goo.gl/PWbBF2. Govaerts et al. The student activity meter for awareness and reflection. ACM SIGCHI 2012. http://goo.gl/SGfta3. Duval et al. Learning dashboard and learnscapes. Workshop at ACM SIGCHI 2012. http://goo.gl/j7NeJ4. Duval. Attention please! Learning analytics for visualization and recommendation. LAK’11. http://goo.gl/Kfwii 5
  6. 6. Design based research methodology Design Implementation Deployment ObservationRequirements Analysis & Evaluation 7
  7. 7. One… two… three… and… four!1. Paper prototype – Professors and teacher assistants.2. Digital prototype – Professors and teacher assistants.3. First release – Students4. Second release – Students 8
  8. 8. 1st and 2nd iterations -Generic (CAM) -Usability -Think-aloud protocol. -15-30 minutes - 1st -> 7 participants - 2nd -> 5 participants 9
  9. 9. Results• Size of tables• Redundant information• Personalization• Context centralization vs diversification• Motion chart 10
  10. 10. Scenario Awareness and reflection Goal-orientedHow do students spend their time during the lab sessions? 11
  11. 11. Why and what do we track?• Individual and group spent time• Type of activity (development, writing, …)• Application• Program code• Websites + 12
  12. 12. How do we visualize this data?http://sourceforge.net/apps/mediawiki/role-project http://role-sandbox.eu/spaces/dashboardkul or http://goo.gl/qzP9H 13
  13. 13. 14
  14. 14. 15
  15. 15. 16
  16. 16. 17
  17. 17. 18
  18. 18. 19
  19. 19. 20
  20. 20. 21
  21. 21. First evaluation with real data• 36 students• Questionnaire after seeing a demo – From USE questionnaire• Perceived usefulness• Privacy concerns 22
  22. 22. Conclusions 23
  23. 23. • Useful• Helpful• Lab tracking• Usability? 24
  24. 24. Second evaluation with real data• 10 students• 4 lab sessions• 15 minutes• SUS• Perceived usefulness• Tracking/privacy concerns.• Questionnaire 25
  25. 25. Conclusions• SUS score: 72• Useful?• Detection of certain patterns 26
  26. 26. Conclusions 27
  27. 27. Final conclusions• Not included in this paper• 14 students• SUS: 66• Useful for: – Teachers (6) – Students (5) – Both (3)• Satisfaction: – 4.4 (over 7) 28
  28. 28. Although they consider ituseful, understandable, us able… 29
  29. 29. …students did not use the tool frequently WHY? 30
  30. 30. One student said:“We had other priorities” 31
  31. 31. How can we engage students in this process? 32
  32. 32. 33
  33. 33. Thank you! Any question? @jlsantoso @erikduval @katrien_v http://jlsantoso.blogspot.com http://erikduval.wordpress.com 34

×