Understanding Students' Engagement with Personalised Feedback Messages Honourable Mention Full Paper The 10th International Learning Analytics and Knowledge Conference (LAK20)

1. Understanding Students'
Engagement with Personalised
Feedback Messages

2. Hamideh Iraj
PhD Student ,
School of
Information
Technology &
Mathematical
Sciences, UniSA
Dr Anthea Fudge
UniSA College,
UniSA
Our team
Dr Margaret
Faulkner
Business School,
UniSA
2
Prof. Abelardo
Pardo
Division of
Information
Technology,
Engineering and the
Environment, UniSA
Dr Vitomir
Kovanović
School of Education
and Teaching
Innovation Unit,
UniSA

3. Feedback Gap
Feedback
Actionability

4. Call to Action (CTA)

5. Research Questions
5
RQ1. How does student response to CTAs affect their
academic success?
RQ2. What student populations, as captured by
demographic and engagement measures are
responding to different CTAs?
RQ3. How do students perceive CTAs in feedback
messages?

6. The Course
• NASC 1009 – Introduction to Biosciences
• Introductory Science Course
• A blended course
• Diverse Student demographics
• N=218

7. CTA in feedback messages

8. OnTask

9. Message 5
Take the quiz
Message 3
Take the practice quiz
Message 2
See the resources
9
The Structure of feedback messages
Finish
Message 1
See the quiz requirements
Message 4
Review the practice quiz

10. 10
RQ1- Passing the course
Quiz 1 Quiz 2 Pass
CTA1 CTA2 CTA3 CTA4 CTA5 CTA1 CTA3 CTA4 CTA5
Student
1
0 0 1 0 1 1 0 0 0 1
Student
2
1 0 0 0 0 0 1 1 0 0
… …
Student
218
0 1 1 1 0 1 0 0 1 0

11. 11
RQ1- Passing the course

12. 12
RQ2- predicting Student Clicks
Predictors Target
CTA 1 CTA 2 CTA 3 CTA 4 CTA 5 CTA 1 CTA 3 CTA 4 CTA 5
Quiz 1
CTA 1
CTA 2
CTA 3
CTA 4
CTA 5
Quiz 2
CTA 1
CTA 3
CTA 4
CTA 5

13. Results – RQ2
13
Previous Engagement Female Students

14. 14
Focus Group Results
Three emergent themes:
● Challenging nature of the course
● Email messages as reminders
● The role of links in engaging with the course

15. 15
Key Findings
● Early engagement with the feedback messages was associated with
higher chances of passing.
● Female students were more likely to engage with feedback messages.
● Students found CTAs easy and engaging.

16. Contributions
● Empirical examination of students’ engagement with technology-
mediated feedback in online settings.
● Ask “why” questions based on the current patterns
● Early intervention for supporting students
● Use the current percentages as a baseline for experimentation and
continuous improvement

17. 17
Interested?
● Hamideh.iraj@mymail.unisa.edu.au
● @HamidehIraj
● researchgate.net/profile/Hamideh_Iraj
● Paper:
http://bit.ly/Feedback_Actionability
● Poster:
https://bit.ly/Feedback_Actionability_Poster

18. Thank you

19. This is where you give credit to the ones who are part of this project.
Did you like the resources on this template? Get them for free at our other
websites.
◂ Presentation template by Slidesgo
◂ Icons by Flaticon
◂ Images & infographics by Freepik
◂ Infographics by new7ducks - Freepik.com
◂ Photos created by pressfoto - Freepik.com
◂ Content slide photo created by chokniti - Freepik.com
◂ Team slide photos created by benzoix and nensuria - Freepik.com
◂ Author introduction slide photo created by katemangostar -
Freepik.com
◂ Image slide photo created by evening-tao - Freepik.com
Credits