Slides for the presentation by Simon Sneddon at the Learning in Law Annual Conference 2011.

2. BACKGROUND National Student Survey (NSS): Overall Student Satisfaction: 82% (2010) 81% (2009) Feedback (Q9, NSS) 58% (2010) 57% (2009) Students valued feedback least when they felt it wasn’t comprehensive or “effective in a formative sense,” (Hodgson and Bermingham, 2004) “ The [NSS] has highlighted that feedback is a key area of importance for both staff and students and is a key factor underpinning successful learning.” (HEA, 2010)

3. BACKGROUND “ There is a growing body of evidence which suggests that there is a growing concern about the quality of feedback to students and how it impacts on learning.” (Adcroft, 2010:251) 76% view feedback as “an absolutely crucial element of my whole student experience” (Adcroft 2010:260) Improving student perception of feedback is an important tool in improving the student experience.

4. BACKGROUND Some students find difficulty with handwritten feedback (Ivanič, et al, 2000) Many call “it ‘scribbles’, which are ‘difficult to read; ‘circles without explanations.’” (Handley et al, 2007) Some students, however, prefer handwritten feedback to typewritten feedback, and believe the former to suggest “increased level of personal connection to the instructor.” (Morgan & Toledo, 2006)

5. BACKGROUND Early results from a pilot study (October 2010 – July 2011) Pilot study group is a mixture of 22 LLB, BSc Environmental Science, BSc Applied Conservation Biology and FdSc Land Management students on a Level 5 designated module. Start point – Rotherham’s 2008, JISC-funded “Sounds Good: Quicker, better assessment using audio feedback” project “ students were overwhelmingly positive about receiving audio feedback on their coursework. They frequently remarked approvingly about its personal nature and the detail provided, evidence that the lecturer had carefully considered their work,” (Rotherham, 2009:2)

6. BACKGROUND Students responded well to the use of screen capture software in marking draft coursework (Stannard, 2007) Additional podcasting of lectures was widely welcomed by students (Watkins, 2010) The vast majority of students felt that the use of podcasts, wikis or blogs by their tutors was helpful to their learning (Bone, 2009) Student scoring of feedback improved using video feedback (Chapman and Busch, 2009)

8. THE FEEDBACK - TG

9. THE FEEDBACK - FG

10. THE FEEDBACK - SCG

11. THE FEEDBACK The essays were submitted in paper form. FG and SCG also submitted identical e-version Marking / moderation process completed, and essays ready for return in the seminar session on 16/12/10 Grade distribution was within expected range (cohort not exceptionally good or exceptionally poor) Selection of Feedback Type by Students TG 7 FG 4 SCG 11

12. THE FEEDBACK 7 TG essays returned with comments written-up by hand. These students were able to see at a glance their grade, and the comments of the first marker and moderator. 15 FG & SCG essays – grade given at end of feedback. “ sometimes students do not value the feedback that they receive, preferring instead to concentrate on marks rather than advice that may help them to improve future work.” (Nichol, 2007) Initial plan – put feedback on VLE), on individual blog **FILE SIZE** Revised plan – 4 smaller files on VLE, 7 larger ones burned to CD

13. THE QUESTIONNAIRE 1: Which type of feedback did you receive for your essay? TG FG SCG 2: How did you receive this feedback? Paper copy CD VLE 3.* Feedback on my assignment has helped me to clarify things I did not understand. 4.* Feedback on my assignment was prompt. 5.* I have received detailed comments on my work. 6.† How have you listened to the audio feedback so far? 7.† About how long was the feedback? 8.† How easy was it to listen to the audio feedback? 9. Have you had written feedback for previous pieces of coursework in other modules? (Y/N) 10. If YES, how does the video feedback compare with written feedback? 11. Do you have any other comments about receiving video feedback? *NSS Question † SoundsGood Question

14. RESPONSES TO THE QUESTIONNAIRE Average Student Responses to Q3-5 Column A – average score (1 = Definitely Agree, 5 = Definitely Disagree) Column B – % who agreed / mostly agreed with statement. Type of Feedback NSS TG FG SCG A B A B A B B Q3 1.8 80 1.5 100 2.0 85 Q4 1.6 100 1.5 100 1.3 85 Q5 1.8 100 2.5 50 1.9 85 Average 1.7 93 1.8 83 1.7 85 57

15. RESPONSES TO THE QUESTIONNAIRE Student Responses to Q10 “How does video feedback compare with written feedback?” Comments: “ it's like you're actually there, so better interaction” “ understood it more” Type of Feedback FG SCG Better 100 33 About the Same 0 50 Worse 0 17

18. INITIAL CONCLUSIONS, FUTURE WORK SOFTWARE COMPATIBILITY “ [Apple] do not allow Flash on iPhones, iPods and iPads” (Jobs, 2010) This issue is likely to affect only a very small number of students, and that it can be overcome by those students accessing the feedback on a desktop pc. One student had problem installing Flash onto pc.

19. INITIAL CONCLUSIONS, FUTURE WORK TECHNOPHOBIA Potential reluctance by some colleagues to use technology – but “technophobia is no longer a major consideration” (Armstrong and Lonsdale, 2003) TIMESCALE Some problems were user-related (i.e. Me) – solved by more practice. “ written comment on conventional coursework... is one of the most time-consuming methods” (Hodgson and Bermingham 2004) For a small module, the extra time is not great (+ see earlier – 93% of students thought feedback was “prompt”). Could be a problem for a larger module.

20. CLOSING THOUGHTS… Several questions this pilot has thrown up. Is video a viable option? Probably as part of a range of techniques that can be accessed by tutors Better suited to some subjects, courses or modules than others Further exploration perhaps on links to equality strands Next... Larger, longitudinal, inter-disciplinary study