SlideShare uma empresa Scribd logo
1 de 28
Audio feedback – better feedback?*

    Susanne Voelkel & Luciane V. Mello
         School of Life Sciences




        *funded by the eLearing Steering Group, UoL
“Feedback is one of the most
    powerful influences on learning
         and achievement”*



* Hattie & Timperley, 2007
Effective feedback answers 3 questions*:
• Where am I going?
     – (the goals)
• How am I going?
     – “feed-back”
• Where to next?
     – “feed- forward”




 * Hattie & Timperley, 2007
Good quality feedback – students’ view*

•   Detailed information on how to improve
•   Applicable to future work
•   Personal
•   Timely




* Student focus group, School of Life Sciences
But…. all is not well!
UoL
Can audio feedback help us provide
        better feedback?
Research questions

• Will audio feedback
  – Work?
  – Save staff time?
  – Increase student satisfaction?
  – Help students learn better?
Research design
• Two case studies
  – Undergraduate level
  – Postgraduate level
1. The undergraduate level project
• Year 3, class size 70
• Low stake (10%) essay, exam conditions
  (handwritten)
• Class split randomly in half
  – 50% written feedback (comments)
  – 50% audio feedback (bullet points on script)
• Evaluation
2. The postgraduate level project
• M-level module
• Class size 14
• Group work assessment
  – Individual component
  – Purely formative
• All students receive audio feedback only
• Evaluation
Methods
• Recording the feedback
  – Mobile digital voice recorder
  – Audio files (mp3 format)
  – Measure time (UG)
• Dissemination
  – By email
• Listening to the feedback
  – Mp3 player or computer
Evaluation
• Questionnaire
  – Response rate
     • 44% undergraduate
     • 93% postgraduate
• Interviews (10, UG)
• Marks (UG)
Did it work? The technical side.


• No problems from staff or student side
Did audio feedback save staff time?

           Time (min)      Standard           N
                           deviation
Audio      16              +8                 31
feedback
Written    11              +3                 31
feedback

           Significant difference (p=0.002)
Did audio feedback increase student
            satisfaction?
After reading/ listening to my
      feedback, I fully understand my mark


            Postgrad



              audio                                  agree
                                                     neither
Under-                                               disagree
graduates
             written



                       0   20   40   60   80   100
I understand what I need to do to get a
             better mark in the future


            Postgrad




              audio                                  agree
                                                     neither
Under-                                               disagree
graduates
             written



                       0   20   40   60   80   100
The amount of feedback I got was


            Postgrad
                                                     definitely not
                                                     enough
                                                     not really enough
              audio
                                                     just right
Under-
graduates
             written                                 too much



                       0   20   40   60   80   100
The feedback I got was detailed
                   enough

            Postgrad



              audio                                  agree
                                                     neither
Under-                                               disagree
graduates
             written



                       0   20   40   60   80   100
My feedback was clear


            Postgrad



              audio                                  agree
                                                     neither
Under-                                               disagree
graduates
             written


                       0   20   40   60   80   100
Written comments on audio feedback
                  Undergraduates
   “It (the audio feedback) was very personal, I
   knew exactly what I had to do to make my
   mark better”

  “you get a lot more honest opinion about (your
  work) and a lot more information I think on how
  to improve”

  “…written feedback means that you have it there just
  to look at all the time and it’s a bit harder to go back
  and look at the audio feedback”
Written comments on audio feedback
                  Postgraduates


   “Audio FB was very useful, I strongly feel more
   lecturers should adopt it as part of their
   teaching methods”


  “Audio FB was fantastic and more detailed than
  just writing a few lines in text format”
Effects on student learning?
                                     F
                    80               e
                                     e
                    70
                                     d
                    60
                                     b
                                     a
 Average mark (%)




                    50               c
                                     k
                                                     audio
                    40
                                                     written
                    30

                    20

                    10

                     0
                         Formative       Summative
Research questions – the answers

• Will audio feedback
  – Work?                            yes
  – Save staff time?                 no
  – Increase student satisfaction?   yes
  – Help students learn better?      perhaps
Thank you
svoelkel@liv.ac.uk

Mais conteúdo relacionado

Mais de Educational Development Division, University of Liverpool

Mais de Educational Development Division, University of Liverpool (20)

Cath gordon teaching and learning conference ppt 2012
Cath gordon teaching and learning conference ppt 2012 Cath gordon teaching and learning conference ppt 2012
Cath gordon teaching and learning conference ppt 2012
 
Tammy thiele june 2012
Tammy thiele  june 2012Tammy thiele  june 2012
Tammy thiele june 2012
 
Josie billington reading for pleasure in schools june 2012
Josie billington reading for pleasure in schools june 2012Josie billington reading for pleasure in schools june 2012
Josie billington reading for pleasure in schools june 2012
 
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
 
Developing strategies and activities to improve interactions between home and...
Developing strategies and activities to improve interactions between home and...Developing strategies and activities to improve interactions between home and...
Developing strategies and activities to improve interactions between home and...
 
FOCAL - Feedback on clinical achievements @ Liverpool
FOCAL - Feedback on clinical achievements @ LiverpoolFOCAL - Feedback on clinical achievements @ Liverpool
FOCAL - Feedback on clinical achievements @ Liverpool
 
The students widening participation forgot? Continuing Education and communit...
The students widening participation forgot? Continuing Education and communit...The students widening participation forgot? Continuing Education and communit...
The students widening participation forgot? Continuing Education and communit...
 
Mike knight
Mike knightMike knight
Mike knight
 
Vaughn l&t 21012 presentation
Vaughn l&t 21012 presentationVaughn l&t 21012 presentation
Vaughn l&t 21012 presentation
 
Glynis cousin keynote
Glynis cousin keynoteGlynis cousin keynote
Glynis cousin keynote
 
Alison hobden
Alison hobdenAlison hobden
Alison hobden
 
Arora anu
Arora anuArora anu
Arora anu
 
M hammond
M hammondM hammond
M hammond
 
Lt conf 2011 drywood presentation
Lt conf 2011 drywood presentationLt conf 2011 drywood presentation
Lt conf 2011 drywood presentation
 
L'pool grounding teaching in learning
L'pool   grounding teaching in learningL'pool   grounding teaching in learning
L'pool grounding teaching in learning
 
L'pool grounding teaching in learning
L'pool   grounding teaching in learningL'pool   grounding teaching in learning
L'pool grounding teaching in learning
 
L+t2011(csu)
L+t2011(csu)L+t2011(csu)
L+t2011(csu)
 
201011 t&l conference_dgh_ac_export
201011 t&l conference_dgh_ac_export201011 t&l conference_dgh_ac_export
201011 t&l conference_dgh_ac_export
 
L&tconference 2011 lv_mello
L&tconference 2011 lv_melloL&tconference 2011 lv_mello
L&tconference 2011 lv_mello
 
290611 deg conference
290611 deg conference290611 deg conference
290611 deg conference
 

Último

SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentationcamerronhm
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and ModificationsMJDuyan
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxPooja Bhuva
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxEsquimalt MFRC
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxmarlenawright1
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfNirmal Dwivedi
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...Poonam Aher Patil
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...Amil baba
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.MaryamAhmad92
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSCeline George
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jisc
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxJisc
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfSherif Taha
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfDr Vijay Vishwakarma
 
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxannathomasp01
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfPoh-Sun Goh
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxPooja Bhuva
 

Último (20)

SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 

Audio feedback – better feedback?

  • 1. Audio feedback – better feedback?* Susanne Voelkel & Luciane V. Mello School of Life Sciences *funded by the eLearing Steering Group, UoL
  • 2. “Feedback is one of the most powerful influences on learning and achievement”* * Hattie & Timperley, 2007
  • 3. Effective feedback answers 3 questions*: • Where am I going? – (the goals) • How am I going? – “feed-back” • Where to next? – “feed- forward” * Hattie & Timperley, 2007
  • 4. Good quality feedback – students’ view* • Detailed information on how to improve • Applicable to future work • Personal • Timely * Student focus group, School of Life Sciences
  • 5. But…. all is not well!
  • 6.
  • 7.
  • 8. UoL
  • 9. Can audio feedback help us provide better feedback?
  • 10. Research questions • Will audio feedback – Work? – Save staff time? – Increase student satisfaction? – Help students learn better?
  • 11. Research design • Two case studies – Undergraduate level – Postgraduate level
  • 12. 1. The undergraduate level project • Year 3, class size 70 • Low stake (10%) essay, exam conditions (handwritten) • Class split randomly in half – 50% written feedback (comments) – 50% audio feedback (bullet points on script) • Evaluation
  • 13. 2. The postgraduate level project • M-level module • Class size 14 • Group work assessment – Individual component – Purely formative • All students receive audio feedback only • Evaluation
  • 14. Methods • Recording the feedback – Mobile digital voice recorder – Audio files (mp3 format) – Measure time (UG) • Dissemination – By email • Listening to the feedback – Mp3 player or computer
  • 15. Evaluation • Questionnaire – Response rate • 44% undergraduate • 93% postgraduate • Interviews (10, UG) • Marks (UG)
  • 16. Did it work? The technical side. • No problems from staff or student side
  • 17. Did audio feedback save staff time? Time (min) Standard N deviation Audio 16 +8 31 feedback Written 11 +3 31 feedback Significant difference (p=0.002)
  • 18. Did audio feedback increase student satisfaction?
  • 19. After reading/ listening to my feedback, I fully understand my mark Postgrad audio agree neither Under- disagree graduates written 0 20 40 60 80 100
  • 20. I understand what I need to do to get a better mark in the future Postgrad audio agree neither Under- disagree graduates written 0 20 40 60 80 100
  • 21. The amount of feedback I got was Postgrad definitely not enough not really enough audio just right Under- graduates written too much 0 20 40 60 80 100
  • 22. The feedback I got was detailed enough Postgrad audio agree neither Under- disagree graduates written 0 20 40 60 80 100
  • 23. My feedback was clear Postgrad audio agree neither Under- disagree graduates written 0 20 40 60 80 100
  • 24. Written comments on audio feedback Undergraduates “It (the audio feedback) was very personal, I knew exactly what I had to do to make my mark better” “you get a lot more honest opinion about (your work) and a lot more information I think on how to improve” “…written feedback means that you have it there just to look at all the time and it’s a bit harder to go back and look at the audio feedback”
  • 25. Written comments on audio feedback Postgraduates “Audio FB was very useful, I strongly feel more lecturers should adopt it as part of their teaching methods” “Audio FB was fantastic and more detailed than just writing a few lines in text format”
  • 26. Effects on student learning? F 80 e e 70 d 60 b a Average mark (%) 50 c k audio 40 written 30 20 10 0 Formative Summative
  • 27. Research questions – the answers • Will audio feedback – Work? yes – Save staff time? no – Increase student satisfaction? yes – Help students learn better? perhaps