SlideShare uma empresa Scribd logo
1 de 32
Developing and delivering video feedback
                Simon Davis – University of York, UK
                          Simon.davis@york.ac.uk
Outline


•   Feedback; written vs video
•   Case study 1 – student presentations
•   Case study 2 – student work
•   Learning points
(Assessment &) feedback in HE


• Key to learning – constructive alignment (Biggs)
• Weakest area for student satisfaction (NSS)
• Feedback = “Any part of the learning process
  which is designed to guide student progress”
    – Adequacy, timeliness, usefulness, fairness*
• Significant issues around timeliness,
  individualisation, engagement, impact, staff
  workload…

* University of York guide to Assessment, Standards, Marking and Feedback
Written feedback : the problem
Lack of engagement with written feedback is related to
  its limitations:
• Discourse of wfb - tacit knowledge making criteria
  explicit (Chanock, 2000)
• Lack of shared understanding of criteria (Sadler,
  1989, 2010)
• Reinforces the distance between tutor expert and
  novice student
• (Mis) interpretation of feedback
• Disconnect between commentary and subject
• Lack of depth
Enhanced feedback


• Audio – “soundsgood” project
• Screencast feedback (McLaughlin 2009,
  Stannard 2007)
• Video feedback (Thiissen 2012, Lightfoot 2010)
Case study 1: Video feedback to develop
 student presentation skills (Physics)
•   Students n=125
•   Students give a presentation in term 1
•   These are recorded and uploaded onto the VLE
•   Feedback is given by staff, self reflection and peers
•   Students give a 2nd presentation in term 3 which
    builds on comments
Case study: Video feedback
2010/11– Learning objects blog


•   Students record presentations > batch converted
•   Batch allocate students to groups (*16)
•   Folders restricted to groups containing LO blogs
•   Multiple videos embedded within the blogs
    – Individual tutor feedback
    – Peer feedback
    – Personal reflection
2011/12 – Blackboard blog


• Blogs restricted to groups with Adaptive Release
  – Could use the My Groups area
• Multiple videos embedded within the blogs
  – Peer feedback
  – Personal reflection
  – Staff feedback provided later
Impact: comparing marks 2009 - 2010
Impact: student evaluation (n=40)

Select from the list below, anything that you feel helped you
to develop your presentation skills:

•   Watching own presentation (94%)
•   Feedback from staff (83%)
•   Feedback from peers (83%)
•   Reflecting on my own presentation performance (76%)
•   Assessing the performance of other students against a
    provided set of criteria (64%)
Impact: student comments

• “Watching the video was most useful. Several things I felt went wrong
  during the talk weren't noticeable at all, while some things I didn't notice
  were”.
• “The videos are especially good, and the fact that you can watch as many
  times as you like is very good. The ability to provide/ receive instant
  feedback is very helpful”.
• “Highlighted my weaknesses more effectively”.
• “It was useful having to analyse my own presentation rather than just
  forgetting about it. I was able to find faults myself which is more likely to
  help me improve next time. This wouldn’t have been possible without the
  talks being recorded”.
• “The VLE provided an interactive source of feedback which helped me
  improve my speaking skills. The videos also helped me to see where I was
  going wrong with my presentation”.
Case study 2: Screencast feedback on
     Academic Writing (Dept Education)
•   Masters ESOL classroom practice
•   ~20 international students
•   Mid term formative task – short academic essay
•   Written feedback after 1 week
•   Screencast feedback 1 week later
    – Via e-mail, VLE “too clunky”
Designing and delivering feedback /
                feedforward
• Review work and make notes / highlighting
• Prepare positive and development bullet points
• Prepare workspace and deliver feedback
    –   Greet student by name and introduce yourself
    –   State what feedback is on and how it is structured
    –   Comment on positive aspects
    –   Expand in detail on highlighted points
    –   Give brief summary with feedforward
(adapted from Cullen
http://www.bioscience.heacademy.ac.uk/ftp/events/roehampton/screencast.pdf)
Impact: Student Survey (n=15/20 )
1)attention to both types of fb
2) evaluating wfb versus sfb
Students read wfb three times+ 9/15
Students viewed sfb three times+ 12/ 15
  Q:If you were only able to receive one form of
  feedback, either written feedback comments or
  screen cast feedback, which of these two forms of
  feedback would you choose?
  9 chose sfb       4 chose wfb
(Kerr & McLaughlin study- three quarters chose sfb)
Impact: Student responses, strengths of
screencast fb (12)
• “I think the most obvious advantage is that
  students can feel engaged as if their tutor is
  talking to them face to face”
• “More straightforward and personal. It's like the
  tutor is talking to you in person. And the
  comments are directed to the parts of your
  article clearly.”
• “More memorable because it‟s like the teacher is
  talking to you and giving instructions to you.
  Sometimes I can't recognize teachers' writing
  in the written feedback.”
Learning from written feedback(12)
• Strengths of written feedback
  •   “I think the written feedback is more clear and specific about
    some small mistakes that I made (like some printing mistakes)
    while the screen cast tends to be focused mainly on the
    structure or some other macro aspects.
  • “You can read it anywhere you like (3) and it's easy to go
    back to check whereas the screen cast can only be read on
    your computer. Also, the information is more memorable to
    visual learners.”
• Meeting this with screencast feedback
  • Ask students to respond to feedback with action points
  • Provide bullet pointed scripts along with
Use of screencasts - reflections
• Benefits – “over the shoulder intimacy”
  – „quick and dirty‟ helps develop trust and authenticity
  – personal style / nuance
  – any innovation that shows tutor commitment engenders
    positive attitude towards tutors (France & Ribchester, 2008)
  – Sfb has all the benefits of audio fb -depth of explanation,
    personalisation etc. but with added visual element
  – Most appropriate for formative feedback
• Challenges
  – Production workload (rendering, distribution to students
    through VLE)
  – Getting “best of both” (written / screencast)
vGuidance Pilot project: online
  screencast creation & access control
• Bespoke system for (non-technical) careers
  advisers creating rich feedback (efficient, easy...)
• Respond to student CV submissions (username)
• Record feedback online (server side production)
   – Screencast-o-matic
• Generic E-mail with advice and link to students
• Students log in to access all feedback provided
• Opportunity for face to face follow up
Impact: student survey (n=12)


• vGuidance is:
  –   Convenient: 5
  –   Easy to use: 4.8
  –   Personal: 4.5
  –   Easy to understand feedback: 4.4
  –   Saves me time: 4.3
  –   Is engaging: 4.4
  –   Want future vGuidance feedback: 4.8
Impact: student comments

• “…the video was much more engaging”
• “I think it is good that I will be able to keep viewing it
  whilst I update my CV with the suggestions that
  were made rather than leaving an appointment and
  maybe not remembering what was said.”
• “Going through the CV in a visual manner helps to
  understand not only where to modify it, but also how
  in terms of spacial and lay-out aspects”
• “It is easier to apply to the document you are
  working on. It creates extensive feedback so you
  are not confused by notes made.”
Impact: staff response


• Careers advisers:
  – Saves time (10-15 mins cf.30-60 for text equivalent)
  – Less fear of getting tone right / misinterpretation
• Bill Soden
  – Removes production overheads
  – Removes access control issues
Potential for integration with Blackboard

Opportunities
• Single sign on potential for simpler integration with
  VLE
• Feedback could be organised by course,
  assignment etc.
Challenges
• Concerns over 3rd party API – funding
• Scalability
• Integration with Gradecentre
• Room for human error (username)
Final questions / comments


• How can the ability to create and provide
  feedback through Blackboard be improved?
References

•   Biggs, J.B. (2003). Teaching for quality learning at university. Buckingham: Open University
    Press/Society for Research into Higher Education. (Second edition)
• Channock, K, (2000) Comments on Essays: do students understand what tutors write?
    Teaching in Higher Education, 5: 1, 95-105.
• Cullen, R. Screencast feedback. Last accessed 2nd June 2011 from
http://www.bioscience.heacademy.ac.uk/ftp/events/roehampton/screencast.pdf
• France, D., & Ribchester, C. (2008). Podcasts and feedback. In G. Salmon & P.
    Edirisingha, (Eds.), Podcasting for learning in universities (pp 70-79). Berkshire: Open
    University Press.
• Kerr, W., & McLaughlin, P. (2009). The benefit of screen recorded summaries in feedback
    for work submitted electronically. Last accessed 15th May 2011 from
    http://ebookbrowse.com/kerr-w-mclaughlin-p-formatted-b1-pdf-d116387872
• Lunt, T, & Curran, J. (2010) „Are you listening please?‟ The advantages of electronic audio
    feedback compared to written feedback. Assessment and Evaluation in Higher Education,
    35: 7, 759-769.
• Sadler, R. (2010) Beyond Feedback: developing student capability in complex appraisal.
    Assessment and Evaluation in Higher Education, 35: 5, 535-550.
• Stannard (2007) Using screen capture software in student feedback: A case study from the
    HEA English Subject Centre. Last accessed 15th May, 2011
    http://www.english.heacademy.ac.uk/explore/publications/casestudies/technology/camtasia
    .php)
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback

Mais conteúdo relacionado

Mais procurados

Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...Dan Randall
 
Maisie Finalv2.0
Maisie Finalv2.0Maisie Finalv2.0
Maisie Finalv2.0annwarm
 
VoiceThread for Improving Deep Learning: a Flipped Classroom Model
VoiceThread for Improving Deep Learning: a Flipped Classroom ModelVoiceThread for Improving Deep Learning: a Flipped Classroom Model
VoiceThread for Improving Deep Learning: a Flipped Classroom ModelMichelle Pacansky-Brock
 
Moving Student Presentations Online
Moving Student Presentations OnlineMoving Student Presentations Online
Moving Student Presentations OnlineKim Kenward
 
Academic Integrity in Online Courses
Academic Integrity in Online CoursesAcademic Integrity in Online Courses
Academic Integrity in Online CoursesFoothill College
 
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary ReportChallenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary Reportengedukamall
 
Flipped education csm_2014_robertson
Flipped education csm_2014_robertsonFlipped education csm_2014_robertson
Flipped education csm_2014_robertsonEric Robertson
 
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...Juho Kim
 
Online evaluations: using proctoring tools, Open book assessments and Group E...
Online evaluations: using proctoring tools, Open book assessments and Group E...Online evaluations: using proctoring tools, Open book assessments and Group E...
Online evaluations: using proctoring tools, Open book assessments and Group E...Inge de Waard
 
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...BCcampus
 
Using Twitter for Teaching, Learning, and Professional Development
Using Twitter for Teaching, Learning, and Professional DevelopmentUsing Twitter for Teaching, Learning, and Professional Development
Using Twitter for Teaching, Learning, and Professional DevelopmentJason Rhode
 
Lessons Learned: Implementation of a Virtual Classroom
Lessons Learned: Implementation of a Virtual ClassroomLessons Learned: Implementation of a Virtual Classroom
Lessons Learned: Implementation of a Virtual Classroomahornton
 
Durham 2018 from pilot to service kelly hall
Durham 2018 from pilot to service  kelly hallDurham 2018 from pilot to service  kelly hall
Durham 2018 from pilot to service kelly hallKelly Hall
 
Want to know how to use Blackboard? Use Blackboard.
Want to know how to use Blackboard? Use Blackboard.Want to know how to use Blackboard? Use Blackboard.
Want to know how to use Blackboard? Use Blackboard.Candace Nolan-Grant
 
Using the SAMR model to innovate assessment design
Using the SAMR model to innovate assessment designUsing the SAMR model to innovate assessment design
Using the SAMR model to innovate assessment designLearningandTeaching
 
Celebrating accents: Using technologies to build student confidence in pronun...
Celebrating accents: Using technologies to build student confidence in pronun...Celebrating accents: Using technologies to build student confidence in pronun...
Celebrating accents: Using technologies to build student confidence in pronun...Tania Lee
 
Lecture Capture for NTU
Lecture Capture for NTULecture Capture for NTU
Lecture Capture for NTUwitthaus
 
The Instructor is In: Sustaining Presence in the Online Environment
The Instructor is In: Sustaining Presence in the Online EnvironmentThe Instructor is In: Sustaining Presence in the Online Environment
The Instructor is In: Sustaining Presence in the Online EnvironmentD2L Barry
 

Mais procurados (20)

Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
 
Maisie Finalv2.0
Maisie Finalv2.0Maisie Finalv2.0
Maisie Finalv2.0
 
VoiceThread for Improving Deep Learning: a Flipped Classroom Model
VoiceThread for Improving Deep Learning: a Flipped Classroom ModelVoiceThread for Improving Deep Learning: a Flipped Classroom Model
VoiceThread for Improving Deep Learning: a Flipped Classroom Model
 
Moving Student Presentations Online
Moving Student Presentations OnlineMoving Student Presentations Online
Moving Student Presentations Online
 
Academic Integrity in Online Courses
Academic Integrity in Online CoursesAcademic Integrity in Online Courses
Academic Integrity in Online Courses
 
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary ReportChallenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
 
Will video kill the manuscript scrawl?
Will video kill the manuscript scrawl?Will video kill the manuscript scrawl?
Will video kill the manuscript scrawl?
 
Flipped education csm_2014_robertson
Flipped education csm_2014_robertsonFlipped education csm_2014_robertson
Flipped education csm_2014_robertson
 
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
 
Online evaluations: using proctoring tools, Open book assessments and Group E...
Online evaluations: using proctoring tools, Open book assessments and Group E...Online evaluations: using proctoring tools, Open book assessments and Group E...
Online evaluations: using proctoring tools, Open book assessments and Group E...
 
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
 
Using Twitter for Teaching, Learning, and Professional Development
Using Twitter for Teaching, Learning, and Professional DevelopmentUsing Twitter for Teaching, Learning, and Professional Development
Using Twitter for Teaching, Learning, and Professional Development
 
Lessons Learned: Implementation of a Virtual Classroom
Lessons Learned: Implementation of a Virtual ClassroomLessons Learned: Implementation of a Virtual Classroom
Lessons Learned: Implementation of a Virtual Classroom
 
Durham 2018 from pilot to service kelly hall
Durham 2018 from pilot to service  kelly hallDurham 2018 from pilot to service  kelly hall
Durham 2018 from pilot to service kelly hall
 
Want to know how to use Blackboard? Use Blackboard.
Want to know how to use Blackboard? Use Blackboard.Want to know how to use Blackboard? Use Blackboard.
Want to know how to use Blackboard? Use Blackboard.
 
Podcasting ppp 08 - Derek France - Chester 08
Podcasting   ppp 08 - Derek France - Chester 08Podcasting   ppp 08 - Derek France - Chester 08
Podcasting ppp 08 - Derek France - Chester 08
 
Using the SAMR model to innovate assessment design
Using the SAMR model to innovate assessment designUsing the SAMR model to innovate assessment design
Using the SAMR model to innovate assessment design
 
Celebrating accents: Using technologies to build student confidence in pronun...
Celebrating accents: Using technologies to build student confidence in pronun...Celebrating accents: Using technologies to build student confidence in pronun...
Celebrating accents: Using technologies to build student confidence in pronun...
 
Lecture Capture for NTU
Lecture Capture for NTULecture Capture for NTU
Lecture Capture for NTU
 
The Instructor is In: Sustaining Presence in the Online Environment
The Instructor is In: Sustaining Presence in the Online EnvironmentThe Instructor is In: Sustaining Presence in the Online Environment
The Instructor is In: Sustaining Presence in the Online Environment
 

Destaque

Hello world
Hello worldHello world
Hello worldhemi46h
 
The way gender is constructed for an individual depend on gendered interactio...
The way gender is constructed for an individual depend on gendered interactio...The way gender is constructed for an individual depend on gendered interactio...
The way gender is constructed for an individual depend on gendered interactio...Mis T Masiapeto
 
Clp 1040 what is a documentary
Clp 1040   what is a documentaryClp 1040   what is a documentary
Clp 1040 what is a documentaryCivic Life Project
 
Ancient Civilization
Ancient CivilizationAncient Civilization
Ancient Civilizationnoctor
 
Clp keynote presentation 090113
Clp keynote presentation 090113Clp keynote presentation 090113
Clp keynote presentation 090113Civic Life Project
 
46h interaction 1.lesson Hello world
46h interaction 1.lesson Hello world46h interaction 1.lesson Hello world
46h interaction 1.lesson Hello worldhemi46h
 
Civic Life Project School presentation 090313
Civic Life Project School presentation 090313Civic Life Project School presentation 090313
Civic Life Project School presentation 090313Civic Life Project
 

Destaque (9)

Hello world
Hello worldHello world
Hello world
 
The way gender is constructed for an individual depend on gendered interactio...
The way gender is constructed for an individual depend on gendered interactio...The way gender is constructed for an individual depend on gendered interactio...
The way gender is constructed for an individual depend on gendered interactio...
 
Lesson 2
Lesson 2 Lesson 2
Lesson 2
 
Clp 1040 what is a documentary
Clp 1040   what is a documentaryClp 1040   what is a documentary
Clp 1040 what is a documentary
 
íDolos
íDolosíDolos
íDolos
 
Ancient Civilization
Ancient CivilizationAncient Civilization
Ancient Civilization
 
Clp keynote presentation 090113
Clp keynote presentation 090113Clp keynote presentation 090113
Clp keynote presentation 090113
 
46h interaction 1.lesson Hello world
46h interaction 1.lesson Hello world46h interaction 1.lesson Hello world
46h interaction 1.lesson Hello world
 
Civic Life Project School presentation 090313
Civic Life Project School presentation 090313Civic Life Project School presentation 090313
Civic Life Project School presentation 090313
 

Semelhante a S davis bblteurpoe2012_videofeedback

Group project topic 3
Group project topic 3Group project topic 3
Group project topic 3Shelly Pinner
 
Online Teaching Best Practices
Online Teaching Best PracticesOnline Teaching Best Practices
Online Teaching Best PracticesKristen Sosulski
 
Badging Study - within a Graduate Course
Badging Study - within a Graduate CourseBadging Study - within a Graduate Course
Badging Study - within a Graduate CourseEileen O'Connor
 
Online assessment
Online assessmentOnline assessment
Online assessmentNisha Singh
 
Hybrid Courses & Curriculum
Hybrid Courses & CurriculumHybrid Courses & Curriculum
Hybrid Courses & CurriculumChristopher Rice
 
Explain Everything & Plickers
Explain Everything & PlickersExplain Everything & Plickers
Explain Everything & Plickerstelshef
 
Nc fslt15 virtual conference
Nc fslt15 virtual conferenceNc fslt15 virtual conference
Nc fslt15 virtual conferenceNeil Currant
 
Judy Stern
Judy Stern Judy Stern
Judy Stern ccnmtl
 
A Technology Enhanced Approach to Improving Feedback Satisfaction:
A Technology Enhanced Approach to Improving Feedback Satisfaction: A Technology Enhanced Approach to Improving Feedback Satisfaction:
A Technology Enhanced Approach to Improving Feedback Satisfaction: John Morrison
 
Russell Stannard_ Key Technologies that can impact on teaching and learning
Russell Stannard_ Key Technologies that can impact on teaching and learningRussell Stannard_ Key Technologies that can impact on teaching and learning
Russell Stannard_ Key Technologies that can impact on teaching and learningeaquals
 
Bringing together internal and external students on Blackboard - Brett Fyfiel...
Bringing together internal and external students on Blackboard - Brett Fyfiel...Bringing together internal and external students on Blackboard - Brett Fyfiel...
Bringing together internal and external students on Blackboard - Brett Fyfiel...Blackboard APAC
 
EMPOWER E-Assessment week: Viewbrics
EMPOWER E-Assessment week: ViewbricsEMPOWER E-Assessment week: Viewbrics
EMPOWER E-Assessment week: ViewbricsEADTU
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEABlackboardEMEA
 
Best practices for teaching online
Best practices for teaching onlineBest practices for teaching online
Best practices for teaching onlineAlly Kimmel
 
CIT2017 - Virtual Reality & Student-Created Video for Learning
CIT2017 - Virtual Reality & Student-Created Video for LearningCIT2017 - Virtual Reality & Student-Created Video for Learning
CIT2017 - Virtual Reality & Student-Created Video for LearningEileen O'Connor
 
Getting started with blended, a presentation for NMSU
Getting started with blended, a presentation for NMSUGetting started with blended, a presentation for NMSU
Getting started with blended, a presentation for NMSUTanya Joosten
 
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...Diogo Casanova
 
Technology Enhanced Feedback Approaches: What Works & Why?
Technology Enhanced Feedback Approaches: What Works & Why?Technology Enhanced Feedback Approaches: What Works & Why?
Technology Enhanced Feedback Approaches: What Works & Why?Y1Feedback
 
What's the big deal about Blended Learning - Models, Results and Challenges
What's the big deal about Blended Learning - Models, Results and ChallengesWhat's the big deal about Blended Learning - Models, Results and Challenges
What's the big deal about Blended Learning - Models, Results and ChallengesTerry Anderson
 
Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Moving Student Presentations Online - Online Learning Consortium Blended Lear...Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Moving Student Presentations Online - Online Learning Consortium Blended Lear...Kim Kenward
 

Semelhante a S davis bblteurpoe2012_videofeedback (20)

Group project topic 3
Group project topic 3Group project topic 3
Group project topic 3
 
Online Teaching Best Practices
Online Teaching Best PracticesOnline Teaching Best Practices
Online Teaching Best Practices
 
Badging Study - within a Graduate Course
Badging Study - within a Graduate CourseBadging Study - within a Graduate Course
Badging Study - within a Graduate Course
 
Online assessment
Online assessmentOnline assessment
Online assessment
 
Hybrid Courses & Curriculum
Hybrid Courses & CurriculumHybrid Courses & Curriculum
Hybrid Courses & Curriculum
 
Explain Everything & Plickers
Explain Everything & PlickersExplain Everything & Plickers
Explain Everything & Plickers
 
Nc fslt15 virtual conference
Nc fslt15 virtual conferenceNc fslt15 virtual conference
Nc fslt15 virtual conference
 
Judy Stern
Judy Stern Judy Stern
Judy Stern
 
A Technology Enhanced Approach to Improving Feedback Satisfaction:
A Technology Enhanced Approach to Improving Feedback Satisfaction: A Technology Enhanced Approach to Improving Feedback Satisfaction:
A Technology Enhanced Approach to Improving Feedback Satisfaction:
 
Russell Stannard_ Key Technologies that can impact on teaching and learning
Russell Stannard_ Key Technologies that can impact on teaching and learningRussell Stannard_ Key Technologies that can impact on teaching and learning
Russell Stannard_ Key Technologies that can impact on teaching and learning
 
Bringing together internal and external students on Blackboard - Brett Fyfiel...
Bringing together internal and external students on Blackboard - Brett Fyfiel...Bringing together internal and external students on Blackboard - Brett Fyfiel...
Bringing together internal and external students on Blackboard - Brett Fyfiel...
 
EMPOWER E-Assessment week: Viewbrics
EMPOWER E-Assessment week: ViewbricsEMPOWER E-Assessment week: Viewbrics
EMPOWER E-Assessment week: Viewbrics
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEA
 
Best practices for teaching online
Best practices for teaching onlineBest practices for teaching online
Best practices for teaching online
 
CIT2017 - Virtual Reality & Student-Created Video for Learning
CIT2017 - Virtual Reality & Student-Created Video for LearningCIT2017 - Virtual Reality & Student-Created Video for Learning
CIT2017 - Virtual Reality & Student-Created Video for Learning
 
Getting started with blended, a presentation for NMSU
Getting started with blended, a presentation for NMSUGetting started with blended, a presentation for NMSU
Getting started with blended, a presentation for NMSU
 
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
 
Technology Enhanced Feedback Approaches: What Works & Why?
Technology Enhanced Feedback Approaches: What Works & Why?Technology Enhanced Feedback Approaches: What Works & Why?
Technology Enhanced Feedback Approaches: What Works & Why?
 
What's the big deal about Blended Learning - Models, Results and Challenges
What's the big deal about Blended Learning - Models, Results and ChallengesWhat's the big deal about Blended Learning - Models, Results and Challenges
What's the big deal about Blended Learning - Models, Results and Challenges
 
Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Moving Student Presentations Online - Online Learning Consortium Blended Lear...Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Moving Student Presentations Online - Online Learning Consortium Blended Lear...
 

Último

Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...fonyou31
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...christianmathematics
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...Sapna Thakur
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 

Último (20)

Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 

S davis bblteurpoe2012_videofeedback

  • 1. Developing and delivering video feedback Simon Davis – University of York, UK Simon.davis@york.ac.uk
  • 2. Outline • Feedback; written vs video • Case study 1 – student presentations • Case study 2 – student work • Learning points
  • 3. (Assessment &) feedback in HE • Key to learning – constructive alignment (Biggs) • Weakest area for student satisfaction (NSS) • Feedback = “Any part of the learning process which is designed to guide student progress” – Adequacy, timeliness, usefulness, fairness* • Significant issues around timeliness, individualisation, engagement, impact, staff workload… * University of York guide to Assessment, Standards, Marking and Feedback
  • 4. Written feedback : the problem Lack of engagement with written feedback is related to its limitations: • Discourse of wfb - tacit knowledge making criteria explicit (Chanock, 2000) • Lack of shared understanding of criteria (Sadler, 1989, 2010) • Reinforces the distance between tutor expert and novice student • (Mis) interpretation of feedback • Disconnect between commentary and subject • Lack of depth
  • 5. Enhanced feedback • Audio – “soundsgood” project • Screencast feedback (McLaughlin 2009, Stannard 2007) • Video feedback (Thiissen 2012, Lightfoot 2010)
  • 6. Case study 1: Video feedback to develop student presentation skills (Physics) • Students n=125 • Students give a presentation in term 1 • These are recorded and uploaded onto the VLE • Feedback is given by staff, self reflection and peers • Students give a 2nd presentation in term 3 which builds on comments
  • 7. Case study: Video feedback
  • 8. 2010/11– Learning objects blog • Students record presentations > batch converted • Batch allocate students to groups (*16) • Folders restricted to groups containing LO blogs • Multiple videos embedded within the blogs – Individual tutor feedback – Peer feedback – Personal reflection
  • 9. 2011/12 – Blackboard blog • Blogs restricted to groups with Adaptive Release – Could use the My Groups area • Multiple videos embedded within the blogs – Peer feedback – Personal reflection – Staff feedback provided later
  • 10. Impact: comparing marks 2009 - 2010
  • 11. Impact: student evaluation (n=40) Select from the list below, anything that you feel helped you to develop your presentation skills: • Watching own presentation (94%) • Feedback from staff (83%) • Feedback from peers (83%) • Reflecting on my own presentation performance (76%) • Assessing the performance of other students against a provided set of criteria (64%)
  • 12. Impact: student comments • “Watching the video was most useful. Several things I felt went wrong during the talk weren't noticeable at all, while some things I didn't notice were”. • “The videos are especially good, and the fact that you can watch as many times as you like is very good. The ability to provide/ receive instant feedback is very helpful”. • “Highlighted my weaknesses more effectively”. • “It was useful having to analyse my own presentation rather than just forgetting about it. I was able to find faults myself which is more likely to help me improve next time. This wouldn’t have been possible without the talks being recorded”. • “The VLE provided an interactive source of feedback which helped me improve my speaking skills. The videos also helped me to see where I was going wrong with my presentation”.
  • 13. Case study 2: Screencast feedback on Academic Writing (Dept Education) • Masters ESOL classroom practice • ~20 international students • Mid term formative task – short academic essay • Written feedback after 1 week • Screencast feedback 1 week later – Via e-mail, VLE “too clunky”
  • 14. Designing and delivering feedback / feedforward • Review work and make notes / highlighting • Prepare positive and development bullet points • Prepare workspace and deliver feedback – Greet student by name and introduce yourself – State what feedback is on and how it is structured – Comment on positive aspects – Expand in detail on highlighted points – Give brief summary with feedforward (adapted from Cullen http://www.bioscience.heacademy.ac.uk/ftp/events/roehampton/screencast.pdf)
  • 15. Impact: Student Survey (n=15/20 ) 1)attention to both types of fb 2) evaluating wfb versus sfb Students read wfb three times+ 9/15 Students viewed sfb three times+ 12/ 15 Q:If you were only able to receive one form of feedback, either written feedback comments or screen cast feedback, which of these two forms of feedback would you choose? 9 chose sfb 4 chose wfb (Kerr & McLaughlin study- three quarters chose sfb)
  • 16. Impact: Student responses, strengths of screencast fb (12) • “I think the most obvious advantage is that students can feel engaged as if their tutor is talking to them face to face” • “More straightforward and personal. It's like the tutor is talking to you in person. And the comments are directed to the parts of your article clearly.” • “More memorable because it‟s like the teacher is talking to you and giving instructions to you. Sometimes I can't recognize teachers' writing in the written feedback.”
  • 17. Learning from written feedback(12) • Strengths of written feedback • “I think the written feedback is more clear and specific about some small mistakes that I made (like some printing mistakes) while the screen cast tends to be focused mainly on the structure or some other macro aspects. • “You can read it anywhere you like (3) and it's easy to go back to check whereas the screen cast can only be read on your computer. Also, the information is more memorable to visual learners.” • Meeting this with screencast feedback • Ask students to respond to feedback with action points • Provide bullet pointed scripts along with
  • 18. Use of screencasts - reflections • Benefits – “over the shoulder intimacy” – „quick and dirty‟ helps develop trust and authenticity – personal style / nuance – any innovation that shows tutor commitment engenders positive attitude towards tutors (France & Ribchester, 2008) – Sfb has all the benefits of audio fb -depth of explanation, personalisation etc. but with added visual element – Most appropriate for formative feedback • Challenges – Production workload (rendering, distribution to students through VLE) – Getting “best of both” (written / screencast)
  • 19. vGuidance Pilot project: online screencast creation & access control • Bespoke system for (non-technical) careers advisers creating rich feedback (efficient, easy...) • Respond to student CV submissions (username) • Record feedback online (server side production) – Screencast-o-matic • Generic E-mail with advice and link to students • Students log in to access all feedback provided • Opportunity for face to face follow up
  • 20. Impact: student survey (n=12) • vGuidance is: – Convenient: 5 – Easy to use: 4.8 – Personal: 4.5 – Easy to understand feedback: 4.4 – Saves me time: 4.3 – Is engaging: 4.4 – Want future vGuidance feedback: 4.8
  • 21. Impact: student comments • “…the video was much more engaging” • “I think it is good that I will be able to keep viewing it whilst I update my CV with the suggestions that were made rather than leaving an appointment and maybe not remembering what was said.” • “Going through the CV in a visual manner helps to understand not only where to modify it, but also how in terms of spacial and lay-out aspects” • “It is easier to apply to the document you are working on. It creates extensive feedback so you are not confused by notes made.”
  • 22. Impact: staff response • Careers advisers: – Saves time (10-15 mins cf.30-60 for text equivalent) – Less fear of getting tone right / misinterpretation • Bill Soden – Removes production overheads – Removes access control issues
  • 23. Potential for integration with Blackboard Opportunities • Single sign on potential for simpler integration with VLE • Feedback could be organised by course, assignment etc. Challenges • Concerns over 3rd party API – funding • Scalability • Integration with Gradecentre • Room for human error (username)
  • 24. Final questions / comments • How can the ability to create and provide feedback through Blackboard be improved?
  • 25. References • Biggs, J.B. (2003). Teaching for quality learning at university. Buckingham: Open University Press/Society for Research into Higher Education. (Second edition) • Channock, K, (2000) Comments on Essays: do students understand what tutors write? Teaching in Higher Education, 5: 1, 95-105. • Cullen, R. Screencast feedback. Last accessed 2nd June 2011 from http://www.bioscience.heacademy.ac.uk/ftp/events/roehampton/screencast.pdf • France, D., & Ribchester, C. (2008). Podcasts and feedback. In G. Salmon & P. Edirisingha, (Eds.), Podcasting for learning in universities (pp 70-79). Berkshire: Open University Press. • Kerr, W., & McLaughlin, P. (2009). The benefit of screen recorded summaries in feedback for work submitted electronically. Last accessed 15th May 2011 from http://ebookbrowse.com/kerr-w-mclaughlin-p-formatted-b1-pdf-d116387872 • Lunt, T, & Curran, J. (2010) „Are you listening please?‟ The advantages of electronic audio feedback compared to written feedback. Assessment and Evaluation in Higher Education, 35: 7, 759-769. • Sadler, R. (2010) Beyond Feedback: developing student capability in complex appraisal. Assessment and Evaluation in Higher Education, 35: 5, 535-550. • Stannard (2007) Using screen capture software in student feedback: A case study from the HEA English Subject Centre. Last accessed 15th May, 2011 http://www.english.heacademy.ac.uk/explore/publications/casestudies/technology/camtasia .php)