SlideShare a Scribd company logo
1 of 10
Using Comparative Judgement to Assess Student e-Portfolios Matt Wingfield Managing Director โ€“ TAG Developments Susan McLaren Senior Lecturer - University of Edinburgh
The evolution of TAGโ€™s e-portfolio solutions ,[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Capturing Project Based Learning Introducing Project e-Scape
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Capturing Project Based Learning Introducing Project e-Scape
[object Object],[object Object],[object Object],[object Object],Capturing Project Based Learning Introducing Project e-Scape
Assessment vs. Evaluation Comparative Pairs Assessment ,[object Object],[object Object],[object Object],[object Object],[object Object]
Assessment vs. Evaluation Comparative Pairs Assessment portfolio A portfolio B TAG has created a web-based comparative pairs engine, that facilitates highly accurate paired assessment of e-portfolios for the first time on a national scale!
The Comparative Pairs Engine  dynamically  refines the ranking of the student work  through a series of judging rounds. What emerges is a  collective professional consensus  of an expert group of judges. Produces a reliability coefficient of 0.95 Assessment vs. Evaluation Comparative Pairs Assessment
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Comparative Pairs Assessment of e-portfolios: where is it being used
Contact Information & Useful Links Matt Wingfield Managing Director โ€“ TAG Developments [email_address] Tel: 07850 488 502 Susan McLaren Senior Lecturer โ€“ University of Edinburgh [email_address] 0131 651 6615 http://www.mapsassessment.com http://www.tagdevelopments.com

More Related Content

What's hot

Week 11 multimedia presentation shives
Week 11 multimedia presentation shivesWeek 11 multimedia presentation shives
Week 11 multimedia presentation shives
jshives11
ย 
Creating a Leading Applied Computing Department (Tony Clark, Head of Departme...
Creating a Leading Applied Computing Department (Tony Clark, Head of Departme...Creating a Leading Applied Computing Department (Tony Clark, Head of Departme...
Creating a Leading Applied Computing Department (Tony Clark, Head of Departme...
Michael Clark
ย 
Tqr project palm e-learningv1
Tqr project palm e-learningv1Tqr project palm e-learningv1
Tqr project palm e-learningv1
Colleen Hodgins
ย 
Pitfalls Of Blended Learning
Pitfalls Of Blended LearningPitfalls Of Blended Learning
Pitfalls Of Blended Learning
cniemczik
ย 
NTLTC 2011 - iPads and blended learning
NTLTC 2011 - iPads and blended learningNTLTC 2011 - iPads and blended learning
NTLTC 2011 - iPads and blended learning
NTLT Conference
ย 

What's hot (20)

Staying relevant in a technology-driven world
Staying relevant in a technology-driven worldStaying relevant in a technology-driven world
Staying relevant in a technology-driven world
ย 
YACRS at ALT-C 2015
YACRS at ALT-C 2015YACRS at ALT-C 2015
YACRS at ALT-C 2015
ย 
Computer Access for Students with Disabilities: An Adaptive Technology Labora...
Computer Access for Students with Disabilities: An Adaptive Technology Labora...Computer Access for Students with Disabilities: An Adaptive Technology Labora...
Computer Access for Students with Disabilities: An Adaptive Technology Labora...
ย 
Mindset, skillset, toolset: transforming the digital landscape
Mindset, skillset, toolset: transforming the digital landscapeMindset, skillset, toolset: transforming the digital landscape
Mindset, skillset, toolset: transforming the digital landscape
ย 
Week 11 multimedia presentation shives
Week 11 multimedia presentation shivesWeek 11 multimedia presentation shives
Week 11 multimedia presentation shives
ย 
Creating a Leading Applied Computing Department (Tony Clark, Head of Departme...
Creating a Leading Applied Computing Department (Tony Clark, Head of Departme...Creating a Leading Applied Computing Department (Tony Clark, Head of Departme...
Creating a Leading Applied Computing Department (Tony Clark, Head of Departme...
ย 
Enhance - the ETF's digital teaching platform
Enhance - the ETF's digital teaching platformEnhance - the ETF's digital teaching platform
Enhance - the ETF's digital teaching platform
ย 
Jisc summer of student innovation-alt-c2015
Jisc summer of student innovation-alt-c2015Jisc summer of student innovation-alt-c2015
Jisc summer of student innovation-alt-c2015
ย 
Projects policy and digital literacy
Projects policy and digital literacyProjects policy and digital literacy
Projects policy and digital literacy
ย 
Apprenticeship journey in a digital age
Apprenticeship journey in a digital ageApprenticeship journey in a digital age
Apprenticeship journey in a digital age
ย 
Analysing feedback
Analysing feedbackAnalysing feedback
Analysing feedback
ย 
Transforming learning, teaching and assessment through reflective practice - ...
Transforming learning, teaching and assessment through reflective practice - ...Transforming learning, teaching and assessment through reflective practice - ...
Transforming learning, teaching and assessment through reflective practice - ...
ย 
Alt C2009 0033 E Portfolios Kc Ac
Alt C2009 0033 E Portfolios Kc AcAlt C2009 0033 E Portfolios Kc Ac
Alt C2009 0033 E Portfolios Kc Ac
ย 
Using staff and student technology enhanced learning (TEL) narratives to info...
Using staff and student technology enhanced learning (TEL) narratives to info...Using staff and student technology enhanced learning (TEL) narratives to info...
Using staff and student technology enhanced learning (TEL) narratives to info...
ย 
Tqr project palm e-learningv1
Tqr project palm e-learningv1Tqr project palm e-learningv1
Tqr project palm e-learningv1
ย 
Delivering RARPA: a college-wide digital approach
Delivering RARPA: a college-wide digital approachDelivering RARPA: a college-wide digital approach
Delivering RARPA: a college-wide digital approach
ย 
Sakai project sites for portfolios
Sakai project sites for portfoliosSakai project sites for portfolios
Sakai project sites for portfolios
ย 
Pitfalls Of Blended Learning
Pitfalls Of Blended LearningPitfalls Of Blended Learning
Pitfalls Of Blended Learning
ย 
Enhancing learning through innovative technologies: observations from UCS & b...
Enhancing learning through innovative technologies: observations from UCS & b...Enhancing learning through innovative technologies: observations from UCS & b...
Enhancing learning through innovative technologies: observations from UCS & b...
ย 
NTLTC 2011 - iPads and blended learning
NTLTC 2011 - iPads and blended learningNTLTC 2011 - iPads and blended learning
NTLTC 2011 - iPads and blended learning
ย 

Viewers also liked (6)

Self assessment (Portfolio) By Miss Muntira Wongsawieng TESOL 7
Self assessment (Portfolio) By Miss Muntira Wongsawieng TESOL 7Self assessment (Portfolio) By Miss Muntira Wongsawieng TESOL 7
Self assessment (Portfolio) By Miss Muntira Wongsawieng TESOL 7
ย 
Word Class (Technical terms)
Word Class (Technical terms)Word Class (Technical terms)
Word Class (Technical terms)
ย 
Sputnik
SputnikSputnik
Sputnik
ย 
Primary & secondary research examples
Primary & secondary research examplesPrimary & secondary research examples
Primary & secondary research examples
ย 
Sherlock Homes - The Sign Of Four
Sherlock Homes - The Sign Of FourSherlock Homes - The Sign Of Four
Sherlock Homes - The Sign Of Four
ย 
The Sign of Four
The Sign of FourThe Sign of Four
The Sign of Four
ย 

Similar to Using Comparative Judgement to Assess Student e-Portfolios

Final E Portfolios Presentation
Final E Portfolios PresentationFinal E Portfolios Presentation
Final E Portfolios Presentation
Charlotte Vaughn
ย 
E Portfolios Storyboard Presentation Update Week 9
E Portfolios Storyboard Presentation Update Week 9E Portfolios Storyboard Presentation Update Week 9
E Portfolios Storyboard Presentation Update Week 9
Charlotte Vaughn
ย 
E Portfolios Storyboard Presentation Update Week 9
E Portfolios Storyboard Presentation Update Week 9E Portfolios Storyboard Presentation Update Week 9
E Portfolios Storyboard Presentation Update Week 9
Charlotte Vaughn
ย 
From constructivist research to formative
From constructivist research to formativeFrom constructivist research to formative
From constructivist research to formative
Ma_Belle
ย 
BMCC, City College of New York, LaGuardia CC
BMCC, City College of New York, LaGuardia CCBMCC, City College of New York, LaGuardia CC
BMCC, City College of New York, LaGuardia CC
Jiyeon Lee
ย 
Have skills, will Travel: E-portfolios for apprentices
Have skills, will Travel: E-portfolios for apprenticesHave skills, will Travel: E-portfolios for apprentices
Have skills, will Travel: E-portfolios for apprentices
Becta FE and Skills
ย 
Coventry 27 11 2008
Coventry 27 11 2008Coventry 27 11 2008
Coventry 27 11 2008
nix1
ย 
1 Peoria Mobile Technology As An Rt I Assessment Tool For[1]
1 Peoria Mobile Technology As An Rt I Assessment Tool For[1]1 Peoria Mobile Technology As An Rt I Assessment Tool For[1]
1 Peoria Mobile Technology As An Rt I Assessment Tool For[1]
guest539850
ย 
Portppt564
Portppt564Portppt564
Portppt564
Carla Piper
ย 

Similar to Using Comparative Judgement to Assess Student e-Portfolios (20)

Online Evaluation/Assessment by Mudasir Amin (Durpora shopian)
Online Evaluation/Assessment by Mudasir Amin (Durpora shopian)Online Evaluation/Assessment by Mudasir Amin (Durpora shopian)
Online Evaluation/Assessment by Mudasir Amin (Durpora shopian)
ย 
WebPA - A Practical Approach to Peer Assessment
WebPA - A Practical Approach to Peer AssessmentWebPA - A Practical Approach to Peer Assessment
WebPA - A Practical Approach to Peer Assessment
ย 
Tools to Enhance Assessment in Moodle
Tools to Enhance Assessment in MoodleTools to Enhance Assessment in Moodle
Tools to Enhance Assessment in Moodle
ย 
Final E Portfolios Presentation
Final E Portfolios PresentationFinal E Portfolios Presentation
Final E Portfolios Presentation
ย 
E Portfolios Storyboard Presentation Update Week 9
E Portfolios Storyboard Presentation Update Week 9E Portfolios Storyboard Presentation Update Week 9
E Portfolios Storyboard Presentation Update Week 9
ย 
E Portfolios Storyboard Presentation Update Week 9
E Portfolios Storyboard Presentation Update Week 9E Portfolios Storyboard Presentation Update Week 9
E Portfolios Storyboard Presentation Update Week 9
ย 
JISC assessment news, updates and development priorities
JISC assessment news, updates and development prioritiesJISC assessment news, updates and development priorities
JISC assessment news, updates and development priorities
ย 
TeSLA project: an adaptive trust-based e-assessment system for learning
TeSLA project: an adaptive trust-based e-assessment system for learningTeSLA project: an adaptive trust-based e-assessment system for learning
TeSLA project: an adaptive trust-based e-assessment system for learning
ย 
From constructivist research to formative
From constructivist research to formativeFrom constructivist research to formative
From constructivist research to formative
ย 
Transforming Education through Disruptive Technologies
Transforming Education through Disruptive TechnologiesTransforming Education through Disruptive Technologies
Transforming Education through Disruptive Technologies
ย 
BMCC, City College of New York, LaGuardia CC
BMCC, City College of New York, LaGuardia CCBMCC, City College of New York, LaGuardia CC
BMCC, City College of New York, LaGuardia CC
ย 
C04622028
C04622028C04622028
C04622028
ย 
Sp110328
Sp110328Sp110328
Sp110328
ย 
Have skills, will Travel: E-portfolios for apprentices
Have skills, will Travel: E-portfolios for apprenticesHave skills, will Travel: E-portfolios for apprentices
Have skills, will Travel: E-portfolios for apprentices
ย 
Educators Pave the Way for Next Generation of Learners
Educators Pave the Way for Next Generation of LearnersEducators Pave the Way for Next Generation of Learners
Educators Pave the Way for Next Generation of Learners
ย 
Coventry 27 11 2008
Coventry 27 11 2008Coventry 27 11 2008
Coventry 27 11 2008
ย 
Developing the E-Learning Experience
Developing the E-Learning ExperienceDeveloping the E-Learning Experience
Developing the E-Learning Experience
ย 
Merv Stapleton from City of Sunderland College discusses The Comport Project
Merv Stapleton from City of Sunderland College discusses The Comport ProjectMerv Stapleton from City of Sunderland College discusses The Comport Project
Merv Stapleton from City of Sunderland College discusses The Comport Project
ย 
1 Peoria Mobile Technology As An Rt I Assessment Tool For[1]
1 Peoria Mobile Technology As An Rt I Assessment Tool For[1]1 Peoria Mobile Technology As An Rt I Assessment Tool For[1]
1 Peoria Mobile Technology As An Rt I Assessment Tool For[1]
ย 
Portppt564
Portppt564Portppt564
Portppt564
ย 

More from Kenji Lamb

More from Kenji Lamb (20)

Beyond Simple MCQs
Beyond Simple MCQsBeyond Simple MCQs
Beyond Simple MCQs
ย 
eLearning Alliance CLD Group - Assessment Tools
eLearning Alliance CLD Group - Assessment ToolseLearning Alliance CLD Group - Assessment Tools
eLearning Alliance CLD Group - Assessment Tools
ย 
Reduce Reuse
Reduce ReuseReduce Reuse
Reduce Reuse
ย 
Peer Collaboration and Assessment
Peer Collaboration and AssessmentPeer Collaboration and Assessment
Peer Collaboration and Assessment
ย 
The NXT Step - Assessing with Lego Robots
The NXT Step - Assessing with Lego RobotsThe NXT Step - Assessing with Lego Robots
The NXT Step - Assessing with Lego Robots
ย 
Tips for Creating and Delivering Effective Mobile Assessments
Tips for Creating and Delivering Effective Mobile AssessmentsTips for Creating and Delivering Effective Mobile Assessments
Tips for Creating and Delivering Effective Mobile Assessments
ย 
A Dummies Guide to Secure Digital eAssessment
A Dummies Guide to Secure Digital eAssessmentA Dummies Guide to Secure Digital eAssessment
A Dummies Guide to Secure Digital eAssessment
ย 
Red Pen Tool Case Study - Oldham Hulme Grammar Schools
Red Pen Tool Case Study - Oldham Hulme Grammar SchoolsRed Pen Tool Case Study - Oldham Hulme Grammar Schools
Red Pen Tool Case Study - Oldham Hulme Grammar Schools
ย 
24-hour Papers: the Open-Book Alternative to Exams for Online Assessment
24-hour Papers: the Open-Book Alternative to Exams for Online Assessment24-hour Papers: the Open-Book Alternative to Exams for Online Assessment
24-hour Papers: the Open-Book Alternative to Exams for Online Assessment
ย 
Personalising the Assessment Experience: Closing the Gap Between Learning, As...
Personalising the Assessment Experience: Closing the Gap Between Learning, As...Personalising the Assessment Experience: Closing the Gap Between Learning, As...
Personalising the Assessment Experience: Closing the Gap Between Learning, As...
ย 
Mahara in Action
Mahara in ActionMahara in Action
Mahara in Action
ย 
Getting Vocal About Feedback
Getting Vocal About FeedbackGetting Vocal About Feedback
Getting Vocal About Feedback
ย 
e-Assessment for Recruitment, Training and Testing in Private and Public Sect...
e-Assessment for Recruitment, Training and Testing in Private and Public Sect...e-Assessment for Recruitment, Training and Testing in Private and Public Sect...
e-Assessment for Recruitment, Training and Testing in Private and Public Sect...
ย 
Assessment Futures: The Role for e-Assessment?
Assessment Futures: The Role for e-Assessment?Assessment Futures: The Role for e-Assessment?
Assessment Futures: The Role for e-Assessment?
ย 
Building the e-Assessment Centre
Building the e-Assessment CentreBuilding the e-Assessment Centre
Building the e-Assessment Centre
ย 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
ย 
Authentic Assessment in Law: SIMPLE
Authentic Assessment in Law: SIMPLEAuthentic Assessment in Law: SIMPLE
Authentic Assessment in Law: SIMPLE
ย 
Open Source Software and Beyond
Open Source Software and BeyondOpen Source Software and Beyond
Open Source Software and Beyond
ย 
Introducing Matterhorn
Introducing MatterhornIntroducing Matterhorn
Introducing Matterhorn
ย 
Looking SWEET with my BigBlueButton
Looking SWEET with my BigBlueButtonLooking SWEET with my BigBlueButton
Looking SWEET with my BigBlueButton
ย 

Recently uploaded

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
ย 

Recently uploaded (20)

REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
ย 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
ย 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
ย 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
ย 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
ย 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
ย 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
ย 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
ย 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
ย 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
ย 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
ย 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
ย 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
ย 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
ย 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
ย 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
ย 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
ย 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
ย 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
ย 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
ย 

Using Comparative Judgement to Assess Student e-Portfolios

  • 1. Using Comparative Judgement to Assess Student e-Portfolios Matt Wingfield Managing Director โ€“ TAG Developments Susan McLaren Senior Lecturer - University of Edinburgh
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7. Assessment vs. Evaluation Comparative Pairs Assessment portfolio A portfolio B TAG has created a web-based comparative pairs engine, that facilitates highly accurate paired assessment of e-portfolios for the first time on a national scale!
  • 8. The Comparative Pairs Engine dynamically refines the ranking of the student work through a series of judging rounds. What emerges is a collective professional consensus of an expert group of judges. Produces a reliability coefficient of 0.95 Assessment vs. Evaluation Comparative Pairs Assessment
  • 9.
  • 10. Contact Information & Useful Links Matt Wingfield Managing Director โ€“ TAG Developments [email_address] Tel: 07850 488 502 Susan McLaren Senior Lecturer โ€“ University of Edinburgh [email_address] 0131 651 6615 http://www.mapsassessment.com http://www.tagdevelopments.com