SlideShare a Scribd company logo
1 of 35
Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1  and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde CAA Conference, Loughborough 5 th  July 2005
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
 
Experiential Practicing Mimicking Experiencing Productive Creating Producing Writing Drawing Composing Synthesising Communicative Discussing Presenting Debating Adaptive Modelling Simulation Info Handling Gathering Ordering Classifying Selecting  Analysing Manipulating Not assessed Diagnostic Formative Summative Adaptive Simulation Modelling Virtual worlds Communicative Chat Chat Email  Discussion boards Mailing lists Weblogs Productive Spreadsheets Databases Narrative Audio  Image Text Video Web page Interactive Libraries Portals Search engines Indiv learner Group leader Coach Participant Mentor Supervisor Rapporteur Facilitator Deliverer Pair person Presenter Peer assessor  Moderator 1 – many Group based Class based 1-1 S to S 1-1 S to T Individual Artefact Assignment Brainstorming Buzz words Defending Dissertation Drill & practice Essay Exercise Fishbowl Ice breaker MCQ Mindmaps Negotiating Pair dialogues Performance Portfolio Product Question & answer Resource-based Role play Rounds Short answer Snowball Debate Test Voting Assimilative Reading Viewing  Listening Assessment Tools & Resources Roles Interaction Technique Type Types of learning activities
 
CAA barriers and enablers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Modelling online assessment ,[object Object],[object Object],[object Object],[object Object],[object Object]
items Anatomy of an online assessment system
Items items item validator item viewer item author Anatomy of an online assessment system
Items assessments items item validator item viewer item author Anatomy of an online assessment system
Items Assessments assessments items item validator item viewer item author test viewer test validator test author Anatomy of an online assessment system
Items Assessments Test instance System, user & group admin invigilator groups test instance assessments items learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system responses and  results
Items Assessments Responses and results Test instance System, user & group admin invigilator responses and  results groups test instance assessments items marks modifier statistics monitor marks monitor marker answer monitor learner feedback administrator learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system
 
TOIA  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Evaluation aims ,[object Object],[object Object],[object Object],[object Object],[object Object]
Evaluation methodology ,[object Object],[object Object],[object Object],[object Object],[object Object]
Emergent themes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Training ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Uses ,[object Object],[object Object],[object Object],[object Object],[object Object]
Barriers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Enablers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Issues ,[object Object],[object Object],[object Object],[object Object]
Teaching strategies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Strategies for designing questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Student experience ,[object Object],[object Object],[object Object],[object Object]
Question types ,[object Object],[object Object],[object Object],[object Object],[object Object]
Interoperability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Questionbanks ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
TOIA specific issues ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
TOIA benefits ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
TOIA disadvantages ,[object Object],[object Object]
Emergent questions ,[object Object],[object Object],[object Object],[object Object]
Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1  and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde www.toia.ac.uk [email_address] Sclater.com

More Related Content

What's hot

Bridging the gap: e-learning research
Bridging the gap: e-learning researchBridging the gap: e-learning research
Bridging the gap: e-learning researchgrainne
 
Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Centre for Distance Education
 
Pedagogy of online teaching
Pedagogy of online teachingPedagogy of online teaching
Pedagogy of online teachingLorna Kearns
 
RALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
RALF (Redesigning Assessment and Learning with feedback in the VLEs) ProjectRALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
RALF (Redesigning Assessment and Learning with feedback in the VLEs) ProjectDiogo Casanova
 
Culture and learning organisations
Culture and learning organisationsCulture and learning organisations
Culture and learning organisationsRamanpreet saini
 
The Future Looks Digital - TCCTA
The Future Looks Digital - TCCTAThe Future Looks Digital - TCCTA
The Future Looks Digital - TCCTAdrpmcgee
 
Conole connected june_2010
Conole connected june_2010Conole connected june_2010
Conole connected june_2010grainne
 
An ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebAn ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebbpanulla
 
Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Blackboard APAC
 
The integrative learning design framework
The integrative learning design frameworkThe integrative learning design framework
The integrative learning design frameworkandreaarcos2015
 
Semantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
Semantic Techniques for Enabling Knowledge Reuse in Conceptual ModellingSemantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
Semantic Techniques for Enabling Knowledge Reuse in Conceptual ModellingOscar Corcho
 
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
Learning Analytics in Education:  Using Student’s Big Data to Improve TeachingLearning Analytics in Education:  Using Student’s Big Data to Improve Teaching
Learning Analytics in Education: Using Student’s Big Data to Improve TeachingRafael Scapin, Ph.D.
 
The future of assessment: five principles, five targets for 2025
The future of assessment: five principles, five targets for 2025The future of assessment: five principles, five targets for 2025
The future of assessment: five principles, five targets for 2025Jisc
 
ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyEd Foster
 
Comparative and Non-Comparative Evaluation Studies
Comparative and Non-Comparative Evaluation StudiesComparative and Non-Comparative Evaluation Studies
Comparative and Non-Comparative Evaluation Studiesu068717
 
Project-based Collaborative Learning Environment with Context-aware Education...
Project-based Collaborative Learning Environment with Context-aware Education...Project-based Collaborative Learning Environment with Context-aware Education...
Project-based Collaborative Learning Environment with Context-aware Education...Zoran Jeremic
 
RIDE 2010 presentation - Formative assessment practices in distance learning:...
RIDE 2010 presentation - Formative assessment practices in distance learning:...RIDE 2010 presentation - Formative assessment practices in distance learning:...
RIDE 2010 presentation - Formative assessment practices in distance learning:...Centre for Distance Education
 
Exploring learning analytics
Exploring learning analyticsExploring learning analytics
Exploring learning analyticsJisc
 

What's hot (20)

Bridging the gap: e-learning research
Bridging the gap: e-learning researchBridging the gap: e-learning research
Bridging the gap: e-learning research
 
Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?
 
Pedagogy of online teaching
Pedagogy of online teachingPedagogy of online teaching
Pedagogy of online teaching
 
RALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
RALF (Redesigning Assessment and Learning with feedback in the VLEs) ProjectRALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
RALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
 
Culture and learning organisations
Culture and learning organisationsCulture and learning organisations
Culture and learning organisations
 
The Future Looks Digital - TCCTA
The Future Looks Digital - TCCTAThe Future Looks Digital - TCCTA
The Future Looks Digital - TCCTA
 
Florida Virtual School Research
Florida Virtual School ResearchFlorida Virtual School Research
Florida Virtual School Research
 
Conole connected june_2010
Conole connected june_2010Conole connected june_2010
Conole connected june_2010
 
An ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebAn ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeontheweb
 
Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...
 
The integrative learning design framework
The integrative learning design frameworkThe integrative learning design framework
The integrative learning design framework
 
Semantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
Semantic Techniques for Enabling Knowledge Reuse in Conceptual ModellingSemantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
Semantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
 
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
Learning Analytics in Education:  Using Student’s Big Data to Improve TeachingLearning Analytics in Education:  Using Student’s Big Data to Improve Teaching
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
 
The future of assessment: five principles, five targets for 2025
The future of assessment: five principles, five targets for 2025The future of assessment: five principles, five targets for 2025
The future of assessment: five principles, five targets for 2025
 
ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of Derby
 
E assessment
E assessmentE assessment
E assessment
 
Comparative and Non-Comparative Evaluation Studies
Comparative and Non-Comparative Evaluation StudiesComparative and Non-Comparative Evaluation Studies
Comparative and Non-Comparative Evaluation Studies
 
Project-based Collaborative Learning Environment with Context-aware Education...
Project-based Collaborative Learning Environment with Context-aware Education...Project-based Collaborative Learning Environment with Context-aware Education...
Project-based Collaborative Learning Environment with Context-aware Education...
 
RIDE 2010 presentation - Formative assessment practices in distance learning:...
RIDE 2010 presentation - Formative assessment practices in distance learning:...RIDE 2010 presentation - Formative assessment practices in distance learning:...
RIDE 2010 presentation - Formative assessment practices in distance learning:...
 
Exploring learning analytics
Exploring learning analyticsExploring learning analytics
Exploring learning analytics
 

Similar to Evaluation of the TOIA project

Blended Learning For Faculty
Blended Learning For FacultyBlended Learning For Faculty
Blended Learning For FacultyEDUCAUSE
 
Online Course Assessment Part 1
Online Course Assessment  Part 1Online Course Assessment  Part 1
Online Course Assessment Part 1drpmcgee
 
Creating Assessments
Creating AssessmentsCreating Assessments
Creating AssessmentsChristina Sax
 
Blended by Design: Day 3
Blended by Design: Day 3Blended by Design: Day 3
Blended by Design: Day 3EDUCAUSE
 
Assessment of Holistic Student Learning in Open Universities
Assessment of Holistic Student Learning in Open UniversitiesAssessment of Holistic Student Learning in Open Universities
Assessment of Holistic Student Learning in Open UniversitiesWawasan Open University
 
MCC Blended Learning
MCC Blended LearningMCC Blended Learning
MCC Blended Learningdrvdiazbus
 
EDUCAUSE 08
EDUCAUSE 08EDUCAUSE 08
EDUCAUSE 08EDUCAUSE
 
Online Course Assessment Part 2
Online Course Assessment Part 2Online Course Assessment Part 2
Online Course Assessment Part 2drpmcgee
 
Fed Stimulus & Oer Workshop
Fed Stimulus & Oer WorkshopFed Stimulus & Oer Workshop
Fed Stimulus & Oer WorkshopRuth Romi
 
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...Shawndra Bowers
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEABlackboardEMEA
 
Helping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCTHelping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCTcies
 
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...Traian Rebedea
 
What Makes a Quality Online Course: The Student Perspective
What Makes a Quality Online Course: The Student PerspectiveWhat Makes a Quality Online Course: The Student Perspective
What Makes a Quality Online Course: The Student PerspectivePenny Ralston-Berg
 
2010 Edu tools
2010 Edu tools2010 Edu tools
2010 Edu toolsWCET
 
Market Opportunity Profile
Market Opportunity Profile Market Opportunity Profile
Market Opportunity Profile Wendy Colby
 
Market Opportunity Profile
Market Opportunity ProfileMarket Opportunity Profile
Market Opportunity ProfileWendy Colby
 
Bringing Blackboard to Bath
Bringing Blackboard to BathBringing Blackboard to Bath
Bringing Blackboard to Bathkateboardman
 

Similar to Evaluation of the TOIA project (20)

Blended Learning For Faculty
Blended Learning For FacultyBlended Learning For Faculty
Blended Learning For Faculty
 
Online Course Assessment Part 1
Online Course Assessment  Part 1Online Course Assessment  Part 1
Online Course Assessment Part 1
 
Creating Assessments
Creating AssessmentsCreating Assessments
Creating Assessments
 
Blended by Design: Day 3
Blended by Design: Day 3Blended by Design: Day 3
Blended by Design: Day 3
 
Assessment of Holistic Student Learning in Open Universities
Assessment of Holistic Student Learning in Open UniversitiesAssessment of Holistic Student Learning in Open Universities
Assessment of Holistic Student Learning in Open Universities
 
Facets of Educational Technology
Facets of Educational TechnologyFacets of Educational Technology
Facets of Educational Technology
 
MCC Blended Learning
MCC Blended LearningMCC Blended Learning
MCC Blended Learning
 
EDUCAUSE 08
EDUCAUSE 08EDUCAUSE 08
EDUCAUSE 08
 
Online Course Assessment Part 2
Online Course Assessment Part 2Online Course Assessment Part 2
Online Course Assessment Part 2
 
Fed Stimulus & Oer Workshop
Fed Stimulus & Oer WorkshopFed Stimulus & Oer Workshop
Fed Stimulus & Oer Workshop
 
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEA
 
Helping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCTHelping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCT
 
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
 
Educause 08 Part 1
Educause 08 Part 1Educause 08 Part 1
Educause 08 Part 1
 
What Makes a Quality Online Course: The Student Perspective
What Makes a Quality Online Course: The Student PerspectiveWhat Makes a Quality Online Course: The Student Perspective
What Makes a Quality Online Course: The Student Perspective
 
2010 Edu tools
2010 Edu tools2010 Edu tools
2010 Edu tools
 
Market Opportunity Profile
Market Opportunity Profile Market Opportunity Profile
Market Opportunity Profile
 
Market Opportunity Profile
Market Opportunity ProfileMarket Opportunity Profile
Market Opportunity Profile
 
Bringing Blackboard to Bath
Bringing Blackboard to BathBringing Blackboard to Bath
Bringing Blackboard to Bath
 

More from grainne

Conole sydney
Conole sydneyConole sydney
Conole sydneygrainne
 
Conole ld overview
Conole ld overviewConole ld overview
Conole ld overviewgrainne
 
Conole compendium ld
Conole compendium ldConole compendium ld
Conole compendium ldgrainne
 
Conole poe
Conole poeConole poe
Conole poegrainne
 
Conole svea
Conole sveaConole svea
Conole sveagrainne
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_novgrainne
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_novgrainne
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_novgrainne
 
Theory methodology
Theory methodologyTheory methodology
Theory methodologygrainne
 
Conole ld
Conole ldConole ld
Conole ldgrainne
 
Oer panel
Oer panelOer panel
Oer panelgrainne
 
Conole creativity
Conole creativityConole creativity
Conole creativitygrainne
 
Conole keynote icde_sept_28
Conole keynote icde_sept_28Conole keynote icde_sept_28
Conole keynote icde_sept_28grainne
 
Conole keynote bali
Conole keynote baliConole keynote bali
Conole keynote baligrainne
 
Conole iaidis 22_july
Conole iaidis 22_julyConole iaidis 22_july
Conole iaidis 22_julygrainne
 
2 09 groinne conole_july_final_2011
2 09 groinne conole_july_final_20112 09 groinne conole_july_final_2011
2 09 groinne conole_july_final_2011grainne
 
Conole opal
Conole opalConole opal
Conole opalgrainne
 
Conole finland workshop
Conole finland workshopConole finland workshop
Conole finland workshopgrainne
 
Conole finland 5_june
Conole finland 5_juneConole finland 5_june
Conole finland 5_junegrainne
 

More from grainne (20)

Conole sydney
Conole sydneyConole sydney
Conole sydney
 
Conole ld overview
Conole ld overviewConole ld overview
Conole ld overview
 
Conole compendium ld
Conole compendium ldConole compendium ld
Conole compendium ld
 
Conole poe
Conole poeConole poe
Conole poe
 
Conole svea
Conole sveaConole svea
Conole svea
 
Conole
ConoleConole
Conole
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_nov
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_nov
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_nov
 
Theory methodology
Theory methodologyTheory methodology
Theory methodology
 
Conole ld
Conole ldConole ld
Conole ld
 
Oer panel
Oer panelOer panel
Oer panel
 
Conole creativity
Conole creativityConole creativity
Conole creativity
 
Conole keynote icde_sept_28
Conole keynote icde_sept_28Conole keynote icde_sept_28
Conole keynote icde_sept_28
 
Conole keynote bali
Conole keynote baliConole keynote bali
Conole keynote bali
 
Conole iaidis 22_july
Conole iaidis 22_julyConole iaidis 22_july
Conole iaidis 22_july
 
2 09 groinne conole_july_final_2011
2 09 groinne conole_july_final_20112 09 groinne conole_july_final_2011
2 09 groinne conole_july_final_2011
 
Conole opal
Conole opalConole opal
Conole opal
 
Conole finland workshop
Conole finland workshopConole finland workshop
Conole finland workshop
 
Conole finland 5_june
Conole finland 5_juneConole finland 5_june
Conole finland 5_june
 

Recently uploaded

NO1 Certified kala jadu karne wale ka contact number kala jadu karne wale bab...
NO1 Certified kala jadu karne wale ka contact number kala jadu karne wale bab...NO1 Certified kala jadu karne wale ka contact number kala jadu karne wale bab...
NO1 Certified kala jadu karne wale ka contact number kala jadu karne wale bab...Amil baba
 
(办理学位证)加拿大萨省大学毕业证成绩单原版一比一
(办理学位证)加拿大萨省大学毕业证成绩单原版一比一(办理学位证)加拿大萨省大学毕业证成绩单原版一比一
(办理学位证)加拿大萨省大学毕业证成绩单原版一比一S SDS
 
(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)twfkn8xj
 
Governor Olli Rehn: Dialling back monetary restraint
Governor Olli Rehn: Dialling back monetary restraintGovernor Olli Rehn: Dialling back monetary restraint
Governor Olli Rehn: Dialling back monetary restraintSuomen Pankki
 
Economic Risk Factor Update: April 2024 [SlideShare]
Economic Risk Factor Update: April 2024 [SlideShare]Economic Risk Factor Update: April 2024 [SlideShare]
Economic Risk Factor Update: April 2024 [SlideShare]Commonwealth
 
2024 Q1 Crypto Industry Report | CoinGecko
2024 Q1 Crypto Industry Report | CoinGecko2024 Q1 Crypto Industry Report | CoinGecko
2024 Q1 Crypto Industry Report | CoinGeckoCoinGecko
 
Overview of Inkel Unlisted Shares Price.
Overview of Inkel Unlisted Shares Price.Overview of Inkel Unlisted Shares Price.
Overview of Inkel Unlisted Shares Price.Precize Formely Leadoff
 
Role of Information and technology in banking and finance .pptx
Role of Information and technology in banking and finance .pptxRole of Information and technology in banking and finance .pptx
Role of Information and technology in banking and finance .pptxNarayaniTripathi2
 
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...Amil baba
 
Kempen ' UK DB Endgame Paper Apr 24 final3.pdf
Kempen ' UK DB Endgame Paper Apr 24 final3.pdfKempen ' UK DB Endgame Paper Apr 24 final3.pdf
Kempen ' UK DB Endgame Paper Apr 24 final3.pdfHenry Tapper
 
Bladex 1Q24 Earning Results Presentation
Bladex 1Q24 Earning Results PresentationBladex 1Q24 Earning Results Presentation
Bladex 1Q24 Earning Results PresentationBladex
 
The Core Functions of the Bangko Sentral ng Pilipinas
The Core Functions of the Bangko Sentral ng PilipinasThe Core Functions of the Bangko Sentral ng Pilipinas
The Core Functions of the Bangko Sentral ng PilipinasCherylouCamus
 
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfBPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfHenry Tapper
 
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...Henry Tapper
 
The AES Investment Code - the go-to counsel for the most well-informed, wise...
The AES Investment Code -  the go-to counsel for the most well-informed, wise...The AES Investment Code -  the go-to counsel for the most well-informed, wise...
The AES Investment Code - the go-to counsel for the most well-informed, wise...AES International
 
AnyConv.com__FSS Advance Retail & Distribution - 15.06.17.ppt
AnyConv.com__FSS Advance Retail & Distribution - 15.06.17.pptAnyConv.com__FSS Advance Retail & Distribution - 15.06.17.ppt
AnyConv.com__FSS Advance Retail & Distribution - 15.06.17.pptPriyankaSharma89719
 
原版1:1复刻温哥华岛大学毕业证Vancouver毕业证留信学历认证
原版1:1复刻温哥华岛大学毕业证Vancouver毕业证留信学历认证原版1:1复刻温哥华岛大学毕业证Vancouver毕业证留信学历认证
原版1:1复刻温哥华岛大学毕业证Vancouver毕业证留信学历认证rjrjkk
 
Stock Market Brief Deck FOR 4/17 video.pdf
Stock Market Brief Deck FOR 4/17 video.pdfStock Market Brief Deck FOR 4/17 video.pdf
Stock Market Brief Deck FOR 4/17 video.pdfMichael Silva
 

Recently uploaded (20)

NO1 Certified kala jadu karne wale ka contact number kala jadu karne wale bab...
NO1 Certified kala jadu karne wale ka contact number kala jadu karne wale bab...NO1 Certified kala jadu karne wale ka contact number kala jadu karne wale bab...
NO1 Certified kala jadu karne wale ka contact number kala jadu karne wale bab...
 
(办理学位证)加拿大萨省大学毕业证成绩单原版一比一
(办理学位证)加拿大萨省大学毕业证成绩单原版一比一(办理学位证)加拿大萨省大学毕业证成绩单原版一比一
(办理学位证)加拿大萨省大学毕业证成绩单原版一比一
 
(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)
 
Governor Olli Rehn: Dialling back monetary restraint
Governor Olli Rehn: Dialling back monetary restraintGovernor Olli Rehn: Dialling back monetary restraint
Governor Olli Rehn: Dialling back monetary restraint
 
Economic Risk Factor Update: April 2024 [SlideShare]
Economic Risk Factor Update: April 2024 [SlideShare]Economic Risk Factor Update: April 2024 [SlideShare]
Economic Risk Factor Update: April 2024 [SlideShare]
 
2024 Q1 Crypto Industry Report | CoinGecko
2024 Q1 Crypto Industry Report | CoinGecko2024 Q1 Crypto Industry Report | CoinGecko
2024 Q1 Crypto Industry Report | CoinGecko
 
Overview of Inkel Unlisted Shares Price.
Overview of Inkel Unlisted Shares Price.Overview of Inkel Unlisted Shares Price.
Overview of Inkel Unlisted Shares Price.
 
Role of Information and technology in banking and finance .pptx
Role of Information and technology in banking and finance .pptxRole of Information and technology in banking and finance .pptx
Role of Information and technology in banking and finance .pptx
 
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
 
Kempen ' UK DB Endgame Paper Apr 24 final3.pdf
Kempen ' UK DB Endgame Paper Apr 24 final3.pdfKempen ' UK DB Endgame Paper Apr 24 final3.pdf
Kempen ' UK DB Endgame Paper Apr 24 final3.pdf
 
Q1 2024 Newsletter | Financial Synergies Wealth Advisors
Q1 2024 Newsletter | Financial Synergies Wealth AdvisorsQ1 2024 Newsletter | Financial Synergies Wealth Advisors
Q1 2024 Newsletter | Financial Synergies Wealth Advisors
 
Bladex 1Q24 Earning Results Presentation
Bladex 1Q24 Earning Results PresentationBladex 1Q24 Earning Results Presentation
Bladex 1Q24 Earning Results Presentation
 
The Core Functions of the Bangko Sentral ng Pilipinas
The Core Functions of the Bangko Sentral ng PilipinasThe Core Functions of the Bangko Sentral ng Pilipinas
The Core Functions of the Bangko Sentral ng Pilipinas
 
🔝+919953056974 🔝young Delhi Escort service Pusa Road
🔝+919953056974 🔝young Delhi Escort service Pusa Road🔝+919953056974 🔝young Delhi Escort service Pusa Road
🔝+919953056974 🔝young Delhi Escort service Pusa Road
 
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfBPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
 
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
 
The AES Investment Code - the go-to counsel for the most well-informed, wise...
The AES Investment Code -  the go-to counsel for the most well-informed, wise...The AES Investment Code -  the go-to counsel for the most well-informed, wise...
The AES Investment Code - the go-to counsel for the most well-informed, wise...
 
AnyConv.com__FSS Advance Retail & Distribution - 15.06.17.ppt
AnyConv.com__FSS Advance Retail & Distribution - 15.06.17.pptAnyConv.com__FSS Advance Retail & Distribution - 15.06.17.ppt
AnyConv.com__FSS Advance Retail & Distribution - 15.06.17.ppt
 
原版1:1复刻温哥华岛大学毕业证Vancouver毕业证留信学历认证
原版1:1复刻温哥华岛大学毕业证Vancouver毕业证留信学历认证原版1:1复刻温哥华岛大学毕业证Vancouver毕业证留信学历认证
原版1:1复刻温哥华岛大学毕业证Vancouver毕业证留信学历认证
 
Stock Market Brief Deck FOR 4/17 video.pdf
Stock Market Brief Deck FOR 4/17 video.pdfStock Market Brief Deck FOR 4/17 video.pdf
Stock Market Brief Deck FOR 4/17 video.pdf
 

Evaluation of the TOIA project

  • 1. Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1 and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde CAA Conference, Loughborough 5 th July 2005
  • 2.
  • 3.  
  • 4.  
  • 5. Experiential Practicing Mimicking Experiencing Productive Creating Producing Writing Drawing Composing Synthesising Communicative Discussing Presenting Debating Adaptive Modelling Simulation Info Handling Gathering Ordering Classifying Selecting Analysing Manipulating Not assessed Diagnostic Formative Summative Adaptive Simulation Modelling Virtual worlds Communicative Chat Chat Email Discussion boards Mailing lists Weblogs Productive Spreadsheets Databases Narrative Audio Image Text Video Web page Interactive Libraries Portals Search engines Indiv learner Group leader Coach Participant Mentor Supervisor Rapporteur Facilitator Deliverer Pair person Presenter Peer assessor Moderator 1 – many Group based Class based 1-1 S to S 1-1 S to T Individual Artefact Assignment Brainstorming Buzz words Defending Dissertation Drill & practice Essay Exercise Fishbowl Ice breaker MCQ Mindmaps Negotiating Pair dialogues Performance Portfolio Product Question & answer Resource-based Role play Rounds Short answer Snowball Debate Test Voting Assimilative Reading Viewing Listening Assessment Tools & Resources Roles Interaction Technique Type Types of learning activities
  • 6.  
  • 7.
  • 8.
  • 9. items Anatomy of an online assessment system
  • 10. Items items item validator item viewer item author Anatomy of an online assessment system
  • 11. Items assessments items item validator item viewer item author Anatomy of an online assessment system
  • 12. Items Assessments assessments items item validator item viewer item author test viewer test validator test author Anatomy of an online assessment system
  • 13. Items Assessments Test instance System, user & group admin invigilator groups test instance assessments items learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system responses and results
  • 14. Items Assessments Responses and results Test instance System, user & group admin invigilator responses and results groups test instance assessments items marks modifier statistics monitor marks monitor marker answer monitor learner feedback administrator learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system
  • 15.  
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35. Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1 and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde www.toia.ac.uk [email_address] Sclater.com