1. Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1 and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde CAA Conference, Loughborough 5 th July 2005
2.
3.
4.
5. Experiential Practicing Mimicking Experiencing Productive Creating Producing Writing Drawing Composing Synthesising Communicative Discussing Presenting Debating Adaptive Modelling Simulation Info Handling Gathering Ordering Classifying Selecting Analysing Manipulating Not assessed Diagnostic Formative Summative Adaptive Simulation Modelling Virtual worlds Communicative Chat Chat Email Discussion boards Mailing lists Weblogs Productive Spreadsheets Databases Narrative Audio Image Text Video Web page Interactive Libraries Portals Search engines Indiv learner Group leader Coach Participant Mentor Supervisor Rapporteur Facilitator Deliverer Pair person Presenter Peer assessor Moderator 1 – many Group based Class based 1-1 S to S 1-1 S to T Individual Artefact Assignment Brainstorming Buzz words Defending Dissertation Drill & practice Essay Exercise Fishbowl Ice breaker MCQ Mindmaps Negotiating Pair dialogues Performance Portfolio Product Question & answer Resource-based Role play Rounds Short answer Snowball Debate Test Voting Assimilative Reading Viewing Listening Assessment Tools & Resources Roles Interaction Technique Type Types of learning activities
10. Items items item validator item viewer item author Anatomy of an online assessment system
11. Items assessments items item validator item viewer item author Anatomy of an online assessment system
12. Items Assessments assessments items item validator item viewer item author test viewer test validator test author Anatomy of an online assessment system
13. Items Assessments Test instance System, user & group admin invigilator groups test instance assessments items learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system responses and results
14. Items Assessments Responses and results Test instance System, user & group admin invigilator responses and results groups test instance assessments items marks modifier statistics monitor marks monitor marker answer monitor learner feedback administrator learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
26.
27.
28.
29.
30.
31.
32.
33.
34.
35. Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1 and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde www.toia.ac.uk [email_address] Sclater.com