Getting started with blended, a presentation for NMSU
Assessment for online discussions
1. Assessment and Round
Up Activities
By James Johnson and Sue Robinson
We will look at:
• Considerations and task types of:
Asynchronous written online discussions
Synchronised chat discussions
• Closing activities – why and what
2. Assessing Asyncronised Online
Discussions
Considerations:
•Have a set of clear criteria for the task
•Develop a matrix/criteria when grading:
Criteria: Excellent (5) Acceptable (3) Poor (1) Total
Meeting the deadline The student made the The student made some The student did not post
required posts by the of the required posts by by the required deadline
deadline set. the deadline set. set.
Quality of work The student has clearly The student has written The student has not
thought about the material about the material, but reflected on the material,
and has raised interesting has not offered or the post made is
solutions and/or problems. information that was not irrelevant to the topic.
already given in the text.
Mechanics The post made does not The post made contains The post made contains
contain grammatical or very few grammatical several grammatical
spelling errors. and/or spelling errors. and/or spelling errors and
is difficult to understand.
Sample Rubric taken from:
The Effectiveness and Development of Online Discussions by Olla Najah Al-Shalchi
http://jolt.merlot.org/vol5no1/al-shalchi_0309.htm
3. A set of guidelines for how to participate and expectations to
meet the criteria
Design tasks that encourage sharing, negotiation and skills
and with a real purpose/focus
Variation in task type and format should be given: video, wiki,
podcast, documents, visual, spoken
Tasks can be longer than synchronous chat as participant
has more time to research and think.
Regulate discussions/make them manageable and provide a
two way dialogue
Keep to a time frame/length for each task
4. Keep a clear record/tracking system/copy of transcript or text
To give opportunity for peer feedback
Think about use of video and audio to give feedback- more
personal
Ensure cohesion
5. Types of tasks: many have been
exemplified on this course
Tasks to give opinion, relate experiences, evaluate and use
question and answers.
Responses to questions previously set/research articles
Critiques/reviews of material
Peer feedback and evaluation
Comment on a picture/song/broadcast
Shared viewing of a video
6. Making a video/podcast
To summarise the discussion
Review of case studies
Students submit a study plan to the tutor-feedback from tutor
Using some of the Google apps: Questionnaires on how the
tasks went. This helps self-correction
Get them to keep a reflective journal, this could allow for self-
correction.
Create an e portfolio
7. Assessing Synchronised Chat
Considerations
To assess is difficult as how do you measure ‘chat’ ?
Synchronised chat is more informal, and so can be fragmented and
hard to keep consistency
Issue of unreliable technology/internet connections
Time zone differences between students – not all will be able to
participate at the same time
The chat needs to be monitored and ‘chaired’ by someone to keep the
focus of the task and stop deviations from the topic. Therefore the role
of the tutor is more important here.
The ‘moderator‘ needs to encourage reluctant participants or stopping
over dominant ones
8. What to assess
Synchronous Chat is very difficult to assess due to the nature
of a spoken text. It could, therefore, have more focus on how
they participate: This is still difficult to measure and would
need criteria as mentioned above to clearly identify the levels
of expected participation.
Turn taking
Frequency of comment and participation
Does the student stay on topic
Valued points that add to the discussion and are relevant
Evidence of reading the course material in their contribution
Acknowledging other participants in the exchange and
responding to their comments
9. Netiquette is being followed
Their participation is helping develop the conversation –
asking pertinent questions
Are they just ‘lurking’ – not really participating
Punctuality and attendance – is there a required %
Responding productively or contributing something just to be
‘on record’
Empower them - get them to act as moderator or summariser
in a group chat and after a group chat
10. Type of tasks
As chat is sharing and talking, the tasks need to be collaborative
and either in pairs or small groups. Assessment could take any
format: aural or text chat or through video. Tasks on slide 5-6 can
be used for both synchronised and asynchronised but the
following extra tasks could also be used for synchronised chats:
Video conferencing
Role play – to interact with other participants
Use software such as Jing, GoToMeeting Space or Collaborate
to present topics or share information
Get them to take on a moderator role within the group/changing
roles to different people
11. CLOSING ACTIVITIES
Closing the course is very important as:
Often participants feel at a loss when the course has ended
as they’ve bonded with the group (particularly on longer
courses)
They’ve been doing it so long it’s part of their routine.
So activities are a good way to bring everything to a close
and sum up what’s been learnt/shared.
12. Examples of activities
(1 and 2 from Nicky Hockley’s Blog Emoderation Station)
Parting gift- specific to course (something such as a favourite
website, tool, picture, video clip or program to give…)
Wall wisher – to say one thing learnt from the course or what they
going to do after the course
Students could complete a feedback questionnaire on the course
Self-evaluation questionnaire:
where most improved
would like to further develop
13. Make a montage of photos with words/phrases from each
participant to be remembered
Farewell messages using Podcast or video
A farewell discussion forum (Scot Thornbury’s idea from
Nicky’s blog)
Quiz/review of course using puzzlemaker/pictures or similar
Headline points! – using Fodey -something we thought at the
beginning but has now changed or improved
A farewell synchronised chat to review, test, say goodbye
(as we did )
14. References
The Effectiveness and Development of Online Discussions by
Olla Najah Al-Shalchi
http://jolt.merlot.org/vol5no1/al-shalchi_0309.htm
Emoderation Station Blog Nicky Hockley
Assessment in the Digital Age JISC (Ros Smith podcast)
Instruction Design Tips for Online Learning
by Joan van Duzer
Planning an Online Course by Curt Bonk -
http://www.indiana.edu/~icy/media/de_series.html
The Real-time Online Tutor by Clive Shepherd