1. Image source: cobalt123 (2007) Test Well. Retrieved from
http://www.flickr.com/photos/cobalt/409924867/
TOWARDS AUTHENTIC ASSESSMENT
IN ONLINE TUTORIALS
SEMLOL Fall Meeting 2013 - November 8, 2013
Bill Marino
Online Learning Librarian - Eastern Michigan University

2. This presentation begins a
conversation on:
•
What do we assess?
•
How do we assess?
Image source: wecometolearn (2012). Long before the Third Grade Test. Retrieved from
http://www.flickr.com/photos/wecometolearn/6831018124/

3. Do we assess student learning in our
online media?

4. What do we assess?

5. What do we assess?
Benjamin
Bloom
Image retrieved from
https://bloomstheory.wikispaces.com/Introduction

6. The
foundation:
Image source: fishbrain.randy@sbcglobal.net (2011). New Bloom's Taxonomy. Retrieved from
http://www.flickr.com/photos/fishbraintexas/5493450400/

7. Learning Objectives
Give focus to a lesson's content
• Express expectations
• Provide a framework for assessment/learning activities
•
Source: Research 101 @ EMU. Adaptation of University of Washington Information Literacy Learning's Research
101.

8. Effective Assessment is…
• “Knowing what you are doing”
• “Knowing why you are doing it”
• “Knowing what students are learning as a
result”
• “Changing because of the information”
(Gilchrist, 2009)

9. The
foundation:
Image source: fishbrain.randy@sbcglobal.net (2011). New Bloom's Taxonomy. Retrieved from
http://www.flickr.com/photos/fishbraintexas/5493450400/

10. Remember:
•
shallow processing
•
recall/recognition of facts
•
memorization
•
the 5 Ws
(IUPUI Center for Teaching and Learning,
2002)

11. Understand:
• summarization
• interpretation
• focus
on connections
(IUPUI Center for Teaching and Learning,
2002)

12. Apply:
• knowing
when and why to
apply
• recognition/transfer
of
patterns
• judging
effects
(IUPUI Center for Teaching and Learning,
2002)

13. Analyze:
• breaking
down into
respective parts to create
a model of thinking
• identifying
relationships
(IUPUI Center for Teaching and Learning,
2002)

14. Evaluate:
•apply
a set of criteria to
evaluate
(IUPUI Center for Teaching and Learning,
2002)

15. Create:
•"combining
elements into a
pattern not clearly there
before."
(IUPUI Center for Teaching and Learning,
2002)

16. Learning Objectives
Source: Research 101 @ EMU. Adaptation of University of Washington Information Literacy Learning's Research
101.

17. •
Select an appropriate topic for research
•
Generate questions from a topic
•
Broaden and narrow a question
•
Identify key concepts and vocabularies related
to a topic
•
Broaden and narrow concepts and
vocabularies related to a topic.

18. •
Select an appropriate topic for research
understand
•
Generate questions from a topic
analyze, create
•
Broaden and narrow a question
apply, analyze, evaluate, create
•
Identify key concepts and vocabularies related
to a topic
understand
•
Broaden and narrow concepts and
vocabularies related to a topic.
apply, analyze, evaluate, create

19. However, when it comes to assessment...
•
Broaden and narrow concepts and vocabularies
apply, analyze, evaluate, create
related to a topic.

20. However, when it comes to assessment...
•
Broaden and narrow concepts and vocabularies
apply, analyze, evaluate, create
related to a topic.
understand, apply

23. Enter Authentic Learning
"Authentic assessment requires the
respondent to construct, rather than select, a
response to academic stimuli" (Powers, 2005).

24. How can this be incorporated
into online tutorials?
1. Not necessarily "tool-dependent”
2. Can still capture relevant data
3. Requires a shift in how we think of assessment-from an add-on to the instructional object itself.

25. What does authentic assessment look
like?
•
simulation
•
case studies/situational
learning models
•
reflection/self-assessment
•
collaboration/social
elements included
Image source: Horse Simulator WWI. Retrieved from
http://en.wikipedia.org/wiki/File:Horse_simulator_WWI.jpg

26. Simulation
Image source: SuperJet International (2011). Full Flight Simulator. Retrieved from
http://www.flickr.com/photos/superjetinternational/5573438825/

27. Simulation
Guide on the Side http://code.library.arizona.edu/gots/
Image source: University of Arizona Libraries (2013). Guide on the Side. Retrieved from
http://www.library.arizona.edu/applications/quickHelp/tutorial/searching-the-ua-library-catalog

28. Case studies/situational learning
models
Image source: VU e-Innovations (n.d.) The Adventures of Jasper Woodbury. Retrieved from
http://jasper.vueinnovations.com/

29. Case studies/situational learning
models

30. Reflection/Self-assessment

31. The social element
•
Provide opportunities for further
discussion

32. So...
can
become...

33. A concept mapping exercise…
Image source: Jobling, C. (2010). My first concept map. Retrieved from
http://www.flickr.com/photos/cpjobling/5011621421/

34. A troubleshooting exercise…
Mike is researching customer service in college dining services, but cannot find
relevant sources. His search is below. Help him refine his keywords by suggesting
broader, narrower, or related terms that he can search.
Enter your words here.

35. So much more.

36. THANK YOU!
References:
Conrad, R., & Donaldson, J. (2004). Engaging the Online Learner. San Francisco: Jossey-Bass.
Ellis, R.K. (2012). Backchannel Best Practices. Retrieved from http://www.astd.org/Publications/Newsletters/LearningCircuits/Learning-Circuits-Archives/2012/02/Backchannel-Best-Practices
Gilchrist, D. (2009). A Twenty Year Path: Learning about Assessment; Learning from Assessment. Communications in Information
Literacy, 3(2), 70-79.
Holder, L. (2012). How to design assessments that promote the learning process. Retrieved from
http://elearningindustry.com/authentic-assessments.
IUPUI Center for Teaching and Learning. (2002). Bloom's Taxonomy "Revised" Key Words, Model Questions, & Instructional
Strategies. Retrieved from https://keyarts.wikispaces.com/file/view/bloom_revised.pdf.
Powers, K. (2005). Authentic Assessment. In (S. W. Lee, Ed.) Encyclopedia of school psychology. Thousand Oaks, Calif.: Sage
Publications. Retrieved from http://galenet.galegroup.com/servlet/eBooks?ste=22&docNum=CX3453099999.
Silvers, A. (2011). Authentic Assessment in Learning Experiences - ADL Future Learning Experience Project. Retrieved from
https://sites.google.com/a/adlnet.gov/future-learning-experience-project/project-updates/authenticassessmentinlearningexperiences

37. Bill Marino
Assistant Professor – Online Learning Librarian
Eastern Michigan University
734-487-2514
wmarino1@emich.edu
Twitter: @wmarino