Improving an Information Literacy Module Using Student Research Journals
1. USING STUDENT ACCOUNTS OF THE RESEARCH
PROCESS TO IMPROVE AN INFORMATION
LITERACY MODULE
Journals for Learning,
Journals for Teaching
Claire McGuinness
2. Presentation Outline
īContext:
īĄ Authentic Assessment for Information Literacy Instruction
īĄ Reflection in the Learning Process
īĄ Journal-keeping as a reflective learning tool
īĄ Reflective practice in teaching
īĄ âAssessment-Evaluation-Revisionâ Cycle
īInformation Literacy in UCD: The Case Study
īĄ Module overview
īĄ Analysis of student research experience reported in 2007
īĄ Using studentsâ research experience to adapt module
4. Authentic Assessment
īTraditional methods of assessing IL outcomes (i.e.
quantitative, standardised tests, product appraisal,
evaluation surveys) â only assess certain level of learning or
student satisfaction
īAuthentic assessment: âan evaluation process that
involves multiple forms of performance measurement
reflecting the studentsâ learning, achievement, motivation
and attitudes on instructionally relevant activitiesâ
(Callison, in Sharma, 2007, p.127)
5. Reflective Learning
ī Metacognition - âawareness of [oneâs] own cognitive machinery and
how the machinery worksâ (Meichenbaum, in Woolfolk et al, 2008, p.319)
ī Declarative knowledge â knowing what to do (skills, strategies)
ī Procedural knowledge â knowing how to use the strategies
ī Conditional knowledge - knowing when and why to use strategies
ī âLearning is enhanced as learners become aware of their own learning
strategies and begin to monitor the use of these strategiesâ (Grassian &
Kaplowitz, 2001, p.48)
ī Three skills which enable individuals to regulate thinking and learning â
Planning, Monitoring and Evaluating (Woolfolk et al, p.320)
6. Learning & Reflective Journals/Portfolios
âJournals, logs, diaries, portfolios are containers for writing that is
recorded over a period of timeâ
âA learning journal is:
ī diverse;
ī not necessarily written - but most of the time assume written format;
ī generally reflective and accumulated over a period of time with the
intention to learn, i.e. not purely descriptive;
ī flexible (it can be structured or unstructured)
ī a useful back-up to learning;
ī something that accentuates favourable conditions for learning - e.g.
space, time, reflection.
ī âĸapplicable to all disciplines (not just literary)â
(Jennifer Moon for UCD Centre for Teaching & Learning)
7. EGâs of Journals/Portfolios for IL instruction
ī Diller & Phelps (2008): Use of e-portfolio to assess IL in General Education
Programme. Students included two pieces of evidence for each of 6 learning
goals, e.g. Critical Thinking, IL and Communication, Self in Society
ī Sharma (2007): Use of a web portfolio to document the process of researching
a 20-page paper. Included topic statement, concept maps, research qâs, research
log, annotated bibliography & reflection
ī Scharf et al (2007): Use of existing writing portfolios to assess IL skills at end
of 4-year programme. Rubric developed using five traits linked to ACRL
standards to measure IL performance in student papers selected from portfolios
ī Sonley et al (2006): Use of research information literacy portfolio in
âNegotiated Learningâ module (adult learners), which included a bibliography,
and âevidence to demonstrate the process which had been undertaken to lead to
this bibliographyâ (p.48), e.g. Search strategies, evaluation of sources, etc.
8. Reflective Practice
īâIf we are going to address
the issues of librariansâ roles
within educational
endeavours systematically,
we, as a discipline, need to
foster reflective, critical
habits of mind regarding
pedagogical praxis within
ourselves, our libraries and
our campusesâ (Jacobs,
2008, p.256)
Critical reflection is
ī A process more than an outcome
ī Recognising and using trigger
events
ī Letting go of assumptions without
feeling guilty
ī Tipping over the ârocksâ of
tradition or habit
ī Confronting illusions
ī Deciding on potential
changes in practice (action
research)
(Burge, in Thomas et al, 2004, p.13)
9. Assessment-Evaluation-Revision
âAssessment should be student centred and proactive. The results should
be used to implement positive changes in the teaching of information
literacyâ (Avery, 2003, p.2)
âAuthentic assessment
is, among other things,
iterative. Librarians
can evaluate student
learning, implement
changes, and continue
this cycle so that
improvement via
assessment becomes
an inherent part of the
instructional process.â
(Sonntag & Meulemans,
2003, p.8)
10. Case Study -Information Literacy Module
īModular structure established in UCD in 2005-6 (âHorizonsâ)
īOverhaul of course offerings â new First Year modules developed
by School of ILS
īConcerns about quality of First Year student essays â plagiarism
and copying a particular issue
īDecision to establish new full (12-week) information literacy
module, aimed at improving studentsâ skills in researching and
writing academic essays
īâIntroduction to Information Literacyâ (re-named in 2006-7:
âInformation Literacy: Information Skills for Effective Academic
Writingâ)
īCollaboration with UCD Library staff, who deliver most of the
âinformation searchingâ sessions
11. Module Objectives
âOn completion of this module students should be able to:
ī Identify and clearly articulate information needs in the context of
specific information tasks.
ī Identify the range of potential information sources, and evaluate and
choose the appropriate source(s) for specific information tasks.
ī Access and retrieve needed information efficiently from a variety of
information media, through the formulation and execution of effective
search strategies.
ī Critically evaluate information and its sources in terms of bias and
relevance to specific information tasks.
ī Synthesise the gathered information to successfully solve an
information problem and create a final product.
ī Recognise and reflect on own information-seeking strategies
and behaviour. â
12. Information Literacy Framework
Stripling & Pittsâ Model of the Research Process (1988)
ī Step 1: Choose a broad topic
ī Step 2: Get an overview of the topic
ī Step 3: Narrow the topic
ī Step 4: Develop a thesis or statement of purpose
ī Step 5: Formulate questions to guide research
ī Step 6: Plan for research and production
ī Step 7: Find / Analyze / Evaluate sources
ī Step 8: Evaluate evidence / Take notes / Compile bibliography
ī Step 9: Establish conclusions / Organize info. into an outline
ī Step 10: Create and present final product
13. Assessment Protocol
Year 1:
ī One-page essay proposal (10%) â
discontinued after year 1
ī 1500-word essay (50%)
ī Reflective Research Journal
(30%)
ī Tutorial attendance (10%)
Year 2:
ī 1500-word essay (50%)
ī Reflective Research Journal
(40%)
ī Tutorial attendance (10%)
From Year 3:
ī 1500-word essay (50%)
ī Reflective Research Journal
(35%)
ī Tutorial attendance (15%)
IL pre-test (MCQ) used in Years 1
& 2, but discontinued as only
offered limited insight into
studentsâ skills deficits, and were
labour-intensive to grade
14. Research Journal
In Year 1: 10 weeks (from Week 3 to Week 12)
Weekly entries comprised:
ī Goals â planned research activities for week ahead
ī Activities â activities actually accomplished during week
ī Readings â items read or referred to by student during week
ī Problems â honest account of any difficulties encountered
ī Reflection â space to reflect on the experience of research and of
writing the journal
ī Appendices â diagrams, exercises, concept maps, search printouts,
abstracts, pictures, etc... Not compulsory, but encouraged
15. Research Journal
Reflection in final week:
īWhat was most challenging about the assignment?
īWhat was easiest?
īWhat have I learned through this assignment?
īWhat am I proud of with this assignment?
īWhat would I do differently next time I complete a similar
task?
īWhat did I enjoy most about writing this assignment?
16. Analysis of Journals 2005-6
Problems experienced
ī Narrowing essay topics
ī Orientation in the library
ī Missing/unavailable items in Lib
ī Information overload
ī Fear of overlooking information
ī Identifying relevant information
ī âFalse hitsâ when searching
ī Problems with ICTâs
ī Time management
ī Getting side-tracked
ī Problems with organising info
ī Difficulty with essay structure
ī Over-reliance on print or electronic
resources, especially the Internet
ī Problems with specialist terminology
ī Not having much to write about
some weeks
ī Problems finding statistics
ī Understanding referencing
ī Technical problems
ī De-motivation
ī Difficulties with search strategies
ī Lack of confidence
ī Fear of accidental plagiarism
17. Analysis of Journals 2005-6
Students enjoyed/were
proud of:
ī Opportunity to explore novel
topics to build knowledge base
in new areas
ī Freedom to choose own topic
ī Improvement in search skills
ī Appreciation of using multiple
information formats in
research
ī Appendices allowed for creative
expression
ī Drawing evidence together to
create arguments
ī Sense of achievement and
personal fulfilment â
persistence through difficulties,
hard work, effort
ī Success in completing
unfamiliar type of assignment
ī Motivation to be organised
ī Developing awareness of multi-
disciplinarity and cognate
subject areas
18. Evolution of a Module
īChanges made since Year 1:
īĄ Length of journal (10 weeks to 8 weeks to 6 weeks)
īĄ More lab sessions & new lecture content
īĄ Summative to formative assessment (Year 2 only)
īĄ Essay topics â broad and unfocused, to narrower ,
more clearly defined questions
īĄ Increased âportfolioâ component â compulsory
worksheets based on lecture and tutorial content
īĄ More emphasis on âactivityâ rather than pure
reflection
19. Summative to Formative
ī Formative assessment: âThe purposes of formative assessment are
to guide the teacher in planning and to help pupils identify areas that
need work. In other words, formative assessment helps form teaching.â
(Woolfolk et al, 2008, p.660)
ī In Year 2, journal was submitted in two parts (4 weeks each)
ī Aim was to provide students with feedback before second half of
journal submitted
ī In the event, turnover was not rapid enough to help students â large
numbers meant that second half of journal was mostly written before
first half returned with comments and grades.
20. Old Essay Titles Examples
Old Essay Format
ī âCensorship and the Mediaâ
ī âHealth Promotion and
Smokingâ
ī âHealth Information and the
Internetâ
ī âTerrorism and News
Reportingâ
ī âPolitical Corruption and
Investigative Journalismâ
ī âDiet and Popular Mediaâ
ī Extremely broad topics
ī Student expected to narrow
topic through exploratory
research
ī Students work together on
topics in tutorial groups
ī Student decides on âtypeâ of
essay, i.e. Argumentative,
persuasive, etc
ī Unique âthesis statementâ
developed for each essay
22. Student Quotes
ī In Week 6 (2006): âAgain, I had great trouble trying to narrow down the topic,
wish I could just write about a few different things.â
ī In week 4 (2006): âGetting worried now as I am still struggling to narrow
down my topic. I feel as if I never will be able to narrow it down and would
much prefer a different research topic!â
ī What would you do differently next time? (2006): âI would have tried to
narrow my topic in to a specific essay title sooner. I wasted a lot of time
researching vast amounts of broad information that ended up being useless to
my essay title.â
ī What was most challenging? (2006): âAs probably everybody else will state as
well, I found it hardest to actually narrow the research topic down to one
specific topic and question relating to it, which was caused by the sheer amount
of information that is to be attained.â
23. Student Quotes
ī In week 8 (2007): âLast journal [entry] and things have still not clearly formed in my head
of what my essay title will be.â
ī In week 8 (2007): âI am not completely happy with the topic and approach I chose, but at
the moment it is too late to alter anything significantly. I am hoping that my good
intentions an idea will come through in my writing and the paper will fit the initial, broad
topic of Media and Censorship.â
ī In week 7 (2007): âI do not have a structure for my essay, or [am not] even certain what it
will beâ
ī In week 6 (2007): âI feel I made little progress this week; this is alarming as I am over half-
way through the journal. This step backwards is quite disheartening, and Iâm starting to
question the aspect I decided to zoom in on.â
ī In week 8 (2007): âAlthough this is the last week, I am having a change of mind in the
direction of my essay [...]. This is a major change, so I will have to change the majority of
my information.â
24. Coursework under the microscope...
ī Persisted with broad essay topics for 3 years â belief that students
should develop skills to explore and narrow topics through background
reading and research, and lectures/tutorials were geared towards that
ī However, evidence of low confidence and frustration until late in
process, in some cases never fully resolved. While frustration is normal
during process, it should eventually give way to confidence and relief.
ī Too advanced for First Year students? More appropriate for 3rd
or 4th
years, or novice postgraduate researchers?
ī Transition from secondary to tertiary education needs to be carefully
managed, to ensure student retention and motivation.
ī Would a more clearly defined approach to topic selection strike the
correct balance between the structured approach of secondary
education, and the more flexible, independent approach at university?
ī What kinds of essays are assigned to undergraduates in other modules?
25. New Essay Titles (Year 4) Examples
ī Reflect type of assignments
students have to do in other
modules
ī Clearly defined âEssay questionsâ
but topics still quite broad
ī Students more easily able to
articulate information needs?
ī Students can hopefully move
beyond âfrustrationâ stage more
quickly
ī Students can spend more time
searching for & evaluating info
ī âDiscuss possible solutions to
the problem of racism towards
immigrants in Irelandâ
ī âIt is widely agreed that poverty
is one of the major causes of anti-
social behaviour. Do you agree?â
ī âReality television competitors
are the modern-day gladiatorsâ
Discuss
New Essay Format
26. From journal to portfolio
īPreviously, journal was primarily reflective
īPossible to complete it all in one go at end (some anecdotal
evidence, and date on printouts in appendices!)
īâHands-onâ activities (e.g. worksheets) not compulsory
īReluctant acceptance (to an extent!) of the âstrategic studentâ â
unless submission is weekly, not possible to monitor entries
īRevisited course objectives â importance of developing skills
īPortfolio format â students have to complete various exercises,
etc, so work gets done regardless of when they do it
īWhich is more important â students complete regular weekly
entries, or learn through activities?
27. Portfolios
īâA portfolio is a purposeful collection of student work that
exhibits the studentâs efforts, progress or achievements in one or
more areas. The collection must include student participation in
selecting contents, the criteria for judging merit and evidence of
the studentâs self-reflectionâ (Paulson et al, in Sonley et al, 2007,
p.47)
īConvey the âthinking and activity involved in the creation of
major projects, and may contain records of original
brainstorming sessions, early and current drafts [âĻ] and student
self assessments, instructor evaluation, and student thoughts on
further projectsâ (Thomas, 1999, p.140).
28. Journal Format Change
New Template (Year 4)
īWhat stage of the process are you at this week?
īWhat research and/or writing tasks have you attempted this
week?
īWhich information resources have you searched and/or read this
week? (List at least 3)
īGive your reasons for either choosing or rejecting resources you
have looked at this week.
īHow do you feel your research and/or writing is going this week?
īCompulsory appendices â students must include all
exercises handed out in class, plus self-selected work
29. Student Quotes (2008)
Main challenge is now focused on the information search process:
ī âThe most challenging aspect of the assignment was the gathering of relevant
sources [âĻ] Citing and quoting references was one of the more difficult aspects
for me. I found the need to quote quite tedious, however I do understand the
importance of itâ
ī âI found the research of my topic quite difficult as it was hard to find books of
good use [sic] and on the same topic.â
ī âIt was difficult to keep looking at different sources that I could write about in
my journal each weekâ
ī âThe most difficult part of this assignment was finding enough sources to fill my
research journal, it was very time-consuming to read three sources a week while
juggling my other subject assignmentsâ
30. Future Plans?
More reflection required....
īChange to e-portfolio format?
īGive students option of presenting journal in Blog format?
īNo longer specify the number of readings to be done each
week?
īIntroduce complete flexibility â students not required to
post weekly entries?
32. References
ī Avery, E.F. Assessing Student Learning Outcomes for Information Literacy
Instruction in Academic Institutions. Chicago: Association of College &
Research Libraries, 2003
ī Diller, K.R., & Phelps, S.F. (2008). Learning outcomes, portfolios and
rubrics, Oh my! Authentic assessment of an information literacy programme.
Portal: Libraries and the Academy, 8(1), pp. 75-89
ī Grassian, E.S., & Kaplowitz, J.R. Information literacy instruction: Theory
and Practice. New York: Neal-Schuman, 2001
ī Jacobs, H.L.M. (2008). Information literacy and reflective pedagogical
praxis. Journal of Academic Librarianship, 34(3), pp.256-262
ī McGuinness, C. & Brien, M. (2007). Using reflective journals to assess the
research process. Reference Services Review, 35(1), pp.21-40.
33. References
ī Scharf, D., Elliot, N., Huey, H.A., Briller, V. & Joshi, K. (2007). Direct
assessment of information literacy using writing portfolios. Journal of
Academic Librarianship, 33(4), pp.462-478.
ī Sharma, S. (2007). From chaos to clarity: Using the research portfolio to
teach and assess information literacy skills. Journal of Academic
Librarianship, 33(4), pp.127-135.
ī Sonley, V., Turner, D., Myer, S., & Cotton, Y. (2007). Information
literacy assessment by portfolio: A case study. Reference Services Review, 35
(1), pp.41-70
ī Sonntag, G., & Meulemans, Y. Planning for assessment. In Avery, E.F. (ed.)
Assessing Student Learning Outcomes for Information Literacy Instruction in
Academic Institutions. Chicago, Association of College & Research Libraries,
2003, pp.6-21
34. References
ī Thomas, D.B., Tammany, R., Daier, R., Owen, E., & Mercado, H.
Reflective Teaching: A Bridge to Learning. (Library Orientation Series). Ann
Arbor, MI: Pierian Press, 2004
ī Thomas, N.P. Information Literacy and Information Skills Instruction:
Applying Research to Practice in the School Library Media Center.
Englewood, CO: Libraries Unlimited, 1999
ī Woolfolk. A., Hughes, M. & Walkup, V. Psychology in Education. Essex:
Pearson Education Ltd, 2008