SlideShare uma empresa Scribd logo
1 de 30
Baixar para ler offline
Enhancing learning
through constructive alignment




    Professor John Biggs

  Open University 14 May, 2009
Outcomes-based Approaches
Three main forms of outcomes-based approaches. All focus
on educational outcomes, each based on a different
philosophy.

1. Outcome-based approaches at school level. Originally
   devised by William Spady for disadvantaged children,
   but later used generally e.g. Target Oriented Curriculum
   (TOC) for individualising teaching.

2. Outcomes-based approaches at institutional level, used
   for benchmarking, credit-transfer. Have little directly to
   do with enhancing teaching and learning.

3. Outcomes-based Approaches to Student Learning
   (OBASL). Defining learning outcomes at programme
   and course level, to enhance teaching and learning.
What the UGC said
“The UGC’s goal in promoting outcome-
 based approaches is simple and
 straightforward—improvement and
 enhancement in student learning and
 teaching quality.” (Alice Lam, May 05)

The UGC has asked local universities to
  show that they have thought through the
  "learning outcomes" they expect their
  students to achieve, and that they are
  organising educational experiences to
  enable students to achieve these
  outcomes. …
Outcome-based Approaches to
      Student Learning (OBASL):
 the Intended Learning Outcome (ILO)
               is central


  Teaching:                   Assessment:
                    ILO:
To facilitate                   How well
                 What the
attaining the                 the student
                student has
     ILOs                     has attained
                   to do
                                the ILOs
Implementing OBASL using
        Constructive Alignment



                                     Assessment:
  Teaching:                            How well
                        ILO:
Engaging the                         the student
                  What the student
student in the                       has met the
                   has to learn
verb in the ILO                          ILO
Constructive Alignment
                            Intended Learning Outcomes (ILOs)
                           expressed as verbs students have to enact

Teaching / Learning                  A
Activities                 The very best understanding that could be      Assessment Tasks
                           reasonably expected: verbs such as
Designed to                hypothesise, apply to “far” domains,
                           generate, relate to principle, etc.            Format such that
elicit desired
                                                                          the target verbs are
verbs                                            B                        elicited and
                            Highly satisfactory understanding: verbs      deployed
May be:
                            such as explain, solve, understand main       in context.
                            ideas, analyze, compare, etc.
Large class activities
                                                C                         Criteria clearly allow
Small class activities
                           Quite satisfactory learning, with under-       judgement as to the
                           standing at a declarative level: verbs such    quality of the
Teacher-managed
                           as elaborate, classify, cover topics a to n,   student's
                                                                          performance
Peer-managed
                                               D
Self-managed               Understanding at a level that would
                           warrant a Pass: low level verbs, also
as best suits context      inadequate but salvageable higher level
                           attempts.
How constructive alignment started

   Constructive alignment was born at HKU.

I was teaching psychology not so that the students could
   tell me what psychology they had learned, but how they
   could use psychology in order to teach better. They
   should be telling me if and how it had, not me telling
   them how I thought it should.

They placed their evidence and reflections in a portfolio.

Lecturing to them and giving them an MCQ was obviously
  irrelevant to the real aims of the course: teachers would
  use psychology to teach more effectively.
If students are to learn desired outcomes in a reasonably
effective manner, then the teacher’s fundamental task is to
get students to engage in learning activities that are likely
to result in their achieving those outcomes… It is helpful to
remember that what the student does is actually more
important in determining what is learned than what the
teacher does.
                                 (Shuell, 1986: 429)
This is in fact a design for teaching:

1. Define the intended learning outcomes that refer not
   only to content to be learned, but what is to be done
   with that content and to what standards.

2. Create a learning environment that is likely to engage
   the student in learning activities that will bring about the
   intended outcomes.

3. Use assessment tasks that directly address the outcome
   and that enable you to judge if and how well students’
   performances meet the criteria.

4. Transform these judgments into summative grades.
Intended Learning Outcomes (ILOs)

. Statements of what students are expected to be
  able to do after studying a course/programme.

. Expressed from the students' perspective.

. Expressed in the form of action verbs leading to
observable and assessable behaviour.

. Related to criteria for assessing student performance.
Intended Learning Outcomes (ILOs)


University level
What are the attributes of an ideal graduate of Open U?


Programme level
What are the intended learning outcomes for students
enrolled in the degree programme?


Course level
What are the intended learning outcomes for students taking
a particular course at a particular level within the
programme?
Distinguish the kind of knowledge you want

Declarative knowledge:
. Knowing about things
. Knowledge we can declare to someone in
   writing or telling
e.g. ‘Distinguish between topic-based and
outcomes-based teaching’

Functioning knowledge:
. Knowledge we put to work in solving a
physics problem, analysing a case study,
designing a building, making an argument
e.g. ‘Write an ILO for a subject you are
currently teaching’
Alignment with teaching and assessment is
         created by the verbs in the ILOs

   For example: “Explain the historical evolution of nursing
    science”
   Teaching is specifically aimed at activating the verb –
    students do the explaining, say to each other providing
    feedback from rubrics defining aspects of a good
    explanation. They don’t just listen to the teacher doing the
    explaining.
   Students should be unable to complete the assessment
    tasks unless they enact the same verb that is in the ILO.
    Students individually explain to the class how they see the
    historical evolution of nursing. The teacher, perhaps using
    peer assessment too, assess each on the same rubrics.
   Weak form of alignment: ‘congruence with’ ILO.
Programme and Course ILOs
    Alignment between the programme and course ILOs



                                    Course ILOs
    Programme ILOs
                         Course 1     Course 2     Course 3




   1. Are the ILOs aligned?
2. Do the course ILOs appropriately address the programme
   ILOs?
3. Are the weightings appropriate?
4. Are there any gaps?
Procedures in designing Course ILOs
1. Decide what kind of knowledge is to be taught -
   Declarative or functioning.

2. Select the topics to be taught.

3. Decide the levels of understanding/performance the
students are expected to achieve for the different topics.

4. Consider if all the ILOs are of equal importance.

5. Ensure a clear understanding and agreement of the
ILOs within the teaching team and other relevant
parties, e.g. External Reviewer.

6. Communicate the ILOs to students.
The SOLO Taxonomy with sample verbs indicating
      levels of understanding/performance
                                                                             Create
                                                                             Formulate
                                                          Analyze
                                                                             Generate
                                                          Apply
                                                                             Hypothesize
 Competence                                               Argue
                                                                             Reflect
                                                          Compare/
                                                                             Theorize
                                                           contrast
                                                          Criticize
                                  Combine
                                  Describe
                                                          Explain causes       ....
                                                          Relate
                                  Enumerate               Justify
                  Identify        Perform serial skills
                  Name            List
                  Follow simple
                    procedure
   Fail
   Incompetent
   Misses point

Incompetence      one relevant    several relevant      integrated into   generalized to
       aspect            independent aspects a structure          new domain

  Prestructural   Unistructural      Multistructural        Relational     Extended Abstract
Designing Teaching/Learning Activities
(TLAs) to Align with Intended Learning
Outcomes
 Having designed Programme ILOs and the
 Course ILOs, we now need to design
 suitable Teaching/Learning Activities that
 will facilitate students achieving the ILOs.
   The best to do this is to activate the verbs
   or learning activities embedded in the
   ILOs.
 NB: there are many alternatives to lectures
  and tutorials, even in large classes.
Typical ILO                     Possible TLAs
Describe                     reading/lecture followed by presentation
Explain                      tutorial, written essay
Integrate                    project, assignment
Apply                        project, case study
Solve problem                PBL, case study
Design, create               project, creative writing
Hypothesise                  experiment, project
Reflect                      reflective diary

The point is not how you are going to teach but how and what you
  want your students to learn.

NOTE! Many of these TLAs can be assessments tasks as well. Then
  you have excellent alignment.
Assessment Tasks (ATs)

. provide students the opportunity to demonstrate
whether or not they have achieved the ILOs and what
level their performance is in those ILOs.

. should be appropriately designed or selected to
address the ILOs that we want to assess.

. different assessment methods (tasks) address different
ILOs. There should therefore be several kinds of task.

. provide the evidence allowing teachers to make a
judgment about the level of a student’s performance
against the ILOs and to award a final grade.
Designing Assessment Tasks (ATs)
Steps:

1. Select a practicable task that embodies the
   target ILO verb. (Try the TLA first).

2. Develop grading criteria so that you can make
   a judgment on how well the ILO has been met
   by a student’s performance on each
assessment task.

3. Decide how the graded performances can be
combined to give a final grade.
Common ILOs      Possible Assessment Tasks

Describe         essay question, exam, oral
                 presentation (peer assessment)
Explain          assignment, essay question
                 exam, oral, letter-to-a-friend
Integrate        project, assignment
Analyse          case study, assignment
Apply            project, case study, experiment
Solve problem    case study, project, experiment
Design, create   project, experiment
Reflect          reflective diary, portfolio,
                 self-assessment
Communicate      a range of oral, writing or
                 listening tasks, e.g. presentation,
                 debate, role play, reporting,
                 assignment, precis, paraphasing,
                 answering questions etc.
Assessing quantitatively by
      using marks
            or
     qualitatively by
     using rubrics?
Assessing by Marks
For:

. Used to it.
. Seems to be the logical way to assess in certain
courses.
. Logistically easy.

Against:

.   Defines quality in terms of accumulating small
   quantities.
. Measurement error also accumulates, thus invalidating
    fine discriminations. E.g. there is no valid difference
between 74 and 75, yet to the student it can make a         BIG
difference - an A or a B, or worse, a pass or fail.
. Sends undesirable messages to students (backwash).
Assessing by grading with Rubrics
For:

 •     Student’s performance is appropriately assessed
       against what they are intended to learn – criterion-
       referenced.
 •     Backwash is positive.
 •     The final grade tells students what they have
       achieved and what they need for a better grade.

 Against:

 •     Requires a different mind set for some teachers.
 •     Initially more work in designing ILOs, suitable
       assessment tasks and rubrics, but once established
       is no more extra work than marking.
Qualitative assessment involves making
judgments against criteria (rubrics), not
by counting ‘marks’


 If ILOs are to reflect workplace or ‘real
    world’ standards it is not appropriate
    to state and assess them in terms of
    marks obtained.
 Assessment tasks should likewise
    reflect the ‘real world’ ILOs.
Grading ILOs or Assessment Tasks?

Normally we grade the task (assignment, project,
etc.) but logically we should grade the ILO directly.

Question becomes: how well did the student do in
the ILO (explain …; reflect …; create …), not on how
well did the student do in the project, the exam, …

The student’s transcript might then present a profile
in terms of learning outcomes, which would
probably be of more use to an employer than a GPA,
or profile of marks.
Some Rubrics for Direct Grading of ILOs
               Marginal Pass                 Satisfactory                  Good                      Excellent
                    D                       C-    C    C+               B- B B+                       A- A
 Grade             1.00                    1.70 2.00 2.30              2.70 3.00 3.30                3.70 4.00
 point/unit

 ILOs

Explain    Able to identify and briefly Able to identify a number          Able to identify a full As in “Good” but
     write about limited points.     relevant points with some      range of relevant          provides views on
     Very little evidence of details. Uses these points       Points with details.      possible alternative
     using these points to           to provide a fair reasoning    Supported by relevant causes and/or results
     provide reasoning to            or causality. No evidence      literature. Points are     under changing
why they are inter-           of a comprehensive              organized to provide a conditions. Able to
     related.                        overview of reasoning          comprehensive and          link current
                                     or causality.                  cohesive reasoning or reasoning to
                                                                    causality.                 situations in real-
                                                                                               life professional
                                                                                              contexts.

  Reflect Able to use available           Able to use available             Able to use available As in “Good”. Able
      information to self-           information to self-           information to self-       to generalize self-
             evaluate and identify         evaluate and identify            evaluate and identify evaluation to beyond
             limited aspects of own        more aspects of own              the full range of owm existing context.
             strengths and weaknesses      strengths and weaknesses         strengthes and weak- Suggest ways of
             in a general sense. No        in a general sense. Little       nesses. Self-evaluation improving perform-
             evidence of suggestions       application of theory in         is based on theory.      ance to real-life
             of ways to improve           self-evaluation and limited Increasingly able to           professional
             performance. No evidence      suggestions of ways to           suggest ways to          contest.
             of theory being used in      improve performance.              improve performance
      self-evaluation.                                                in a specific context.
Grading of Assessment Tasks
     in a Portfolio (addressing whatever ILOs apply)
Marginal                    Adequate                       Good                        Excellent
           D                   C- C       C+                  B-    B    B+                 A- A

 The pieces of evidence The evidence is relevant,           The evidence presents a       As in “B” but with
 are relevant and            accurate and covers             good appreciation of         higher degree of
 accurate, but are           several aspects of the          the general thrust of the originality and
 isolated, addressing        course. Little evidence of course. Good coverage              evidence of inter-
 one aspect of the           an overall view of the          with relevant and            nalization into
 course. Demonstration course. Demonstrates                  accurate support. A clear personalized model
 of understanding in a      declarative understanding view of how various                  of practice. Good
 minimally acceptable       of a reasonable amount of aspects of the course               evidence of reflect-
 way. Poor coverage, no content. Able to discuss            integrate to form a           ion on own
 originality, weak          content meaningfully.           thrust or purpose.             performance based
 justification of portfolio Good coverage but little        Good evidence of               on theory.
 items. Inappropriate       Application or integration. application of course             Generalizes course
self-evaluation.            Fair justification of items. Content to practice.              content to new and
                      Attempted realistic self-       Portfolio items well           unfamiliar real-
                         evaluation                   justified. Realistic          life contexts.
                                                             self-evaluation.
For OBASL to work, impediments to
    successful implementation must be
    removed
    all references in policies and
     procedures to norm-referencing and
     grading on the curve. ILOs are meant to
     establish what students know and can
     perform and at what level of
     competence. Grading by comparing
     students is incompatible with
     constructive alignment.
    all references in policies and
     procedures to quantitative marking, in
     percentages or anything else.
Bibliography and some websites on
                constructive alignment
Biggs, J. B. and Tang, C. (2007, 3rd edition) Teaching for
  Quality Learning at University, Maidenhead, UK: Open
  University Press/McGraw Hill, 2007.

General Descriptions of CA
 www.scu.edu.au/services/tl/sd_online/consalign.html
 www.engsc.ac.uk/er/theory/constructive_alignment.asp


Applied to a Web course in botany
 google.com.hk/search?q=%22Constructive+alignment%22&hl=en&lr=&
  start=10&sa=N
 Economics
 ideas.repec.org/a/che/ireepp/v2y2004i1p9-38.html
 Advanced physiology
 advan.physiology.org/cgi/content/full/27/3/146

Mais conteúdo relacionado

Mais procurados

4 instructional objectives
4 instructional objectives4 instructional objectives
4 instructional objectivesAngel Rathnabai
 
Portfolios in self assessment
Portfolios in self assessmentPortfolios in self assessment
Portfolios in self assessmentMaria Mu
 
Content,performance standard
Content,performance standardContent,performance standard
Content,performance standardmarvz18
 
Assessing student learning in diverse ways: Portfolios
Assessing student learning in diverse ways: PortfoliosAssessing student learning in diverse ways: Portfolios
Assessing student learning in diverse ways: PortfoliosCALT
 
Portfolio Assessment
Portfolio AssessmentPortfolio Assessment
Portfolio Assessmentjanehbasto
 
BEHAVIORAL OBJECTIVES
BEHAVIORAL OBJECTIVESBEHAVIORAL OBJECTIVES
BEHAVIORAL OBJECTIVESjonasmole
 
Assessment 2 e-portfolio
Assessment 2 e-portfolioAssessment 2 e-portfolio
Assessment 2 e-portfolioMarvillBautista
 
Assessment for Learning I
Assessment for Learning IAssessment for Learning I
Assessment for Learning ICALT
 
Assessment for Learning Activities
Assessment for Learning ActivitiesAssessment for Learning Activities
Assessment for Learning ActivitiesCharlie Ferguson
 
Cognitive (bloom taxonomy).ppt
Cognitive (bloom taxonomy).pptCognitive (bloom taxonomy).ppt
Cognitive (bloom taxonomy).pptAli Sufyan
 
Writing instructional objectives
Writing instructional objectivesWriting instructional objectives
Writing instructional objectivesleesha roberts
 
Gagnes nine events_of_instruction
Gagnes nine events_of_instructionGagnes nine events_of_instruction
Gagnes nine events_of_instructionPeter Mackey
 
Triangulation in Teaching Assessment & learning Outcomes (2) (1)
Triangulation in Teaching Assessment & learning Outcomes (2) (1)Triangulation in Teaching Assessment & learning Outcomes (2) (1)
Triangulation in Teaching Assessment & learning Outcomes (2) (1)Sheema Haider
 
K to12 ASSESSMENT AND RATING OF LEARNING OUTCOMES
K to12 ASSESSMENT AND RATING OF LEARNING OUTCOMESK to12 ASSESSMENT AND RATING OF LEARNING OUTCOMES
K to12 ASSESSMENT AND RATING OF LEARNING OUTCOMESYanne Evangelista
 
Behavioural objectives
Behavioural objectivesBehavioural objectives
Behavioural objectivesali talahmeh
 

Mais procurados (20)

4 instructional objectives
4 instructional objectives4 instructional objectives
4 instructional objectives
 
Portfolios in self assessment
Portfolios in self assessmentPortfolios in self assessment
Portfolios in self assessment
 
Instructional objectives
Instructional objectivesInstructional objectives
Instructional objectives
 
Content,performance standard
Content,performance standardContent,performance standard
Content,performance standard
 
Assessing student learning in diverse ways: Portfolios
Assessing student learning in diverse ways: PortfoliosAssessing student learning in diverse ways: Portfolios
Assessing student learning in diverse ways: Portfolios
 
Gagnes orig.
Gagnes orig.Gagnes orig.
Gagnes orig.
 
On Constructive Alignment - what & how?
On Constructive Alignment - what & how?On Constructive Alignment - what & how?
On Constructive Alignment - what & how?
 
Designs 2010 Session 3 Elementary
Designs 2010 Session 3 ElementaryDesigns 2010 Session 3 Elementary
Designs 2010 Session 3 Elementary
 
Portfolio Assessment
Portfolio AssessmentPortfolio Assessment
Portfolio Assessment
 
BEHAVIORAL OBJECTIVES
BEHAVIORAL OBJECTIVESBEHAVIORAL OBJECTIVES
BEHAVIORAL OBJECTIVES
 
Assessment 2 e-portfolio
Assessment 2 e-portfolioAssessment 2 e-portfolio
Assessment 2 e-portfolio
 
Assessment for Learning I
Assessment for Learning IAssessment for Learning I
Assessment for Learning I
 
Assessment for Learning Activities
Assessment for Learning ActivitiesAssessment for Learning Activities
Assessment for Learning Activities
 
Cognitive (bloom taxonomy).ppt
Cognitive (bloom taxonomy).pptCognitive (bloom taxonomy).ppt
Cognitive (bloom taxonomy).ppt
 
Writing instructional objectives
Writing instructional objectivesWriting instructional objectives
Writing instructional objectives
 
Gagnes nine events_of_instruction
Gagnes nine events_of_instructionGagnes nine events_of_instruction
Gagnes nine events_of_instruction
 
Triangulation in Teaching Assessment & learning Outcomes (2) (1)
Triangulation in Teaching Assessment & learning Outcomes (2) (1)Triangulation in Teaching Assessment & learning Outcomes (2) (1)
Triangulation in Teaching Assessment & learning Outcomes (2) (1)
 
K to12 ASSESSMENT AND RATING OF LEARNING OUTCOMES
K to12 ASSESSMENT AND RATING OF LEARNING OUTCOMESK to12 ASSESSMENT AND RATING OF LEARNING OUTCOMES
K to12 ASSESSMENT AND RATING OF LEARNING OUTCOMES
 
Behavioural objectives
Behavioural objectivesBehavioural objectives
Behavioural objectives
 
Week 2 - Instructional Objectives
Week 2 - Instructional ObjectivesWeek 2 - Instructional Objectives
Week 2 - Instructional Objectives
 

Semelhante a 677 b bd01

PGCAP cohort 2 week2 designing session and programmes
PGCAP cohort 2 week2 designing session and programmesPGCAP cohort 2 week2 designing session and programmes
PGCAP cohort 2 week2 designing session and programmesAcademic Development
 
Outcome-based Learning Opportunities - Webinar
Outcome-based Learning Opportunities - WebinarOutcome-based Learning Opportunities - Webinar
Outcome-based Learning Opportunities - WebinarMichael Derntl
 
Ailacte
AilacteAilacte
Ailactevaugha
 
Learning to Write through Conceptual Units
Learning to Write through Conceptual UnitsLearning to Write through Conceptual Units
Learning to Write through Conceptual Unitschrsndrsn
 
Lorna Earl Rethinking Classroom Assessment With Purpose In Mind
Lorna Earl Rethinking Classroom Assessment With Purpose In MindLorna Earl Rethinking Classroom Assessment With Purpose In Mind
Lorna Earl Rethinking Classroom Assessment With Purpose In MindNanaimo Ladysmith Public Schools
 
Aim & objective of teaching mathematics
Aim & objective of teaching mathematics Aim & objective of teaching mathematics
Aim & objective of teaching mathematics suresh kumar
 
Tutoring through Assessment: Practices and innovations
Tutoring through Assessment: Practices and innovationsTutoring through Assessment: Practices and innovations
Tutoring through Assessment: Practices and innovationsCEMCA
 
PGCAP cohort 2: week 6 - assessing and feeding back
PGCAP cohort 2: week 6 - assessing and feeding backPGCAP cohort 2: week 6 - assessing and feeding back
PGCAP cohort 2: week 6 - assessing and feeding backAcademic Development
 
Assessment tools for higher learning
Assessment tools for higher learningAssessment tools for higher learning
Assessment tools for higher learningsharifahshahab
 
Lesson planning and demo teaching
Lesson planning and demo teachingLesson planning and demo teaching
Lesson planning and demo teachingAthan Mensalvas
 
Test construction edited
Test construction editedTest construction edited
Test construction editedArnel Rivera
 
PGCAP coresep11 designing (week 3)
PGCAP coresep11 designing (week 3)PGCAP coresep11 designing (week 3)
PGCAP coresep11 designing (week 3)Academic Development
 
Course objectives
Course objectivesCourse objectives
Course objectivesweldesenbet
 
Course objectives
Course objectivesCourse objectives
Course objectivesweldesenbet
 
InTeGrate_Learning_Goal_Webinar_Powerpoint
InTeGrate_Learning_Goal_Webinar_PowerpointInTeGrate_Learning_Goal_Webinar_Powerpoint
InTeGrate_Learning_Goal_Webinar_PowerpointSERC at Carleton College
 
Special topic by Rosalie P. Mabana and Gemma Caranza(Authentic Assessment)
Special topic by Rosalie P. Mabana and Gemma Caranza(Authentic Assessment)Special topic by Rosalie P. Mabana and Gemma Caranza(Authentic Assessment)
Special topic by Rosalie P. Mabana and Gemma Caranza(Authentic Assessment)yunisay13
 

Semelhante a 677 b bd01 (20)

PGCAP cohort 2 week2 designing session and programmes
PGCAP cohort 2 week2 designing session and programmesPGCAP cohort 2 week2 designing session and programmes
PGCAP cohort 2 week2 designing session and programmes
 
PGCAP LTHE week 3: designing
PGCAP LTHE week 3: designingPGCAP LTHE week 3: designing
PGCAP LTHE week 3: designing
 
#LTHESep12 week3 designing @pgcap
#LTHESep12 week3 designing @pgcap#LTHESep12 week3 designing @pgcap
#LTHESep12 week3 designing @pgcap
 
Pgcap week3 designing_corejan12
Pgcap week3 designing_corejan12Pgcap week3 designing_corejan12
Pgcap week3 designing_corejan12
 
Outcome-based Learning Opportunities - Webinar
Outcome-based Learning Opportunities - WebinarOutcome-based Learning Opportunities - Webinar
Outcome-based Learning Opportunities - Webinar
 
Ailacte
AilacteAilacte
Ailacte
 
Learning to Write through Conceptual Units
Learning to Write through Conceptual UnitsLearning to Write through Conceptual Units
Learning to Write through Conceptual Units
 
Lorna Earl Rethinking Classroom Assessment With Purpose In Mind
Lorna Earl Rethinking Classroom Assessment With Purpose In MindLorna Earl Rethinking Classroom Assessment With Purpose In Mind
Lorna Earl Rethinking Classroom Assessment With Purpose In Mind
 
Aim & objective of teaching mathematics
Aim & objective of teaching mathematics Aim & objective of teaching mathematics
Aim & objective of teaching mathematics
 
Tutoring through Assessment: Practices and innovations
Tutoring through Assessment: Practices and innovationsTutoring through Assessment: Practices and innovations
Tutoring through Assessment: Practices and innovations
 
PGCAP cohort 2: week 6 - assessing and feeding back
PGCAP cohort 2: week 6 - assessing and feeding backPGCAP cohort 2: week 6 - assessing and feeding back
PGCAP cohort 2: week 6 - assessing and feeding back
 
Assessment tools for higher learning
Assessment tools for higher learningAssessment tools for higher learning
Assessment tools for higher learning
 
Lesson planning and demo teaching
Lesson planning and demo teachingLesson planning and demo teaching
Lesson planning and demo teaching
 
Test construction edited
Test construction editedTest construction edited
Test construction edited
 
PGCAP coresep11 designing (week 3)
PGCAP coresep11 designing (week 3)PGCAP coresep11 designing (week 3)
PGCAP coresep11 designing (week 3)
 
Course objectives
Course objectivesCourse objectives
Course objectives
 
Stu emp workgroup intro
Stu emp workgroup introStu emp workgroup intro
Stu emp workgroup intro
 
Course objectives
Course objectivesCourse objectives
Course objectives
 
InTeGrate_Learning_Goal_Webinar_Powerpoint
InTeGrate_Learning_Goal_Webinar_PowerpointInTeGrate_Learning_Goal_Webinar_Powerpoint
InTeGrate_Learning_Goal_Webinar_Powerpoint
 
Special topic by Rosalie P. Mabana and Gemma Caranza(Authentic Assessment)
Special topic by Rosalie P. Mabana and Gemma Caranza(Authentic Assessment)Special topic by Rosalie P. Mabana and Gemma Caranza(Authentic Assessment)
Special topic by Rosalie P. Mabana and Gemma Caranza(Authentic Assessment)
 

Mais de SMK PRASASTI KARANG BERAHI JAMBI (20)

72 d86d01
72 d86d0172 d86d01
72 d86d01
 
9 a004d01
9 a004d019 a004d01
9 a004d01
 
8 d946d01
8 d946d018 d946d01
8 d946d01
 
6 e354d01
6 e354d016 e354d01
6 e354d01
 
6 cd4ad01
6 cd4ad016 cd4ad01
6 cd4ad01
 
5 a3a2d01
5 a3a2d015 a3a2d01
5 a3a2d01
 
4 f6a5d01
4 f6a5d014 f6a5d01
4 f6a5d01
 
1 d715d01
1 d715d011 d715d01
1 d715d01
 
1 b1d8d01
1 b1d8d011 b1d8d01
1 b1d8d01
 
26463d01
26463d0126463d01
26463d01
 
97309d01
97309d0197309d01
97309d01
 
50414d01
50414d0150414d01
50414d01
 
913
913913
913
 
754 c2d01
754 c2d01754 c2d01
754 c2d01
 
457 a4d01
457 a4d01457 a4d01
457 a4d01
 
354 b0d01
354 b0d01354 b0d01
354 b0d01
 
232 a7d01
232 a7d01232 a7d01
232 a7d01
 
214 e6d01
214 e6d01214 e6d01
214 e6d01
 
99 ce ed01
99 ce ed0199 ce ed01
99 ce ed01
 
86 c40d01
86 c40d0186 c40d01
86 c40d01
 

677 b bd01

  • 1. Enhancing learning through constructive alignment Professor John Biggs Open University 14 May, 2009
  • 2. Outcomes-based Approaches Three main forms of outcomes-based approaches. All focus on educational outcomes, each based on a different philosophy. 1. Outcome-based approaches at school level. Originally devised by William Spady for disadvantaged children, but later used generally e.g. Target Oriented Curriculum (TOC) for individualising teaching. 2. Outcomes-based approaches at institutional level, used for benchmarking, credit-transfer. Have little directly to do with enhancing teaching and learning. 3. Outcomes-based Approaches to Student Learning (OBASL). Defining learning outcomes at programme and course level, to enhance teaching and learning.
  • 3. What the UGC said “The UGC’s goal in promoting outcome- based approaches is simple and straightforward—improvement and enhancement in student learning and teaching quality.” (Alice Lam, May 05) The UGC has asked local universities to show that they have thought through the "learning outcomes" they expect their students to achieve, and that they are organising educational experiences to enable students to achieve these outcomes. …
  • 4. Outcome-based Approaches to Student Learning (OBASL): the Intended Learning Outcome (ILO) is central Teaching: Assessment: ILO: To facilitate How well What the attaining the the student student has ILOs has attained to do the ILOs
  • 5. Implementing OBASL using Constructive Alignment Assessment: Teaching: How well ILO: Engaging the the student What the student student in the has met the has to learn verb in the ILO ILO
  • 6. Constructive Alignment Intended Learning Outcomes (ILOs) expressed as verbs students have to enact Teaching / Learning A Activities The very best understanding that could be Assessment Tasks reasonably expected: verbs such as Designed to hypothesise, apply to “far” domains, generate, relate to principle, etc. Format such that elicit desired the target verbs are verbs B elicited and Highly satisfactory understanding: verbs deployed May be: such as explain, solve, understand main in context. ideas, analyze, compare, etc. Large class activities C Criteria clearly allow Small class activities Quite satisfactory learning, with under- judgement as to the standing at a declarative level: verbs such quality of the Teacher-managed as elaborate, classify, cover topics a to n, student's performance Peer-managed D Self-managed Understanding at a level that would warrant a Pass: low level verbs, also as best suits context inadequate but salvageable higher level attempts.
  • 7. How constructive alignment started  Constructive alignment was born at HKU. I was teaching psychology not so that the students could tell me what psychology they had learned, but how they could use psychology in order to teach better. They should be telling me if and how it had, not me telling them how I thought it should. They placed their evidence and reflections in a portfolio. Lecturing to them and giving them an MCQ was obviously irrelevant to the real aims of the course: teachers would use psychology to teach more effectively.
  • 8. If students are to learn desired outcomes in a reasonably effective manner, then the teacher’s fundamental task is to get students to engage in learning activities that are likely to result in their achieving those outcomes… It is helpful to remember that what the student does is actually more important in determining what is learned than what the teacher does. (Shuell, 1986: 429)
  • 9. This is in fact a design for teaching: 1. Define the intended learning outcomes that refer not only to content to be learned, but what is to be done with that content and to what standards. 2. Create a learning environment that is likely to engage the student in learning activities that will bring about the intended outcomes. 3. Use assessment tasks that directly address the outcome and that enable you to judge if and how well students’ performances meet the criteria. 4. Transform these judgments into summative grades.
  • 10. Intended Learning Outcomes (ILOs) . Statements of what students are expected to be able to do after studying a course/programme. . Expressed from the students' perspective. . Expressed in the form of action verbs leading to observable and assessable behaviour. . Related to criteria for assessing student performance.
  • 11. Intended Learning Outcomes (ILOs) University level What are the attributes of an ideal graduate of Open U? Programme level What are the intended learning outcomes for students enrolled in the degree programme? Course level What are the intended learning outcomes for students taking a particular course at a particular level within the programme?
  • 12. Distinguish the kind of knowledge you want Declarative knowledge: . Knowing about things . Knowledge we can declare to someone in writing or telling e.g. ‘Distinguish between topic-based and outcomes-based teaching’ Functioning knowledge: . Knowledge we put to work in solving a physics problem, analysing a case study, designing a building, making an argument e.g. ‘Write an ILO for a subject you are currently teaching’
  • 13. Alignment with teaching and assessment is created by the verbs in the ILOs  For example: “Explain the historical evolution of nursing science”  Teaching is specifically aimed at activating the verb – students do the explaining, say to each other providing feedback from rubrics defining aspects of a good explanation. They don’t just listen to the teacher doing the explaining.  Students should be unable to complete the assessment tasks unless they enact the same verb that is in the ILO. Students individually explain to the class how they see the historical evolution of nursing. The teacher, perhaps using peer assessment too, assess each on the same rubrics.  Weak form of alignment: ‘congruence with’ ILO.
  • 14. Programme and Course ILOs Alignment between the programme and course ILOs Course ILOs Programme ILOs Course 1 Course 2 Course 3 1. Are the ILOs aligned? 2. Do the course ILOs appropriately address the programme ILOs? 3. Are the weightings appropriate? 4. Are there any gaps?
  • 15. Procedures in designing Course ILOs 1. Decide what kind of knowledge is to be taught - Declarative or functioning. 2. Select the topics to be taught. 3. Decide the levels of understanding/performance the students are expected to achieve for the different topics. 4. Consider if all the ILOs are of equal importance. 5. Ensure a clear understanding and agreement of the ILOs within the teaching team and other relevant parties, e.g. External Reviewer. 6. Communicate the ILOs to students.
  • 16. The SOLO Taxonomy with sample verbs indicating levels of understanding/performance Create Formulate Analyze Generate Apply Hypothesize Competence Argue Reflect Compare/ Theorize contrast Criticize Combine Describe Explain causes .... Relate Enumerate Justify Identify Perform serial skills Name List Follow simple procedure Fail Incompetent Misses point Incompetence one relevant several relevant integrated into generalized to aspect independent aspects a structure new domain Prestructural Unistructural Multistructural Relational Extended Abstract
  • 17. Designing Teaching/Learning Activities (TLAs) to Align with Intended Learning Outcomes Having designed Programme ILOs and the Course ILOs, we now need to design suitable Teaching/Learning Activities that will facilitate students achieving the ILOs. The best to do this is to activate the verbs or learning activities embedded in the ILOs. NB: there are many alternatives to lectures and tutorials, even in large classes.
  • 18. Typical ILO Possible TLAs Describe reading/lecture followed by presentation Explain tutorial, written essay Integrate project, assignment Apply project, case study Solve problem PBL, case study Design, create project, creative writing Hypothesise experiment, project Reflect reflective diary The point is not how you are going to teach but how and what you want your students to learn. NOTE! Many of these TLAs can be assessments tasks as well. Then you have excellent alignment.
  • 19. Assessment Tasks (ATs) . provide students the opportunity to demonstrate whether or not they have achieved the ILOs and what level their performance is in those ILOs. . should be appropriately designed or selected to address the ILOs that we want to assess. . different assessment methods (tasks) address different ILOs. There should therefore be several kinds of task. . provide the evidence allowing teachers to make a judgment about the level of a student’s performance against the ILOs and to award a final grade.
  • 20. Designing Assessment Tasks (ATs) Steps: 1. Select a practicable task that embodies the target ILO verb. (Try the TLA first). 2. Develop grading criteria so that you can make a judgment on how well the ILO has been met by a student’s performance on each assessment task. 3. Decide how the graded performances can be combined to give a final grade.
  • 21. Common ILOs Possible Assessment Tasks Describe essay question, exam, oral presentation (peer assessment) Explain assignment, essay question exam, oral, letter-to-a-friend Integrate project, assignment Analyse case study, assignment Apply project, case study, experiment Solve problem case study, project, experiment Design, create project, experiment Reflect reflective diary, portfolio, self-assessment Communicate a range of oral, writing or listening tasks, e.g. presentation, debate, role play, reporting, assignment, precis, paraphasing, answering questions etc.
  • 22. Assessing quantitatively by using marks or qualitatively by using rubrics?
  • 23. Assessing by Marks For: . Used to it. . Seems to be the logical way to assess in certain courses. . Logistically easy. Against: . Defines quality in terms of accumulating small quantities. . Measurement error also accumulates, thus invalidating fine discriminations. E.g. there is no valid difference between 74 and 75, yet to the student it can make a BIG difference - an A or a B, or worse, a pass or fail. . Sends undesirable messages to students (backwash).
  • 24. Assessing by grading with Rubrics For: • Student’s performance is appropriately assessed against what they are intended to learn – criterion- referenced. • Backwash is positive. • The final grade tells students what they have achieved and what they need for a better grade. Against: • Requires a different mind set for some teachers. • Initially more work in designing ILOs, suitable assessment tasks and rubrics, but once established is no more extra work than marking.
  • 25. Qualitative assessment involves making judgments against criteria (rubrics), not by counting ‘marks’ If ILOs are to reflect workplace or ‘real world’ standards it is not appropriate to state and assess them in terms of marks obtained. Assessment tasks should likewise reflect the ‘real world’ ILOs.
  • 26. Grading ILOs or Assessment Tasks? Normally we grade the task (assignment, project, etc.) but logically we should grade the ILO directly. Question becomes: how well did the student do in the ILO (explain …; reflect …; create …), not on how well did the student do in the project, the exam, … The student’s transcript might then present a profile in terms of learning outcomes, which would probably be of more use to an employer than a GPA, or profile of marks.
  • 27. Some Rubrics for Direct Grading of ILOs Marginal Pass Satisfactory Good Excellent D C- C C+ B- B B+ A- A Grade 1.00 1.70 2.00 2.30 2.70 3.00 3.30 3.70 4.00 point/unit ILOs Explain Able to identify and briefly Able to identify a number Able to identify a full As in “Good” but write about limited points. relevant points with some range of relevant provides views on Very little evidence of details. Uses these points Points with details. possible alternative using these points to to provide a fair reasoning Supported by relevant causes and/or results provide reasoning to or causality. No evidence literature. Points are under changing why they are inter- of a comprehensive organized to provide a conditions. Able to related. overview of reasoning comprehensive and link current or causality. cohesive reasoning or reasoning to causality. situations in real- life professional contexts. Reflect Able to use available Able to use available Able to use available As in “Good”. Able information to self- information to self- information to self- to generalize self- evaluate and identify evaluate and identify evaluate and identify evaluation to beyond limited aspects of own more aspects of own the full range of owm existing context. strengths and weaknesses strengths and weaknesses strengthes and weak- Suggest ways of in a general sense. No in a general sense. Little nesses. Self-evaluation improving perform- evidence of suggestions application of theory in is based on theory. ance to real-life of ways to improve self-evaluation and limited Increasingly able to professional performance. No evidence suggestions of ways to suggest ways to contest. of theory being used in improve performance. improve performance self-evaluation. in a specific context.
  • 28. Grading of Assessment Tasks in a Portfolio (addressing whatever ILOs apply) Marginal Adequate Good Excellent D C- C C+ B- B B+ A- A The pieces of evidence The evidence is relevant, The evidence presents a As in “B” but with are relevant and accurate and covers good appreciation of higher degree of accurate, but are several aspects of the the general thrust of the originality and isolated, addressing course. Little evidence of course. Good coverage evidence of inter- one aspect of the an overall view of the with relevant and nalization into course. Demonstration course. Demonstrates accurate support. A clear personalized model of understanding in a declarative understanding view of how various of practice. Good minimally acceptable of a reasonable amount of aspects of the course evidence of reflect- way. Poor coverage, no content. Able to discuss integrate to form a ion on own originality, weak content meaningfully. thrust or purpose. performance based justification of portfolio Good coverage but little Good evidence of on theory. items. Inappropriate Application or integration. application of course Generalizes course self-evaluation. Fair justification of items. Content to practice. content to new and Attempted realistic self- Portfolio items well unfamiliar real- evaluation justified. Realistic life contexts. self-evaluation.
  • 29. For OBASL to work, impediments to successful implementation must be removed  all references in policies and procedures to norm-referencing and grading on the curve. ILOs are meant to establish what students know and can perform and at what level of competence. Grading by comparing students is incompatible with constructive alignment.  all references in policies and procedures to quantitative marking, in percentages or anything else.
  • 30. Bibliography and some websites on constructive alignment Biggs, J. B. and Tang, C. (2007, 3rd edition) Teaching for Quality Learning at University, Maidenhead, UK: Open University Press/McGraw Hill, 2007. General Descriptions of CA  www.scu.edu.au/services/tl/sd_online/consalign.html  www.engsc.ac.uk/er/theory/constructive_alignment.asp Applied to a Web course in botany  google.com.hk/search?q=%22Constructive+alignment%22&hl=en&lr=& start=10&sa=N  Economics  ideas.repec.org/a/che/ireepp/v2y2004i1p9-38.html  Advanced physiology  advan.physiology.org/cgi/content/full/27/3/146