SlideShare a Scribd company logo
1 of 20
What are we really trying to do with assessment in teacher education: Resolving Conflicting purposes and principles Sue Bloxham
Certification to identify and discriminate between different levels of achievement, and between students,  providing a license to practice in the case of professional programmes,  enabling selection of students for further study and employment. This is assessment  of  learning.
Quality assurance to provide evidence for relevant stakeholders (for example headteachers, ofsted, external examiners)  to enable them to judge the appropriateness of standards on the programme   This is assessment  of  learning.
Student Learning ,[object Object],[object Object],[object Object],[object Object],This is assessment  for  learning .
Lifelong learning:  sustainable assessment   This is assessment  as  learning .  to achieve an understanding of standards,  to learn how to make judgments,  to be able to use criteria,  to be able to tell when you really understand something
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Classroom Assessment From Shepard, L.A. (2000)
Discussion ,[object Object],[object Object],[object Object]
Conflict in assessment purposes Group assessment Un-seen examinations Peer & self assessment Presentations, debates
Unseen exam Essay Poster setting out scientific work for lay readers Press release Reflective journal Debate speech Designing a leaflet for parents or web resource School-based project Working in a group to make a radio programme Curating an online exhibition Familiar ‘safe’ assessment Methods. Examiners will understand. Newer methods which may assess a wider range of learning and different communication skills Tutor marked Self, peer and tutor marked
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Studies suggest that useful feedback to students   But moderators and external examiners Who is the tutor writing their comments for?
Dealing with conflict ,[object Object],[object Object],[object Object]
Programme assessment environment  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],From Gibbs & Dunbar-Goddet (2007)
Programme assessment map D= developed  A=assessed Con’t through all modules/ placements D D D 206 D D DA 205 D 204 D D DA 203 D DA 105 D DA 104 D D D 103 D 102 D D 101 Programme outcome 6 Programme outcome 5 Programme outcome 4 Programme outcome 3 Programme outcome 2 Programme outcome 1 modules
Discussion ,[object Object],[object Object]
Combining the different purposes of assessment ,[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],From Shepard, L.A. (2000)
Characteristics of learning-oriented assessment ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Field-based enquiry ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Interactive exam ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Patchwork text ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More Related Content

What's hot

Continuous assessment as a relevant tool to quality products of learners in e...
Continuous assessment as a relevant tool to quality products of learners in e...Continuous assessment as a relevant tool to quality products of learners in e...
Continuous assessment as a relevant tool to quality products of learners in e...
William Kapambwe
 
Outcome based education and student learning in managerial
Outcome based education and student learning in managerialOutcome based education and student learning in managerial
Outcome based education and student learning in managerial
etha puteri
 
Alternative assessment
 Alternative assessment Alternative assessment
Alternative assessment
Godfred Abledu
 
Standards based assessment under the k to12
Standards based assessment under the k to12Standards based assessment under the k to12
Standards based assessment under the k to12
Maria Theresa
 

What's hot (20)

Alternative Assessment
Alternative AssessmentAlternative Assessment
Alternative Assessment
 
Assessment of learning outcomes in OBE
Assessment of learning outcomes in OBEAssessment of learning outcomes in OBE
Assessment of learning outcomes in OBE
 
Overview Of Standards Based Curriculum Alignment
Overview Of Standards Based Curriculum AlignmentOverview Of Standards Based Curriculum Alignment
Overview Of Standards Based Curriculum Alignment
 
Continuous assessment as a relevant tool to quality products of learners in e...
Continuous assessment as a relevant tool to quality products of learners in e...Continuous assessment as a relevant tool to quality products of learners in e...
Continuous assessment as a relevant tool to quality products of learners in e...
 
Policy guidelines on classroom assessment for the k to 12 basic education pro...
Policy guidelines on classroom assessment for the k to 12 basic education pro...Policy guidelines on classroom assessment for the k to 12 basic education pro...
Policy guidelines on classroom assessment for the k to 12 basic education pro...
 
Characteristics of outcomes based assessment
Characteristics of outcomes based assessmentCharacteristics of outcomes based assessment
Characteristics of outcomes based assessment
 
Modern trends in Educational Assessment
Modern trends in Educational Assessment Modern trends in Educational Assessment
Modern trends in Educational Assessment
 
Designing good assessment
Designing good assessmentDesigning good assessment
Designing good assessment
 
Formative assessment aicha abidi & mohame nafa
Formative assessment   aicha abidi & mohame nafaFormative assessment   aicha abidi & mohame nafa
Formative assessment aicha abidi & mohame nafa
 
Assessment literacy for effective classroom-based assessment
Assessment literacy for effective classroom-based assessmentAssessment literacy for effective classroom-based assessment
Assessment literacy for effective classroom-based assessment
 
Assessment DO no.8, s.2015
Assessment DO no.8, s.2015Assessment DO no.8, s.2015
Assessment DO no.8, s.2015
 
Assessment for Learning I
Assessment for Learning IAssessment for Learning I
Assessment for Learning I
 
CONTINUOUS ASSESSMENT PROPOSAL AND IMPLEMENTATION IN OPEN EDUCATION PROJECT
CONTINUOUS ASSESSMENT PROPOSAL AND IMPLEMENTATION IN  OPEN EDUCATION PROJECTCONTINUOUS ASSESSMENT PROPOSAL AND IMPLEMENTATION IN  OPEN EDUCATION PROJECT
CONTINUOUS ASSESSMENT PROPOSAL AND IMPLEMENTATION IN OPEN EDUCATION PROJECT
 
Designing Teaching: ASSURE
Designing Teaching: ASSUREDesigning Teaching: ASSURE
Designing Teaching: ASSURE
 
Outcome based education and student learning in managerial
Outcome based education and student learning in managerialOutcome based education and student learning in managerial
Outcome based education and student learning in managerial
 
Development of Proposed Computer Program for Quarterly Assessments Activities
Development of Proposed Computer Program for Quarterly Assessments Activities Development of Proposed Computer Program for Quarterly Assessments Activities
Development of Proposed Computer Program for Quarterly Assessments Activities
 
Assessment of learning
Assessment of learningAssessment of learning
Assessment of learning
 
Alternative assessment
 Alternative assessment Alternative assessment
Alternative assessment
 
Learning outcomes
Learning outcomesLearning outcomes
Learning outcomes
 
Standards based assessment under the k to12
Standards based assessment under the k to12Standards based assessment under the k to12
Standards based assessment under the k to12
 

Similar to ESCalate Seminar- Assessment: Challenging Practice

Chapter 10
Chapter 10Chapter 10
Chapter 10
haneyjw
 
Edgh952 assign3 davis
Edgh952 assign3 davisEdgh952 assign3 davis
Edgh952 assign3 davis
Cible Davis
 
using Project as a procedure for famative assesssment
using Project as a procedure for famative assesssmentusing Project as a procedure for famative assesssment
using Project as a procedure for famative assesssment
Sohail Ahmad
 

Similar to ESCalate Seminar- Assessment: Challenging Practice (20)

Criteria for curriculum assessment
Criteria for curriculum assessmentCriteria for curriculum assessment
Criteria for curriculum assessment
 
A#4.Loor.Yadira.CI.DISEÑO.ESTRATEGÍAS.pptx
A#4.Loor.Yadira.CI.DISEÑO.ESTRATEGÍAS.pptxA#4.Loor.Yadira.CI.DISEÑO.ESTRATEGÍAS.pptx
A#4.Loor.Yadira.CI.DISEÑO.ESTRATEGÍAS.pptx
 
15366790.pdf
15366790.pdf15366790.pdf
15366790.pdf
 
A4.Villacis.Erick.Catedra.Integradora.pptx
A4.Villacis.Erick.Catedra.Integradora.pptxA4.Villacis.Erick.Catedra.Integradora.pptx
A4.Villacis.Erick.Catedra.Integradora.pptx
 
Conducting Material Evaluation
Conducting Material EvaluationConducting Material Evaluation
Conducting Material Evaluation
 
Chapter 10
Chapter 10Chapter 10
Chapter 10
 
Reimagining and Reinforcing Student Success Into Career Success Across the Cu...
Reimagining and Reinforcing Student Success Into Career Success Across the Cu...Reimagining and Reinforcing Student Success Into Career Success Across the Cu...
Reimagining and Reinforcing Student Success Into Career Success Across the Cu...
 
DU CTLAT Presentation Assessing Student Learning Outcomes Educational Program...
DU CTLAT Presentation Assessing Student Learning Outcomes Educational Program...DU CTLAT Presentation Assessing Student Learning Outcomes Educational Program...
DU CTLAT Presentation Assessing Student Learning Outcomes Educational Program...
 
Curriculum mapping intro
Curriculum mapping introCurriculum mapping intro
Curriculum mapping intro
 
Differentiation Instruction
Differentiation InstructionDifferentiation Instruction
Differentiation Instruction
 
Interdisciplinary teaching and learning- objectives and assessment
Interdisciplinary teaching and learning- objectives and assessmentInterdisciplinary teaching and learning- objectives and assessment
Interdisciplinary teaching and learning- objectives and assessment
 
Criteria for Curriculum Assessment
Criteria for Curriculum AssessmentCriteria for Curriculum Assessment
Criteria for Curriculum Assessment
 
Edgh952 assign3 davis
Edgh952 assign3 davisEdgh952 assign3 davis
Edgh952 assign3 davis
 
using Project as a procedure for famative assesssment
using Project as a procedure for famative assesssmentusing Project as a procedure for famative assesssment
using Project as a procedure for famative assesssment
 
Developing teacher quality and effectiveness in new teachers for nyu
Developing teacher quality and effectiveness  in new teachers for nyuDeveloping teacher quality and effectiveness  in new teachers for nyu
Developing teacher quality and effectiveness in new teachers for nyu
 
continous assessment (LH) for Jinela Teachers.pdf
continous assessment (LH)   for Jinela Teachers.pdfcontinous assessment (LH)   for Jinela Teachers.pdf
continous assessment (LH) for Jinela Teachers.pdf
 
Assessment in the K12 Classroom
Assessment in the K12 ClassroomAssessment in the K12 Classroom
Assessment in the K12 Classroom
 
Building Foundations for Para-professionalism
Building Foundations for Para-professionalismBuilding Foundations for Para-professionalism
Building Foundations for Para-professionalism
 
ADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdfADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdf
 
Ib
IbIb
Ib
 

More from Mike Blamires

ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
ECER 2010: Curriculum Reform in Four Nations: a home international perspective: ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
Mike Blamires
 
Elmis Conference Powerpoint Presentation
Elmis Conference Powerpoint PresentationElmis Conference Powerpoint Presentation
Elmis Conference Powerpoint Presentation
Mike Blamires
 
Progression At Pupil, School And National Levels
Progression At Pupil, School And National LevelsProgression At Pupil, School And National Levels
Progression At Pupil, School And National Levels
Mike Blamires
 
Evaluation Of Virtual School Heads For Looked After Children
Evaluation Of Virtual School Heads For Looked After ChildrenEvaluation Of Virtual School Heads For Looked After Children
Evaluation Of Virtual School Heads For Looked After Children
Mike Blamires
 
Making The Most Of Longitudinal Data
Making The Most Of Longitudinal DataMaking The Most Of Longitudinal Data
Making The Most Of Longitudinal Data
Mike Blamires
 

More from Mike Blamires (20)

Marti aned education plus sen
Marti aned education plus senMarti aned education plus sen
Marti aned education plus sen
 
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...
Educating for Entrepreneurial Mindsets (MESHGuide): A critical consideration ...
 
Wealth Taking or Wealth Making?: What Does The Evidence Tell Us About Effecti...
Wealth Taking or Wealth Making?:What Does The Evidence Tell Us About Effecti...Wealth Taking or Wealth Making?:What Does The Evidence Tell Us About Effecti...
Wealth Taking or Wealth Making?: What Does The Evidence Tell Us About Effecti...
 
A
AA
A
 
Lsda models of_research_impact
Lsda models of_research_impactLsda models of_research_impact
Lsda models of_research_impact
 
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580
Evaluation of the Communication Aids Project (CAP) DFES (2004) Rr580
 
The Public, the Personal and National Curricula: Reform in England 1988 to 2010
The Public, the Personal and National Curricula: Reform in England 1988 to 2010The Public, the Personal and National Curricula: Reform in England 1988 to 2010
The Public, the Personal and National Curricula: Reform in England 1988 to 2010
 
ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
ECER 2010: Curriculum Reform in Four Nations: a home international perspective: ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
ECER 2010: Curriculum Reform in Four Nations: a home international perspective:
 
The School Curriculum in Wales and Devolution: Evidence Informed Policy
The School Curriculum in Wales and Devolution: Evidence Informed PolicyThe School Curriculum in Wales and Devolution: Evidence Informed Policy
The School Curriculum in Wales and Devolution: Evidence Informed Policy
 
Education reform in Scotland: engagement, consultation and the politics of ch...
Education reform in Scotland: engagement, consultation and the politics of ch...Education reform in Scotland: engagement, consultation and the politics of ch...
Education reform in Scotland: engagement, consultation and the politics of ch...
 
Policy, Politics and Curriculum and Assessment Change in Northern Ireland
Policy, Politics and Curriculum and Assessment Change in Northern IrelandPolicy, Politics and Curriculum and Assessment Change in Northern Ireland
Policy, Politics and Curriculum and Assessment Change in Northern Ireland
 
Elmis Conference Powerpoint Presentation
Elmis Conference Powerpoint PresentationElmis Conference Powerpoint Presentation
Elmis Conference Powerpoint Presentation
 
Progression At Pupil, School And National Levels
Progression At Pupil, School And National LevelsProgression At Pupil, School And National Levels
Progression At Pupil, School And National Levels
 
Evaluation Of Virtual School Heads For Looked After Children
Evaluation Of Virtual School Heads For Looked After ChildrenEvaluation Of Virtual School Heads For Looked After Children
Evaluation Of Virtual School Heads For Looked After Children
 
Making The Most Of Longitudinal Data
Making The Most Of Longitudinal DataMaking The Most Of Longitudinal Data
Making The Most Of Longitudinal Data
 
Planning for the Future: How the Data & Statistics Strategy will help us get ...
Planning for the Future: How the Data & Statistics Strategy will help us get ...Planning for the Future: How the Data & Statistics Strategy will help us get ...
Planning for the Future: How the Data & Statistics Strategy will help us get ...
 
Defining the Eradication of Child Poverty in the Child Poverty Bill
Defining the Eradication of Child Poverty in the Child Poverty BillDefining the Eradication of Child Poverty in the Child Poverty Bill
Defining the Eradication of Child Poverty in the Child Poverty Bill
 
STEM: Progression from GCSE to A Level
STEM: Progression from GCSE to A LevelSTEM: Progression from GCSE to A Level
STEM: Progression from GCSE to A Level
 
Using Tellus data for National and Local Indicators
Using Tellus data for National and Local IndicatorsUsing Tellus data for National and Local Indicators
Using Tellus data for National and Local Indicators
 
Tellus4: Delivering the survey
Tellus4: Delivering the surveyTellus4: Delivering the survey
Tellus4: Delivering the survey
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 

Recently uploaded (20)

Role Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptxRole Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptx
 
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-IIFood Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 

ESCalate Seminar- Assessment: Challenging Practice

  • 1. What are we really trying to do with assessment in teacher education: Resolving Conflicting purposes and principles Sue Bloxham
  • 2. Certification to identify and discriminate between different levels of achievement, and between students, providing a license to practice in the case of professional programmes, enabling selection of students for further study and employment. This is assessment of learning.
  • 3. Quality assurance to provide evidence for relevant stakeholders (for example headteachers, ofsted, external examiners) to enable them to judge the appropriateness of standards on the programme This is assessment of learning.
  • 4.
  • 5. Lifelong learning: sustainable assessment This is assessment as learning . to achieve an understanding of standards, to learn how to make judgments, to be able to use criteria, to be able to tell when you really understand something
  • 6.
  • 7.
  • 8. Conflict in assessment purposes Group assessment Un-seen examinations Peer & self assessment Presentations, debates
  • 9. Unseen exam Essay Poster setting out scientific work for lay readers Press release Reflective journal Debate speech Designing a leaflet for parents or web resource School-based project Working in a group to make a radio programme Curating an online exhibition Familiar ‘safe’ assessment Methods. Examiners will understand. Newer methods which may assess a wider range of learning and different communication skills Tutor marked Self, peer and tutor marked
  • 10.
  • 11.
  • 12.
  • 13. Programme assessment map D= developed A=assessed Con’t through all modules/ placements D D D 206 D D DA 205 D 204 D D DA 203 D DA 105 D DA 104 D D D 103 D 102 D D 101 Programme outcome 6 Programme outcome 5 Programme outcome 4 Programme outcome 3 Programme outcome 2 Programme outcome 1 modules
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.