SlideShare uma empresa Scribd logo
1 de 15
Baixar para ler offline
Applying standards to
testing
KAYSERI, 29-31 JANUARY 2014
Aims

! 

Objectives of setting up standards

! 

Overview of international testing standards

! 

The Common European Framework of Reference
Standards = code of practice

! 

an agreed set of guidelines which should be
consulted and, as far as possible, heeded in the
construction and evaluation of a test
(definition from Language Test Construction and
Evaluation by Alderson, Clapham and Wall, 1995
CUP)
Standards: history

! 

late 20th century:
!  various

competing educational and testing standards

!  some

widely respected, but no universal acceptance:
ALTE Code of Practice (1994) or UCLES Standards (for
Cambridge Main Suite exams)

! 

early 21st century:
!  move

towards internationally recognised standards: the
CEFR (2001)
What the CEFR is

! 

The Common European Framework of Reference for
Languages – Learning, Teaching, Assessment

! 

A Council of Europe project, initiated in 2001

! 

Designed to facilitate ‘mutual recognition of
qualifications, and communication concerning
objectives and achievement standards’

! 

Description, not prescription
What the CEFR isn’t

! 

Not a framework only for Europe (or for the EU)

! 

Not a language teaching curriculum, or syllabus plan

! 

Not an exam system

! 

The Portfolio is only part of the CEFR, and so are the
assessment tables
The Common Reference Levels
Reception
Listening

C2

Audiovisual

Interaction
Reading

Proficient user

C1
B2

Independent user

B1
A2
A1

Basic user

Production

Spoken

Spoken

Written

Written
Criticism of the CEFR
! 

Not user-friendly

! 

Practices differ from school to school, from country to
country

! 

Policymakers see CEFR as a quick fix

! 

The implementation is top-down

! 

Applying the assessment tables in practice is
complicated

! 

Favours the communicate approach only

! 

Creativity is limited
Benefits of the CEFR
! 

The CEFR can be the basis of a school (or national)
curriculum, offering transparent standards

! 

The CEFR can be the basis of a course syllabus

! 

The assessment criteria can serve as the basis for
exam specifications

! 

The Portfolio involves the learner in the process of
their learning (! self-assessment)

! 

The use of CEFR level labels makes distinction
between courses clearer
Disadvantages of applying
CEFR in the school classroom
! 

No measure of grammar-based progression

! 

Not geared towards school-based learners (and
towards non-adults)

! 

Self-assessment descriptors are not exhaustive

! 

Some functional areas are not covered
Advantages of applying CEFR
in the school classroom
! 

Focus on situational / functional language (real
world context)

! 

Skills and strategies (‘can do’)

! 

Less focus on mechanical practice

! 

Clear link between student achievement and exams

! 

Self-assessment and autonomy

! 

Encouragement of continuity
Portfolio
Portfolio: CEFR applied to teaching
! 

Continuous assessment throughout the
learning career

! 

Portfolio work is not only for beginners

! 

Any age group

! 

The Portfolio belongs to the learner, not to
the institution or teacher

! 

The Portfolio becomes a record of the
learning process
Thank you!

zoltan.rezmuves@digimedia.hu
consonantvoiced.blogspot.com

Mais conteúdo relacionado

Destaque

Destaque (7)

Progetti PON C5
Progetti PON C5Progetti PON C5
Progetti PON C5
 
CTS-Academic: Module 2 session 2 theories of language learning
CTS-Academic: Module 2 session 2 theories of language learningCTS-Academic: Module 2 session 2 theories of language learning
CTS-Academic: Module 2 session 2 theories of language learning
 
Tutorial como insertar una imagen
Tutorial como insertar una imagenTutorial como insertar una imagen
Tutorial como insertar una imagen
 
Corsi di inglese per giovani ingegneri - English for Young Engineers
Corsi di inglese per giovani ingegneri - English for Young EngineersCorsi di inglese per giovani ingegneri - English for Young Engineers
Corsi di inglese per giovani ingegneri - English for Young Engineers
 
Corsi di business english 2016
Corsi di business english 2016Corsi di business english 2016
Corsi di business english 2016
 
Corso di Business English a Londra per giovani. Possibilità di stage successivo
Corso di Business English a Londra per giovani. Possibilità di stage successivoCorso di Business English a Londra per giovani. Possibilità di stage successivo
Corso di Business English a Londra per giovani. Possibilità di stage successivo
 
3.3 tests of productive skills: workshop CTS-Academic
3.3 tests of productive skills: workshop CTS-Academic3.3 tests of productive skills: workshop CTS-Academic
3.3 tests of productive skills: workshop CTS-Academic
 

Semelhante a 2.1 applying standards to testing: plenary CTS-Academic

A quality approach to CEFR implementation
A quality approach to CEFR implementation A quality approach to CEFR implementation
A quality approach to CEFR implementation
eaquals
 
Thom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speakingThom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speaking
eaquals
 
31GEP3_GA3_Common European Framework
31GEP3_GA3_Common European Framework31GEP3_GA3_Common European Framework
31GEP3_GA3_Common European Framework
carobuf
 
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Claudia Martínez
 
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspectionSarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
eaquals
 
Assessnent literacy apr 14 (fiona barker)
Assessnent literacy apr 14 (fiona barker)Assessnent literacy apr 14 (fiona barker)
Assessnent literacy apr 14 (fiona barker)
eaquals
 
Using the European Profiling Grid
Using the European Profiling Grid Using the European Profiling Grid
Using the European Profiling Grid
eaquals
 

Semelhante a 2.1 applying standards to testing: plenary CTS-Academic (20)

Summary:The Common European Framework of Reference for Language
Summary:The Common European Framework of Reference for Language Summary:The Common European Framework of Reference for Language
Summary:The Common European Framework of Reference for Language
 
3.1 curriculum and assessment: plenary CTS-Academic
3.1 curriculum and assessment: plenary CTS-Academic3.1 curriculum and assessment: plenary CTS-Academic
3.1 curriculum and assessment: plenary CTS-Academic
 
1.1 language assessment in Turkey: plenary CTS-Academic
1.1 language assessment in Turkey: plenary CTS-Academic1.1 language assessment in Turkey: plenary CTS-Academic
1.1 language assessment in Turkey: plenary CTS-Academic
 
A quality approach to CEFR implementation
A quality approach to CEFR implementation A quality approach to CEFR implementation
A quality approach to CEFR implementation
 
Roadmap_MoE_290616.pptx
Roadmap_MoE_290616.pptxRoadmap_MoE_290616.pptx
Roadmap_MoE_290616.pptx
 
Khoa hoc TESOL tai truong Anh ngu EV - Cebu
Khoa hoc TESOL tai truong Anh ngu EV - CebuKhoa hoc TESOL tai truong Anh ngu EV - Cebu
Khoa hoc TESOL tai truong Anh ngu EV - Cebu
 
CEFR-based tools and resources: latest developments (Mila Angelova)
CEFR-based tools and resources: latest developments (Mila Angelova)CEFR-based tools and resources: latest developments (Mila Angelova)
CEFR-based tools and resources: latest developments (Mila Angelova)
 
Thom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speakingThom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speaking
 
Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...
Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...
Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...
 
Assessment Module 3
Assessment Module 3Assessment Module 3
Assessment Module 3
 
ppt CEFR.ppt
ppt CEFR.pptppt CEFR.ppt
ppt CEFR.ppt
 
!ppt CEFR.ppt
!ppt CEFR.ppt!ppt CEFR.ppt
!ppt CEFR.ppt
 
31GEP3_GA3_Common European Framework
31GEP3_GA3_Common European Framework31GEP3_GA3_Common European Framework
31GEP3_GA3_Common European Framework
 
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
 
53 1-6
53 1-653 1-6
53 1-6
 
Classroom Practices for English Learners (ELs) Instruction
Classroom Practices for English Learners (ELs) InstructionClassroom Practices for English Learners (ELs) Instruction
Classroom Practices for English Learners (ELs) Instruction
 
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspectionSarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
 
Evaluation in Capacity-Building Strategy: The Next Step in the LMD Philosophy
Evaluation in Capacity-Building Strategy: The Next Step in the LMD PhilosophyEvaluation in Capacity-Building Strategy: The Next Step in the LMD Philosophy
Evaluation in Capacity-Building Strategy: The Next Step in the LMD Philosophy
 
Assessnent literacy apr 14 (fiona barker)
Assessnent literacy apr 14 (fiona barker)Assessnent literacy apr 14 (fiona barker)
Assessnent literacy apr 14 (fiona barker)
 
Using the European Profiling Grid
Using the European Profiling Grid Using the European Profiling Grid
Using the European Profiling Grid
 

Mais de SeltAcademy

Mais de SeltAcademy (15)

CTS-Academic: Module 2 session 9 cognitive processes
CTS-Academic: Module 2 session 9 cognitive processesCTS-Academic: Module 2 session 9 cognitive processes
CTS-Academic: Module 2 session 9 cognitive processes
 
CTS-Academic: Module 2 session 8 psycholinguistics
CTS-Academic: Module 2 session 8 psycholinguisticsCTS-Academic: Module 2 session 8 psycholinguistics
CTS-Academic: Module 2 session 8 psycholinguistics
 
CTS-Academic: Module 2 session 6 classroom sla
CTS-Academic: Module 2 session 6 classroom slaCTS-Academic: Module 2 session 6 classroom sla
CTS-Academic: Module 2 session 6 classroom sla
 
CTS-Academic: Module 2 session 5 sla research
CTS-Academic: Module 2 session 5 sla researchCTS-Academic: Module 2 session 5 sla research
CTS-Academic: Module 2 session 5 sla research
 
CTS-Academic: Module 2 session 3 theories of language learning
CTS-Academic: Module 2 session 3 theories of language learningCTS-Academic: Module 2 session 3 theories of language learning
CTS-Academic: Module 2 session 3 theories of language learning
 
CTS-Academic: Module 2 session 1 theories of language
CTS-Academic: Module 2 session 1 theories of languageCTS-Academic: Module 2 session 1 theories of language
CTS-Academic: Module 2 session 1 theories of language
 
1.3 tests of grammar and vocabulary: workshop CTS-Academic
1.3 tests of grammar and vocabulary: workshop CTS-Academic1.3 tests of grammar and vocabulary: workshop CTS-Academic
1.3 tests of grammar and vocabulary: workshop CTS-Academic
 
2.3 tests of receptive skills: workshop CTS-Academic
2.3 tests of receptive skills: workshop CTS-Academic2.3 tests of receptive skills: workshop CTS-Academic
2.3 tests of receptive skills: workshop CTS-Academic
 
3.2 test development cycle: plenary CTS-Academic
3.2 test development cycle: plenary CTS-Academic3.2 test development cycle: plenary CTS-Academic
3.2 test development cycle: plenary CTS-Academic
 
2.2.test design test writing: plenary CTS-Academic
2.2.test design test writing: plenary CTS-Academic2.2.test design test writing: plenary CTS-Academic
2.2.test design test writing: plenary CTS-Academic
 
1.2 principles of test design: plenary CTS-Academic
1.2 principles of test design: plenary CTS-Academic1.2 principles of test design: plenary CTS-Academic
1.2 principles of test design: plenary CTS-Academic
 
Part 3 great opportunities great expectations
Part 3 great opportunities great expectationsPart 3 great opportunities great expectations
Part 3 great opportunities great expectations
 
Part 2 great opportunities great expectations
Part 2 great opportunities great expectationsPart 2 great opportunities great expectations
Part 2 great opportunities great expectations
 
Part 1 great opportunities great expectations
Part 1 great opportunities great expectationsPart 1 great opportunities great expectations
Part 1 great opportunities great expectations
 
Types of stories for children
Types of stories for childrenTypes of stories for children
Types of stories for children
 

Último

Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 

Último (20)

TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 

2.1 applying standards to testing: plenary CTS-Academic

  • 2.
  • 3. Aims !  Objectives of setting up standards !  Overview of international testing standards !  The Common European Framework of Reference
  • 4. Standards = code of practice !  an agreed set of guidelines which should be consulted and, as far as possible, heeded in the construction and evaluation of a test (definition from Language Test Construction and Evaluation by Alderson, Clapham and Wall, 1995 CUP)
  • 5. Standards: history !  late 20th century: !  various competing educational and testing standards !  some widely respected, but no universal acceptance: ALTE Code of Practice (1994) or UCLES Standards (for Cambridge Main Suite exams) !  early 21st century: !  move towards internationally recognised standards: the CEFR (2001)
  • 6. What the CEFR is !  The Common European Framework of Reference for Languages – Learning, Teaching, Assessment !  A Council of Europe project, initiated in 2001 !  Designed to facilitate ‘mutual recognition of qualifications, and communication concerning objectives and achievement standards’ !  Description, not prescription
  • 7. What the CEFR isn’t !  Not a framework only for Europe (or for the EU) !  Not a language teaching curriculum, or syllabus plan !  Not an exam system !  The Portfolio is only part of the CEFR, and so are the assessment tables
  • 8. The Common Reference Levels Reception Listening C2 Audiovisual Interaction Reading Proficient user C1 B2 Independent user B1 A2 A1 Basic user Production Spoken Spoken Written Written
  • 9. Criticism of the CEFR !  Not user-friendly !  Practices differ from school to school, from country to country !  Policymakers see CEFR as a quick fix !  The implementation is top-down !  Applying the assessment tables in practice is complicated !  Favours the communicate approach only !  Creativity is limited
  • 10. Benefits of the CEFR !  The CEFR can be the basis of a school (or national) curriculum, offering transparent standards !  The CEFR can be the basis of a course syllabus !  The assessment criteria can serve as the basis for exam specifications !  The Portfolio involves the learner in the process of their learning (! self-assessment) !  The use of CEFR level labels makes distinction between courses clearer
  • 11. Disadvantages of applying CEFR in the school classroom !  No measure of grammar-based progression !  Not geared towards school-based learners (and towards non-adults) !  Self-assessment descriptors are not exhaustive !  Some functional areas are not covered
  • 12. Advantages of applying CEFR in the school classroom !  Focus on situational / functional language (real world context) !  Skills and strategies (‘can do’) !  Less focus on mechanical practice !  Clear link between student achievement and exams !  Self-assessment and autonomy !  Encouragement of continuity
  • 14. Portfolio: CEFR applied to teaching !  Continuous assessment throughout the learning career !  Portfolio work is not only for beginners !  Any age group !  The Portfolio belongs to the learner, not to the institution or teacher !  The Portfolio becomes a record of the learning process