SlideShare uma empresa Scribd logo
1 de 18
EL CLUC d’anglès, el nou certificat de les
          universitats de Catalunya



Universitat de Barcelona - Universitat Autònoma de Barcelona - Universitat Politècnica de Catalunya
Universitat Pompeu Fabra - Universitat de Lleida - Universitat de Girona - Universitat Rovira i Virgili
            Universitat Ramon Llull - Universitat Oberta de Catalunya - Universitat de Vic
                 Universitat Internacional de Catalunya - Universitat Abat Oliba CEU


                                                         Sònia Prats, APAC 2013
Why?




   Need for our own exam in Catalonia

   To serve the specific requirements of the university community

   Other interuniversity projects working well: CIFOLC, ComComunicar, ...

   To support the good work carried out at our university language centers in
    terms of assessment
How?




        PUC (Prova universitària de competència en anglès)

        Interlingua grants, from the Consell Interuniversitari de Catalunya

        February 2012, meeting of the university language-centre directors;
         March 2012, proposal and commission
What’s in it for me?
What?



         Levels

         Addressed to

         Cost

         When

         Who gets involved in the project

         What will be assessed

         What can be reused from the old PUC exam
Steps


     Specifications for writing & speaking & reading tests

     Elaboration of the different parts

         Reading & text-mapping
         Writing
         Speaking

     Assessment criteria

          Writing
          Reading
          Speaking: holistic and analytic
Steps
      Piloting
The sample that participated in the study comprised 433 students of English at B1, B2 and C1 levels
taking courses at five Catalan universities: the UAB, the UdL, the UPC, the UPF and the UVic.

Distribution of participants according to university of study:
 Piloting

    Data processing (statistical, feedback questionnaires,...)
 Piloting: consequences and improvements made

         Cut-off points and selection of texts (oral & reading)

         Rewording of instructions

         Eliminate certain items (reading and Simtest)

         Timing confirmed

         Reordering different parts of oral text

         Video recordings and writing samples for future reference and use, to
          establish gold standard

         More scripting (and more detailed) needed for examiners and invigilators
Essential




    Assessors: qualities and experience needed

    Training (norming sessions)

    Collect all feedback

    Documents created and storage

    Final results: excel and instructions
Also important




    Administrative regulations of the different tests

    Administration guide: procedures, issuing of certificates,...

    Publicity: transparency of information, quality standards

    Certification / ACLES

    CLUC and the media
And what next?
Bibliography



    Council of Europe (2011). Common European Framework of Reference for Languages: Learning, Teaching, Assessment.

    Rita Green, Statistical Analysis for Language Testers (Palgrave Macmillan, 2013)

    Fulcher, G. and Davidson, F. Language Testing and Assessment (Routledge, 2007)

    Bachman, L.F. and Palmer, A.S. Language Testing in Practice: Designing and Developing Useful Language Tests.
    (Oxford University Press, 1996)
ille!                 Mer
             m                               c i be
    Grazie                                          auco
                                                         up!
                  Moltes gràcies!


                   s!         Tha
         g racia                  nk
     has                                 you
¡Muc                                           very
                                                      muc
                                                            h!
                   sonia.prats@uab.cat

               Coordinació CLUC, 2012-2013

Mais conteúdo relacionado

Semelhante a CLUC, APAC Presentation 2013

A story for refocusing: “A Proposal for a Quality Framework for MOOCs based o...
A story for refocusing: “A Proposal for a Quality Framework for MOOCs based o...A story for refocusing: “A Proposal for a Quality Framework for MOOCs based o...
A story for refocusing: “A Proposal for a Quality Framework for MOOCs based o...Global OER Graduate Network
 
2011 Meet the Parents Session - 1NA (Year-End)
2011 Meet the Parents Session - 1NA (Year-End)2011 Meet the Parents Session - 1NA (Year-End)
2011 Meet the Parents Session - 1NA (Year-End)damaisec
 
2011 Meet the Parents Session - 2EXP (Year-End)
2011 Meet the Parents Session - 2EXP (Year-End)2011 Meet the Parents Session - 2EXP (Year-End)
2011 Meet the Parents Session - 2EXP (Year-End)damaisec
 
Language Literacy & MOOCs
Language Literacy & MOOCsLanguage Literacy & MOOCs
Language Literacy & MOOCsMaria Perifanou
 
Julia Zabala & Cristina Perez-Guillot: Designing a Language Programme Based o...
Julia Zabala & Cristina Perez-Guillot: Designing a Language Programme Based o...Julia Zabala & Cristina Perez-Guillot: Designing a Language Programme Based o...
Julia Zabala & Cristina Perez-Guillot: Designing a Language Programme Based o...eaquals
 
Ec Presentation Roma
Ec Presentation   RomaEc Presentation   Roma
Ec Presentation RomaYouth Agora
 
Current International Developments in English Language Teaching (ELT) and Imp...
Current International Developments in English Language Teaching (ELT) and Imp...Current International Developments in English Language Teaching (ELT) and Imp...
Current International Developments in English Language Teaching (ELT) and Imp...Hala Nur
 
Assessment of oral skills roleplay
Assessment of oral skills roleplayAssessment of oral skills roleplay
Assessment of oral skills roleplayLourdes Pomposo
 
20140606 Hestia Digital Pedagogy
20140606 Hestia Digital Pedagogy20140606 Hestia Digital Pedagogy
20140606 Hestia Digital PedagogyMairLloyd
 
National Curriculum
National CurriculumNational Curriculum
National CurriculumMLTA of NSW
 
sample syllabus in Organization of Information Sources II
sample syllabus in Organization of Information Sources IIsample syllabus in Organization of Information Sources II
sample syllabus in Organization of Information Sources IICynthia Narra
 
2011 Meet the Parents Session - 1EXP (Year End)
2011 Meet the Parents Session - 1EXP (Year End)2011 Meet the Parents Session - 1EXP (Year End)
2011 Meet the Parents Session - 1EXP (Year End)damaisec
 
2011 Meet the Parents Session - 1EXP (Year End)
2011 Meet the Parents Session - 1EXP (Year End)2011 Meet the Parents Session - 1EXP (Year End)
2011 Meet the Parents Session - 1EXP (Year End)damaisec
 
“On the path to crystal mountain” a trek and elt in the 21st century
“On the path to crystal mountain” a trek and elt in the 21st century“On the path to crystal mountain” a trek and elt in the 21st century
“On the path to crystal mountain” a trek and elt in the 21st centuryDirectinterNetLocator.Com
 
Culegere de teste competenta lingvistica
Culegere de teste competenta lingvisticaCulegere de teste competenta lingvistica
Culegere de teste competenta lingvisticatdaniela2005br
 

Semelhante a CLUC, APAC Presentation 2013 (20)

A story for refocusing: “A Proposal for a Quality Framework for MOOCs based o...
A story for refocusing: “A Proposal for a Quality Framework for MOOCs based o...A story for refocusing: “A Proposal for a Quality Framework for MOOCs based o...
A story for refocusing: “A Proposal for a Quality Framework for MOOCs based o...
 
2011 Meet the Parents Session - 1NA (Year-End)
2011 Meet the Parents Session - 1NA (Year-End)2011 Meet the Parents Session - 1NA (Year-End)
2011 Meet the Parents Session - 1NA (Year-End)
 
XXIII Curso Greta
XXIII Curso GretaXXIII Curso Greta
XXIII Curso Greta
 
2011 Meet the Parents Session - 2EXP (Year-End)
2011 Meet the Parents Session - 2EXP (Year-End)2011 Meet the Parents Session - 2EXP (Year-End)
2011 Meet the Parents Session - 2EXP (Year-End)
 
Language Literacy & MOOCs
Language Literacy & MOOCsLanguage Literacy & MOOCs
Language Literacy & MOOCs
 
SpeakApps presentation
SpeakApps  presentationSpeakApps  presentation
SpeakApps presentation
 
Julia Zabala & Cristina Perez-Guillot: Designing a Language Programme Based o...
Julia Zabala & Cristina Perez-Guillot: Designing a Language Programme Based o...Julia Zabala & Cristina Perez-Guillot: Designing a Language Programme Based o...
Julia Zabala & Cristina Perez-Guillot: Designing a Language Programme Based o...
 
Ec Presentation Roma
Ec Presentation   RomaEc Presentation   Roma
Ec Presentation Roma
 
Current International Developments in English Language Teaching (ELT) and Imp...
Current International Developments in English Language Teaching (ELT) and Imp...Current International Developments in English Language Teaching (ELT) and Imp...
Current International Developments in English Language Teaching (ELT) and Imp...
 
Assessment of oral skills roleplay
Assessment of oral skills roleplayAssessment of oral skills roleplay
Assessment of oral skills roleplay
 
Tim Bullough & Anthony Sinclair: Working with your discipline's HEA Subject C...
Tim Bullough & Anthony Sinclair: Working with your discipline's HEA Subject C...Tim Bullough & Anthony Sinclair: Working with your discipline's HEA Subject C...
Tim Bullough & Anthony Sinclair: Working with your discipline's HEA Subject C...
 
20140606 Hestia Digital Pedagogy
20140606 Hestia Digital Pedagogy20140606 Hestia Digital Pedagogy
20140606 Hestia Digital Pedagogy
 
A quality dialogue: from inspection to inspiration
A quality dialogue: from inspection to inspirationA quality dialogue: from inspection to inspiration
A quality dialogue: from inspection to inspiration
 
National Curriculum
National CurriculumNational Curriculum
National Curriculum
 
sample syllabus in Organization of Information Sources II
sample syllabus in Organization of Information Sources IIsample syllabus in Organization of Information Sources II
sample syllabus in Organization of Information Sources II
 
2011 Meet the Parents Session - 1EXP (Year End)
2011 Meet the Parents Session - 1EXP (Year End)2011 Meet the Parents Session - 1EXP (Year End)
2011 Meet the Parents Session - 1EXP (Year End)
 
2011 Meet the Parents Session - 1EXP (Year End)
2011 Meet the Parents Session - 1EXP (Year End)2011 Meet the Parents Session - 1EXP (Year End)
2011 Meet the Parents Session - 1EXP (Year End)
 
“On the path to crystal mountain” a trek and elt in the 21st century
“On the path to crystal mountain” a trek and elt in the 21st century“On the path to crystal mountain” a trek and elt in the 21st century
“On the path to crystal mountain” a trek and elt in the 21st century
 
The INTENT project
The INTENT projectThe INTENT project
The INTENT project
 
Culegere de teste competenta lingvistica
Culegere de teste competenta lingvisticaCulegere de teste competenta lingvistica
Culegere de teste competenta lingvistica
 

Último

BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...Sapna Thakur
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...PsychoTech Services
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 

Último (20)

BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 

CLUC, APAC Presentation 2013

  • 1. EL CLUC d’anglès, el nou certificat de les universitats de Catalunya Universitat de Barcelona - Universitat Autònoma de Barcelona - Universitat Politècnica de Catalunya Universitat Pompeu Fabra - Universitat de Lleida - Universitat de Girona - Universitat Rovira i Virgili Universitat Ramon Llull - Universitat Oberta de Catalunya - Universitat de Vic Universitat Internacional de Catalunya - Universitat Abat Oliba CEU Sònia Prats, APAC 2013
  • 2.
  • 3. Why?  Need for our own exam in Catalonia  To serve the specific requirements of the university community  Other interuniversity projects working well: CIFOLC, ComComunicar, ...  To support the good work carried out at our university language centers in terms of assessment
  • 4. How?  PUC (Prova universitària de competència en anglès)  Interlingua grants, from the Consell Interuniversitari de Catalunya  February 2012, meeting of the university language-centre directors; March 2012, proposal and commission
  • 5. What’s in it for me?
  • 6. What?  Levels  Addressed to  Cost  When  Who gets involved in the project  What will be assessed  What can be reused from the old PUC exam
  • 7. Steps  Specifications for writing & speaking & reading tests  Elaboration of the different parts Reading & text-mapping Writing Speaking  Assessment criteria  Writing  Reading  Speaking: holistic and analytic
  • 8. Steps  Piloting The sample that participated in the study comprised 433 students of English at B1, B2 and C1 levels taking courses at five Catalan universities: the UAB, the UdL, the UPC, the UPF and the UVic. Distribution of participants according to university of study:
  • 9.  Piloting Data processing (statistical, feedback questionnaires,...)
  • 10.
  • 11.  Piloting: consequences and improvements made  Cut-off points and selection of texts (oral & reading)  Rewording of instructions  Eliminate certain items (reading and Simtest)  Timing confirmed  Reordering different parts of oral text  Video recordings and writing samples for future reference and use, to establish gold standard  More scripting (and more detailed) needed for examiners and invigilators
  • 12. Essential  Assessors: qualities and experience needed  Training (norming sessions)  Collect all feedback  Documents created and storage  Final results: excel and instructions
  • 13. Also important  Administrative regulations of the different tests  Administration guide: procedures, issuing of certificates,...  Publicity: transparency of information, quality standards  Certification / ACLES  CLUC and the media
  • 14.
  • 15.
  • 17. Bibliography Council of Europe (2011). Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Rita Green, Statistical Analysis for Language Testers (Palgrave Macmillan, 2013) Fulcher, G. and Davidson, F. Language Testing and Assessment (Routledge, 2007) Bachman, L.F. and Palmer, A.S. Language Testing in Practice: Designing and Developing Useful Language Tests. (Oxford University Press, 1996)
  • 18. ille! Mer m c i be Grazie auco up! Moltes gràcies! s! Tha g racia nk has you ¡Muc very muc h! sonia.prats@uab.cat Coordinació CLUC, 2012-2013

Notas do Editor

  1. N eeds: Erasmus, need to certificate level to finish degree courses, to get into Master de secundària, etc. Inter-intra.
  2. Diapo adient si el públic és professorat o tècnics lingüístics que han de dissenyar exàmens
  3. Assessment criteria: can’t be “closed” until after piloting Text mapping: procediment pel qual es poden extreure les idees principals o els detalls més rellevants d’un text i que serviran de base per a l’elaboració dels ítems de la tasca a crear. Hi ha quatre procediments diferents: 1)gist, 2) main ideas 3) specific information and 4 ) main events.
  4. Piloting: 5-16 november 2012, 5 unis involved