SlideShare a Scribd company logo
1 of 23
Lessons learned from adapting U.S. developed MKT measures for use in NorwayPresentation at the University of Huelva, SpainMay 27th, 2011 Arne Jakobsen Department of Education University of Stavanger, Norway
Disposition History and background (Norway) Students (TIMSS, PISA,…) Teachers’ knowledge is important for students achievement Government decide to invest in Professional development  Professional development programs to meet teachers’ needs Mathematical knowledge for teaching (MKT) Our project research question: What are the possibilities and challenges of using the MKT measures in Norway? ,[object Object],Translation of items   Pilot: 142 (150) teachers measured and 7 focus group interviews
MKT ,[object Object]
Workofteaching
Tasks ofteaching
Areas of MKT
MKT items
MQI - back to theclassroom,[object Object]
Tasks ofteachingwithitems.   Giving and evaluating explanations Explaining a common procedure Explain a concept or idea Evaluating student explanations for evidence of understanding Characterizing the quality of an explanation   Interpreting and evaluating non-standard methods/ideas and multiple solutions Evaluating a particular non-standard method Evaluating multiple possible solutions for a particular problem     Choosing examples and problems Choosing examples to introduce a concept Choosing examples that use or illustrate a particular idea Choosing examples that lend themselves to particular strategies Changing the context/numbers of a problem without changing the mathematical content Designing a mathematically similar problem Designing a simpler version of a problem Designing a sequence of problems to teach an idea  
Tasks withitems (cont.) Choosing and using representations Representing a particular idea in multiple ways Interpreting a particular representation in multiple ways Choosing a diagram/story/model to represent and idea/concept/expression Selecting a representation to match an instructional purpose Analyzing student errors Identifying errors of the same type Evaluating difficulty Choosing and using definitions (+ more.) 
MKT - the «egg» Ball, D. L., Thames, M. H., & Phelps, G. (2008, p. 403).
Example item
Translation and adaptionofmeasures ,[object Object]
Documentationofchanges
Aspectsofequivalence,[object Object]
Translation and adaption
Translation and adaptation MKT, releaseditems Mosvold, R., Fauskanger, J., Jakobsen, A., & Melhus, K. (2009). 
The multiple-choice format Focusgroupinterviews. How can Norwegian teachers’ reflections about the MKT items contribute to our understanding of challenges related to the multiple-choice format?
Item ResponceTheory (IRT) How can information about items psychometric properties give new insight when adapting U.S. developed MKT measure for use in Norway? An item performance is described by an item characteristic function (with different difficulty and slopes). Monotonically increasing function – as the MKT increase the probability of correct answer increase. Slope and difficulty is of importance.
Item performance
From IRT analyses of data
IRT findings We found that items can be divided into three groups: Items that do not seem to function in Norway  Items that function well, but have relatively high difference in item characteristics in Norway compared to the U.S., and  Items that seem to function well and that have item characteristics close to what is reported in the U.S. Quantitative + qualitative analyses!
From IRT analyses ofthe data ,[object Object]

More Related Content

What's hot

Denduang 606 Final Pp Ready
Denduang 606 Final Pp ReadyDenduang 606 Final Pp Ready
Denduang 606 Final Pp Ready
guesta536f75
 
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Bilinguistics
 
Site2011 tomidaokibayashitamura
Site2011 tomidaokibayashitamuraSite2011 tomidaokibayashitamura
Site2011 tomidaokibayashitamura
Eiji Tomida
 
First oral Presentation
First oral  PresentationFirst oral  Presentation
First oral Presentation
lynn3940
 
Communicative language testing
Communicative language testingCommunicative language testing
Communicative language testing
Ida Mantra
 
Effects of Task-based language teaching on grade five students reading perfor...
Effects of Task-based language teaching on grade five students reading perfor...Effects of Task-based language teaching on grade five students reading perfor...
Effects of Task-based language teaching on grade five students reading perfor...
Mesfin Eyob
 
Language testing final
Language testing finalLanguage testing final
Language testing final
edac4co
 
Language Testing: Approaches and Techniques
Language Testing: Approaches and TechniquesLanguage Testing: Approaches and Techniques
Language Testing: Approaches and Techniques
Monica Angeles
 

What's hot (20)

Denduang 606 Final Pp Ready
Denduang 606 Final Pp ReadyDenduang 606 Final Pp Ready
Denduang 606 Final Pp Ready
 
CONCEPTUAL APPROACH AND SOLVING WORD PROBLEM INVOLVING MULTIPLICATION OF WHOL...
CONCEPTUAL APPROACH AND SOLVING WORD PROBLEM INVOLVING MULTIPLICATION OF WHOL...CONCEPTUAL APPROACH AND SOLVING WORD PROBLEM INVOLVING MULTIPLICATION OF WHOL...
CONCEPTUAL APPROACH AND SOLVING WORD PROBLEM INVOLVING MULTIPLICATION OF WHOL...
 
Pp ch11
Pp ch11Pp ch11
Pp ch11
 
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
 
Full indo ms-jme-nenden
Full indo ms-jme-nendenFull indo ms-jme-nenden
Full indo ms-jme-nenden
 
Test specifications and designs session 4
Test specifications and designs  session 4Test specifications and designs  session 4
Test specifications and designs session 4
 
Site2011 tomidaokibayashitamura
Site2011 tomidaokibayashitamuraSite2011 tomidaokibayashitamura
Site2011 tomidaokibayashitamura
 
Ppt 8
Ppt 8Ppt 8
Ppt 8
 
ECML20140218
ECML20140218ECML20140218
ECML20140218
 
First oral Presentation
First oral  PresentationFirst oral  Presentation
First oral Presentation
 
Validity
ValidityValidity
Validity
 
Communicative language testing
Communicative language testingCommunicative language testing
Communicative language testing
 
Understanding the Common Core State Standards
Understanding the Common Core State StandardsUnderstanding the Common Core State Standards
Understanding the Common Core State Standards
 
Language assessment tsl3123 notes
Language assessment tsl3123 notesLanguage assessment tsl3123 notes
Language assessment tsl3123 notes
 
Matching type of evaluation
Matching type of evaluationMatching type of evaluation
Matching type of evaluation
 
Effects of Task-based language teaching on grade five students reading perfor...
Effects of Task-based language teaching on grade five students reading perfor...Effects of Task-based language teaching on grade five students reading perfor...
Effects of Task-based language teaching on grade five students reading perfor...
 
Steps to design a test
Steps to design a testSteps to design a test
Steps to design a test
 
Language testing final
Language testing finalLanguage testing final
Language testing final
 
Language Testing: Approaches and Techniques
Language Testing: Approaches and TechniquesLanguage Testing: Approaches and Techniques
Language Testing: Approaches and Techniques
 
Writing the review or related literature
Writing the review or related literatureWriting the review or related literature
Writing the review or related literature
 

Viewers also liked

Viewers also liked (9)

AERA 2009, Delaney symposium
AERA 2009, Delaney symposiumAERA 2009, Delaney symposium
AERA 2009, Delaney symposium
 
Presentasjon for KD
Presentasjon for KDPresentasjon for KD
Presentasjon for KD
 
Aera 2012
Aera 2012Aera 2012
Aera 2012
 
Presentation of UKM-Stavanger in Algarve
Presentation of UKM-Stavanger in AlgarvePresentation of UKM-Stavanger in Algarve
Presentation of UKM-Stavanger in Algarve
 
Fellesforelesning - uke 43
Fellesforelesning - uke 43Fellesforelesning - uke 43
Fellesforelesning - uke 43
 
Presentation - Norma 11
Presentation - Norma 11Presentation - Norma 11
Presentation - Norma 11
 
2010 Sprout Up Presentation
2010 Sprout Up Presentation2010 Sprout Up Presentation
2010 Sprout Up Presentation
 
Matematikk i barnehagen
Matematikk i barnehagenMatematikk i barnehagen
Matematikk i barnehagen
 
Presentation of UKM-Stavanger at Coimbra, Portugal
Presentation of UKM-Stavanger at Coimbra, PortugalPresentation of UKM-Stavanger at Coimbra, Portugal
Presentation of UKM-Stavanger at Coimbra, Portugal
 

Similar to Presentation of UKM-Stavanger in Spain

Study Of Studies
Study Of StudiesStudy Of Studies
Study Of Studies
Paula Breen
 
Action Research
Action ResearchAction Research
Action Research
Trudy Keil
 
20 Slide Final on Content
20 Slide Final on Content20 Slide Final on Content
20 Slide Final on Content
Swaynisha
 
Team A Presentation Templatedraft[1]
Team A Presentation Templatedraft[1]Team A Presentation Templatedraft[1]
Team A Presentation Templatedraft[1]
67renat
 
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
William Kritsonis
 
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
William Kritsonis
 
Forskerskoleseminar Mai2008
Forskerskoleseminar Mai2008Forskerskoleseminar Mai2008
Forskerskoleseminar Mai2008
Reidar Mosvold
 

Similar to Presentation of UKM-Stavanger in Spain (20)

Fostering Curriculum Development Through Artesol 2010
Fostering Curriculum Development Through Artesol 2010Fostering Curriculum Development Through Artesol 2010
Fostering Curriculum Development Through Artesol 2010
 
Belfast IFLS June 2016 Ppt Chris Banister
Belfast IFLS June 2016 Ppt Chris BanisterBelfast IFLS June 2016 Ppt Chris Banister
Belfast IFLS June 2016 Ppt Chris Banister
 
TALC 2008 - What do annotators annotate? An analysis of language teachers’ co...
TALC 2008 - What do annotators annotate? An analysis of language teachers’ co...TALC 2008 - What do annotators annotate? An analysis of language teachers’ co...
TALC 2008 - What do annotators annotate? An analysis of language teachers’ co...
 
An in progress co-teaching project developing information, technology, and s...
An in progress co-teaching project  developing information, technology, and s...An in progress co-teaching project  developing information, technology, and s...
An in progress co-teaching project developing information, technology, and s...
 
Study Of Studies
Study Of StudiesStudy Of Studies
Study Of Studies
 
Action Research
Action ResearchAction Research
Action Research
 
Assessment and learning - getting quality in both
Assessment and learning - getting quality in bothAssessment and learning - getting quality in both
Assessment and learning - getting quality in both
 
El Ls And Spec Ed
El Ls And Spec EdEl Ls And Spec Ed
El Ls And Spec Ed
 
Last Curriculum Leadersip Class
Last Curriculum Leadersip ClassLast Curriculum Leadersip Class
Last Curriculum Leadersip Class
 
3 Documenting Quality of Teaching by Standardised Indicators, Per Morten Kind...
3 Documenting Quality of Teaching by Standardised Indicators, Per Morten Kind...3 Documenting Quality of Teaching by Standardised Indicators, Per Morten Kind...
3 Documenting Quality of Teaching by Standardised Indicators, Per Morten Kind...
 
Tblt Presentation
Tblt PresentationTblt Presentation
Tblt Presentation
 
CBI Part II: Practical
CBI Part II: PracticalCBI Part II: Practical
CBI Part II: Practical
 
20 Slide Final on Content
20 Slide Final on Content20 Slide Final on Content
20 Slide Final on Content
 
Esp chap 4 materials design (finished)
Esp chap 4   materials design (finished)Esp chap 4   materials design (finished)
Esp chap 4 materials design (finished)
 
Assessing Elementary Mathematics Instructional Leader Programs
Assessing Elementary Mathematics Instructional Leader ProgramsAssessing Elementary Mathematics Instructional Leader Programs
Assessing Elementary Mathematics Instructional Leader Programs
 
TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
 TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan... TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
 
Team A Presentation Templatedraft[1]
Team A Presentation Templatedraft[1]Team A Presentation Templatedraft[1]
Team A Presentation Templatedraft[1]
 
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
 
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
Frantz dana pomykal_is_there_room_in_math_reform_for_preservice_teachers_to_u...
 
Forskerskoleseminar Mai2008
Forskerskoleseminar Mai2008Forskerskoleseminar Mai2008
Forskerskoleseminar Mai2008
 

More from Reidar Mosvold (17)

Fellesforelesning uke5
Fellesforelesning uke5Fellesforelesning uke5
Fellesforelesning uke5
 
UKM-presentasjon, Sanner
UKM-presentasjon, SannerUKM-presentasjon, Sanner
UKM-presentasjon, Sanner
 
Fellesforelesning - uke 17
Fellesforelesning - uke 17Fellesforelesning - uke 17
Fellesforelesning - uke 17
 
Barnehageløftet - kurs 14.11.2007
Barnehageløftet - kurs 14.11.2007Barnehageløftet - kurs 14.11.2007
Barnehageløftet - kurs 14.11.2007
 
Fellesforelesning - uke 44
Fellesforelesning - uke 44Fellesforelesning - uke 44
Fellesforelesning - uke 44
 
Fellesforelesning/seminargrupper uke 42
Fellesforelesning/seminargrupper uke 42Fellesforelesning/seminargrupper uke 42
Fellesforelesning/seminargrupper uke 42
 
Fellesforelesning - uke 40
Fellesforelesning - uke 40Fellesforelesning - uke 40
Fellesforelesning - uke 40
 
Fellesforelesning - uke 39
Fellesforelesning - uke 39Fellesforelesning - uke 39
Fellesforelesning - uke 39
 
Kurs Randaberg
Kurs RandabergKurs Randaberg
Kurs Randaberg
 
Fellesforelesning - uke 38
Fellesforelesning - uke 38Fellesforelesning - uke 38
Fellesforelesning - uke 38
 
Fellesforelesning - uke 37
Fellesforelesning - uke 37Fellesforelesning - uke 37
Fellesforelesning - uke 37
 
Fellesforelesning - Uke 36
Fellesforelesning - Uke 36Fellesforelesning - Uke 36
Fellesforelesning - Uke 36
 
Fellesforelesning - uke 35
Fellesforelesning - uke 35Fellesforelesning - uke 35
Fellesforelesning - uke 35
 
Forelesning - 22.08.2007
Forelesning - 22.08.2007Forelesning - 22.08.2007
Forelesning - 22.08.2007
 
Erfaringskonferanse
ErfaringskonferanseErfaringskonferanse
Erfaringskonferanse
 
MatteKick - avslutningskonferanse
MatteKick - avslutningskonferanseMatteKick - avslutningskonferanse
MatteKick - avslutningskonferanse
 
Kornberget
KornbergetKornberget
Kornberget
 

Recently uploaded

BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
SoniaTolstoy
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
fonyou31
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Recently uploaded (20)

Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
General AI for Medical Educators April 2024
General AI for Medical Educators April 2024General AI for Medical Educators April 2024
General AI for Medical Educators April 2024
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 

Presentation of UKM-Stavanger in Spain

  • 1. Lessons learned from adapting U.S. developed MKT measures for use in NorwayPresentation at the University of Huelva, SpainMay 27th, 2011 Arne Jakobsen Department of Education University of Stavanger, Norway
  • 2.
  • 3.
  • 8.
  • 9. Tasks ofteachingwithitems.   Giving and evaluating explanations Explaining a common procedure Explain a concept or idea Evaluating student explanations for evidence of understanding Characterizing the quality of an explanation   Interpreting and evaluating non-standard methods/ideas and multiple solutions Evaluating a particular non-standard method Evaluating multiple possible solutions for a particular problem    Choosing examples and problems Choosing examples to introduce a concept Choosing examples that use or illustrate a particular idea Choosing examples that lend themselves to particular strategies Changing the context/numbers of a problem without changing the mathematical content Designing a mathematically similar problem Designing a simpler version of a problem Designing a sequence of problems to teach an idea  
  • 10. Tasks withitems (cont.) Choosing and using representations Representing a particular idea in multiple ways Interpreting a particular representation in multiple ways Choosing a diagram/story/model to represent and idea/concept/expression Selecting a representation to match an instructional purpose Analyzing student errors Identifying errors of the same type Evaluating difficulty Choosing and using definitions (+ more.) 
  • 11. MKT - the «egg» Ball, D. L., Thames, M. H., & Phelps, G. (2008, p. 403).
  • 13.
  • 15.
  • 17. Translation and adaptation MKT, releaseditems Mosvold, R., Fauskanger, J., Jakobsen, A., & Melhus, K. (2009). 
  • 18. The multiple-choice format Focusgroupinterviews. How can Norwegian teachers’ reflections about the MKT items contribute to our understanding of challenges related to the multiple-choice format?
  • 19. Item ResponceTheory (IRT) How can information about items psychometric properties give new insight when adapting U.S. developed MKT measure for use in Norway? An item performance is described by an item characteristic function (with different difficulty and slopes). Monotonically increasing function – as the MKT increase the probability of correct answer increase. Slope and difficulty is of importance.
  • 21. From IRT analyses of data
  • 22. IRT findings We found that items can be divided into three groups: Items that do not seem to function in Norway Items that function well, but have relatively high difference in item characteristics in Norway compared to the U.S., and Items that seem to function well and that have item characteristics close to what is reported in the U.S. Quantitative + qualitative analyses!
  • 23.
  • 25.
  • 26. Correlation between NCOP and GEOMETRY is 0.701 (p-value < 0.0005).
  • 27. Correlations (Pearson, p-value<0.005) Correlations Teachers’ MKT scores in differentcontent areas arecorrelated All correlationsaresignificant – weakestcorrelationbetween PFA and NCOP
  • 28. Conclusion We find that teachers’ MKT scores in the three content areas are correlated Teachers with high MKT in one content area have high MKT in other content areas and vice versa Despite comments from teachers that not finding PFA items relevant for their teaching, their PFA MKT is related to MKT in the other content areas
  • 29.
  • 30. Want to establish link between Norwegian teachers’ MKT and student achievements (UiO-TIMSS 2011)
  • 31. Discussing items as part of professional development to learn more about teachers MKT?