SlideShare uma empresa Scribd logo
1 de 16
Stefan
                  Mol


                               Anne
                              Keegan

                 Gabor
                Kismihok



The Cinderella Predictor:
Taking job knowledge to the personnel selection ball
Content
Related
Validity

            Criterion
            Related
            Validity
Construct
 Related
 Validity
Content
Related
Validity

            Criterion
            Related
            Validity
Construct
 Related
 Validity
Job Knowledge


“…people who are more intelligent learn
more job knowledge and learn it faster, the
                     Criterion
                     Related
major determinant of job performance is
                      Validity
not GMA but job knowledge” (Schmidt and
Hunter, 2001).
                                        Job
  GMA           Job knowledge
                                   Performance
Criterion
              Job Knowledge                     Related
                                                Validity

“Validity is nearly twice as high for job specific
tests than for of the-shelf tests. In fact, the
levels for locally developed tests appear to
rival those of general ability tests” (Dye, Reck
& McDaniel, 1993,p. 156).

ρ=.62, k =59, N=3965

                                             Job
  GMA             Job knowledge
                                        Performance
Criterion
             Job Knowledge              Related
                                        Validity


“Content-related evidence of validity
has traditionally involved … rational   Content
                                        Related
examination of the manner in which      Validity

the performance domain is sampled by
the predictor” (Binning &
Barrett, 1989, p. 482).
Criterion
               Job Knowledge             Related
                                         Validity

Job knowledge: According to the APA
publication manual which statistics do   Content
you need to report in a regression       Related
analysis table?                          Validity



GMA: How smart do you need to be to
publish an article?

Hunter (1986, p. 353) “knowledge is a
much better measure of performance
than [supervisor] ratings”.
Criterion
             Job Knowledge                Related
                                          Validity


“construct validation and theory
development imply the same basic          Content
                                          Related
process….” “If it can be shown that a     Validity
test measures a specific construct …
that has been determined to be critical
for job performance…, then inferences     Construct
                                           Related
about job performance from test scores     Validity
are by logical implication justified”
(Binning and Barrett, 1989, p.487, p.
480
Criterion
                       Job Knowledge                                        Related
                                                                            Validity



                                                                            Content



                             Substantiation
                                                                            Related
                                                                            Validity




                                                                            Construct
                                                                             Related
1 2 3 4 5 6 7 8 9                             9 8 7 6 5 4 3 2 1              Validity
 Job Knowledge Specificity                    Job Performance Specificity
Towards a research agenda
Undeniably Job General
                                              Unequivocally Job Specific (albeit more portable for more related occupations)




                                                 Job                                                     Job
 GMA
                                              Knowledge                                             Performance




                     Education

                         Job Specific – Job
                              General
Development of Job Knowledge Tests:
          Implications
• Focus on idiosyncratic job knowledge
  requirements
  – Requires use of inductive, interpretive research
    methods
• Implications for status and acceptance of
  qualitative research within the personnel
  psychology community
  – “Qualitative research often advances the field by
    providing unique, memorable, socially important and
    theoretically meaningful contributions to scholarly
    discourse and organizational life” (Gephart and Rynes
    2004, p.461)
Job Knowledge as Matchmaker
• Connecting:
  – HRM, eLearning & Knowledge Management
    (foster collaboration)
  – Academia and industry (Science and practice)
  – Employees and workplaces (Enhanced Matching)
  – Policy and Education (Training)
  – Government and Labor Market (Needs analysis)

                http://www.ontohr.eu
Technology is on our side
• Flexible systems for matching employees, organizations and
  educational institutions
• Process Management
• Semantic applications
   – Data structuring
   – Comparability
• Text/data mining
   – Automatic data collection and recognition
• Content management
   – eLearning methodologies for content representation
     (LO, LOR, OER)
• Adaptive testing
Why make the effort?
With representative job knowledge tests:
• We no longer need to reject candidates on stable
  dispositional characteristics
• We can inform candidates as to where they can
  obtain missing knowledge
• We can inform educational institutions about
  missing job knowledge of their graduates
• We can gauge the knowledge of
  immigrants, informal learners, and the elderly
The cinderella predictor

Mais conteúdo relacionado

Semelhante a The cinderella predictor

The cinderella predictor [final]
The cinderella predictor [final]The cinderella predictor [final]
The cinderella predictor [final]Gábor Kismihók
 
Rocket Hire Assessment 101 4 Steps To Success
Rocket Hire Assessment 101  4 Steps To SuccessRocket Hire Assessment 101  4 Steps To Success
Rocket Hire Assessment 101 4 Steps To SuccessRocket-Hire
 
Mol, S.T. (2013, October). Job Knowledge Based Personnel Selection & The Cent...
Mol, S.T. (2013, October). Job Knowledge Based Personnel Selection & The Cent...Mol, S.T. (2013, October). Job Knowledge Based Personnel Selection & The Cent...
Mol, S.T. (2013, October). Job Knowledge Based Personnel Selection & The Cent...job_knowledge_research
 
Chapter 6 Employee Testing and Selection
Chapter 6 Employee Testing and SelectionChapter 6 Employee Testing and Selection
Chapter 6 Employee Testing and SelectionTi UtIt
 
2005 apr jun_47_56
2005 apr jun_47_562005 apr jun_47_56
2005 apr jun_47_56hina456
 
26-05-10 making the most of your internship
26-05-10 making the most of your internship26-05-10 making the most of your internship
26-05-10 making the most of your internshipJPStrategy
 
Corporate Presentation
Corporate PresentationCorporate Presentation
Corporate Presentationsadhavi_kd
 
Corporate presentation
Corporate presentation Corporate presentation
Corporate presentation pjw1955
 
Metaphors as design points for collaboration 2012
Metaphors as design points for collaboration 2012Metaphors as design points for collaboration 2012
Metaphors as design points for collaboration 2012KM Chicago
 
Reliability And Validity Iv
Reliability And Validity IvReliability And Validity Iv
Reliability And Validity Ivrk1672
 
Dutch flemish 2013 presentation
Dutch flemish 2013 presentationDutch flemish 2013 presentation
Dutch flemish 2013 presentationEduworks Network
 
Start the New Year Right — Focus Learning Through Competencies in 2013
Start the New Year Right — Focus Learning Through Competencies in 2013Start the New Year Right — Focus Learning Through Competencies in 2013
Start the New Year Right — Focus Learning Through Competencies in 2013Human Capital Media
 
Agile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterAgile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterDeclan Whelan
 
Competency based hr management
Competency based hr managementCompetency based hr management
Competency based hr managementZaini Ithnin
 
But what's happening (ciec 2013) v1
But what's happening (ciec 2013) v1But what's happening (ciec 2013) v1
But what's happening (ciec 2013) v1svillach
 
Content, Connections, and Context
Content, Connections, and ContextContent, Connections, and Context
Content, Connections, and ContextDaniel Tunkelang
 

Semelhante a The cinderella predictor (20)

The cinderella predictor [final]
The cinderella predictor [final]The cinderella predictor [final]
The cinderella predictor [final]
 
ICAP 2014 - CJKR presentation
ICAP 2014 - CJKR presentationICAP 2014 - CJKR presentation
ICAP 2014 - CJKR presentation
 
Rocket Hire Assessment 101 4 Steps To Success
Rocket Hire Assessment 101  4 Steps To SuccessRocket Hire Assessment 101  4 Steps To Success
Rocket Hire Assessment 101 4 Steps To Success
 
Mol, S.T. (2013, October). Job Knowledge Based Personnel Selection & The Cent...
Mol, S.T. (2013, October). Job Knowledge Based Personnel Selection & The Cent...Mol, S.T. (2013, October). Job Knowledge Based Personnel Selection & The Cent...
Mol, S.T. (2013, October). Job Knowledge Based Personnel Selection & The Cent...
 
Isdt 2012 presentation
Isdt 2012 presentationIsdt 2012 presentation
Isdt 2012 presentation
 
Chapter 6 Employee Testing and Selection
Chapter 6 Employee Testing and SelectionChapter 6 Employee Testing and Selection
Chapter 6 Employee Testing and Selection
 
2005 apr jun_47_56
2005 apr jun_47_562005 apr jun_47_56
2005 apr jun_47_56
 
26-05-10 making the most of your internship
26-05-10 making the most of your internship26-05-10 making the most of your internship
26-05-10 making the most of your internship
 
Corporate Presentation
Corporate PresentationCorporate Presentation
Corporate Presentation
 
Corporate presentation
Corporate presentation Corporate presentation
Corporate presentation
 
Metaphors as design points for collaboration 2012
Metaphors as design points for collaboration 2012Metaphors as design points for collaboration 2012
Metaphors as design points for collaboration 2012
 
Knowledge management
Knowledge managementKnowledge management
Knowledge management
 
Act Workkeys Presentation 2010
Act Workkeys Presentation 2010Act Workkeys Presentation 2010
Act Workkeys Presentation 2010
 
Reliability And Validity Iv
Reliability And Validity IvReliability And Validity Iv
Reliability And Validity Iv
 
Dutch flemish 2013 presentation
Dutch flemish 2013 presentationDutch flemish 2013 presentation
Dutch flemish 2013 presentation
 
Start the New Year Right — Focus Learning Through Competencies in 2013
Start the New Year Right — Focus Learning Through Competencies in 2013Start the New Year Right — Focus Learning Through Competencies in 2013
Start the New Year Right — Focus Learning Through Competencies in 2013
 
Agile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterAgile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile Tester
 
Competency based hr management
Competency based hr managementCompetency based hr management
Competency based hr management
 
But what's happening (ciec 2013) v1
But what's happening (ciec 2013) v1But what's happening (ciec 2013) v1
But what's happening (ciec 2013) v1
 
Content, Connections, and Context
Content, Connections, and ContextContent, Connections, and Context
Content, Connections, and Context
 

Mais de OntoHR Project

Introduction to Med-Assess
Introduction to Med-AssessIntroduction to Med-Assess
Introduction to Med-AssessOntoHR Project
 
CNR Semantic Lab presentation
CNR Semantic Lab presentationCNR Semantic Lab presentation
CNR Semantic Lab presentationOntoHR Project
 
OntoHR in Italian context
OntoHR in Italian contextOntoHR in Italian context
OntoHR in Italian contextOntoHR Project
 
Presenting the OntoHR idea at EAWOP 2009
Presenting the OntoHR idea at EAWOP 2009Presenting the OntoHR idea at EAWOP 2009
Presenting the OntoHR idea at EAWOP 2009OntoHR Project
 
OntoHR on the Fifth Dutch Flemish research meeting on personnel selection and...
OntoHR on the Fifth Dutch Flemish research meeting on personnel selection and...OntoHR on the Fifth Dutch Flemish research meeting on personnel selection and...
OntoHR on the Fifth Dutch Flemish research meeting on personnel selection and...OntoHR Project
 

Mais de OntoHR Project (8)

Introduction to Med-Assess
Introduction to Med-AssessIntroduction to Med-Assess
Introduction to Med-Assess
 
OntoHR summary
OntoHR summaryOntoHR summary
OntoHR summary
 
CNR Semantic Lab presentation
CNR Semantic Lab presentationCNR Semantic Lab presentation
CNR Semantic Lab presentation
 
OntoHR in Italian context
OntoHR in Italian contextOntoHR in Italian context
OntoHR in Italian context
 
Presenting the OntoHR idea at EAWOP 2009
Presenting the OntoHR idea at EAWOP 2009Presenting the OntoHR idea at EAWOP 2009
Presenting the OntoHR idea at EAWOP 2009
 
OntoHR on the Fifth Dutch Flemish research meeting on personnel selection and...
OntoHR on the Fifth Dutch Flemish research meeting on personnel selection and...OntoHR on the Fifth Dutch Flemish research meeting on personnel selection and...
OntoHR on the Fifth Dutch Flemish research meeting on personnel selection and...
 
Ontohr Presentation
Ontohr PresentationOntohr Presentation
Ontohr Presentation
 
Onto hr AICA 2010
Onto hr AICA 2010Onto hr AICA 2010
Onto hr AICA 2010
 

Último

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfSanaAli374401
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxVishalSingh1417
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxVishalSingh1417
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.MateoGardella
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin ClassesCeline George
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxnegromaestrong
 

Último (20)

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 

The cinderella predictor

  • 1. Stefan Mol Anne Keegan Gabor Kismihok The Cinderella Predictor: Taking job knowledge to the personnel selection ball
  • 2. Content Related Validity Criterion Related Validity Construct Related Validity
  • 3. Content Related Validity Criterion Related Validity Construct Related Validity
  • 4. Job Knowledge “…people who are more intelligent learn more job knowledge and learn it faster, the Criterion Related major determinant of job performance is Validity not GMA but job knowledge” (Schmidt and Hunter, 2001). Job GMA Job knowledge Performance
  • 5. Criterion Job Knowledge Related Validity “Validity is nearly twice as high for job specific tests than for of the-shelf tests. In fact, the levels for locally developed tests appear to rival those of general ability tests” (Dye, Reck & McDaniel, 1993,p. 156). ρ=.62, k =59, N=3965 Job GMA Job knowledge Performance
  • 6. Criterion Job Knowledge Related Validity “Content-related evidence of validity has traditionally involved … rational Content Related examination of the manner in which Validity the performance domain is sampled by the predictor” (Binning & Barrett, 1989, p. 482).
  • 7. Criterion Job Knowledge Related Validity Job knowledge: According to the APA publication manual which statistics do Content you need to report in a regression Related analysis table? Validity GMA: How smart do you need to be to publish an article? Hunter (1986, p. 353) “knowledge is a much better measure of performance than [supervisor] ratings”.
  • 8. Criterion Job Knowledge Related Validity “construct validation and theory development imply the same basic Content Related process….” “If it can be shown that a Validity test measures a specific construct … that has been determined to be critical for job performance…, then inferences Construct Related about job performance from test scores Validity are by logical implication justified” (Binning and Barrett, 1989, p.487, p. 480
  • 9. Criterion Job Knowledge Related Validity Content Substantiation Related Validity Construct Related 1 2 3 4 5 6 7 8 9 9 8 7 6 5 4 3 2 1 Validity Job Knowledge Specificity Job Performance Specificity
  • 10.
  • 11. Towards a research agenda Undeniably Job General Unequivocally Job Specific (albeit more portable for more related occupations) Job Job GMA Knowledge Performance Education Job Specific – Job General
  • 12. Development of Job Knowledge Tests: Implications • Focus on idiosyncratic job knowledge requirements – Requires use of inductive, interpretive research methods • Implications for status and acceptance of qualitative research within the personnel psychology community – “Qualitative research often advances the field by providing unique, memorable, socially important and theoretically meaningful contributions to scholarly discourse and organizational life” (Gephart and Rynes 2004, p.461)
  • 13. Job Knowledge as Matchmaker • Connecting: – HRM, eLearning & Knowledge Management (foster collaboration) – Academia and industry (Science and practice) – Employees and workplaces (Enhanced Matching) – Policy and Education (Training) – Government and Labor Market (Needs analysis) http://www.ontohr.eu
  • 14. Technology is on our side • Flexible systems for matching employees, organizations and educational institutions • Process Management • Semantic applications – Data structuring – Comparability • Text/data mining – Automatic data collection and recognition • Content management – eLearning methodologies for content representation (LO, LOR, OER) • Adaptive testing
  • 15. Why make the effort? With representative job knowledge tests: • We no longer need to reject candidates on stable dispositional characteristics • We can inform candidates as to where they can obtain missing knowledge • We can inform educational institutions about missing job knowledge of their graduates • We can gauge the knowledge of immigrants, informal learners, and the elderly