SlideShare uma empresa Scribd logo
1 de 8
Baixar para ler offline
Developing, Validating, and
Analyzing Structured Interviews



BCGi: Adverse Impact & Test
Validation Book Series
What are Structured Interviews
and How are they Scored and Analyzed?

• Structured Interviews are oral interview sessions for hiring or
  promotional selection processes
• They are different than many ad-hoc, informal interviews in both
  the way they are given and how they are scored
• Structured Interviews can include several types of questions:
   – Situational questions
   – Behavioral questions
   – Competency-based questions
• And typically involve several raters and pre-defined scoring
  routines


                      www.BCGinstitute.org
Why is this Topic Important to HR/EEO Professionals?
• Why do I need to know about this topic?
  – Yes… Interviews are “tests” and they are also subject to Title
    VII validation laws and are frequently litigated
  – Informal, ad-hoc interviews are generally not as effective as
    validated, structured interviews
  – There is a process for building and developing strong
    interviews, but many employers don’t take the time
• What are the key essentials I need to know about this topic?
  – Structured interviews are not too difficult to develop
  – Using multiple raters and rating scales can improve the
    effectiveness and validity of your interview process
• What are the consequences surrounding these issues?
  – Ad-hoc, informal interviews can possibly introduce liability and
    lower the quality of your workforce
  – The “start up” cost of a validation case is $30k to $80k
                      www.BCGinstitute.org
Presentation Overview


• Overview & Background
• Methods for Improving the Interview Process
• Types of Questions to Include in Structured
  Interviews
• Steps for Developing Situational Questions
• Administering and Scoring an Interview




                www.BCGinstitute.org
Presentation Overview

• Methods for Improving the Interview Process
  – How valid and reliable the interview is may be highly
    specific to both the situation and to the rater.
• Types of Questions to Include in Structured
  Interviews
  – Situational questions
  – Behavioral questions
  – Competency-based questions


                 www.BCGinstitute.org
Presentation Overview

• Steps for Developing Situational Questions
  – We’ll cover 13 steps that are typically involved in the
    Interview development process
• Administering and Scoring an Interview
  –   Selecting raters
  –   Training raters
  –   Assembling panels
  –   Administering/scoring the interview
  –   Combining applicant scores from multiple panels


                   www.BCGinstitute.org
Resources
• Adverse Impact and Test Validation: A Practitioner's
  Handbook by Daniel A. Biddle, Ph.D.
   – Purchase online at www.BCGinstitute.org

• Adverse Impact and Test Validation Book Series Webinars
   – Recordings available online for all BCGi Platinum Members
   – Webinar slides available online to all BCGi Standard & Platinum
     Members

• BCGi Membership
   – Free Standard Membership
   – Premium Platinum Membership



                        www.BCGinstitute.org
About Our Sponsor: Biddle Consulting Group (BCG)
 BCG is an HR firm dedicated to providing the highest products and services related to
 Equal Employment Opportunity (EEO), Affirmative Action and Employee Selection.
 • BCG’s Consulting Services
     ― Affirmative Action Plan Outsourcing
     ― Compensation Analysis
     ― EEO/AA Litigation Support (Plaintiff and Defendant)
     ― Job Analysis
     ― Test Development and Test Validation
 • BCG’s Software Products
     ― Adverse Impact Toolkit™
     ― AutoAAP® affirmative action plan development software
     ― AutoGOJA® job analysis software
     ― C4 call center testing software
     ― COMPARE™ compensation analysis software
     ― CritiCall® dispatcher/call-taker personnel selection software
     ― ENCOUNTER soft skills video situational judgment testing software
     ― OPAC® office skills testing software
     ― TVAP™ Test Validation & Analysis Program software
                                www.Biddle.com

Mais conteúdo relacionado

Mais procurados

Authentic Assessment
Authentic AssessmentAuthentic Assessment
Authentic AssessmentSuha Tamim
 
Performance-based Learning and Assessment: Issues
Performance-based Learning and Assessment: IssuesPerformance-based Learning and Assessment: Issues
Performance-based Learning and Assessment: IssuesDino Andrey
 
Criterion-referenced assessment
Criterion-referenced assessmentCriterion-referenced assessment
Criterion-referenced assessmentMiss EAP
 
lecture strategy- method of teaching
 lecture strategy- method of teaching lecture strategy- method of teaching
lecture strategy- method of teachingMonika Sharma
 
5.4 STAGES IN IMPLEMENTING PORTFOLIO ASSESSMENT
5.4 STAGES IN IMPLEMENTING PORTFOLIO ASSESSMENT5.4 STAGES IN IMPLEMENTING PORTFOLIO ASSESSMENT
5.4 STAGES IN IMPLEMENTING PORTFOLIO ASSESSMENTRhea Dulla
 
Curriculum - What the Experts Have to Say
Curriculum - What the Experts Have to SayCurriculum - What the Experts Have to Say
Curriculum - What the Experts Have to SayAleasha2602
 
Performance Based Assessment
Performance  Based AssessmentPerformance  Based Assessment
Performance Based AssessmentJeremy
 
Practicality and-efficiency
Practicality and-efficiencyPracticality and-efficiency
Practicality and-efficiencyJelma Perico
 
Strengthening School Learning Action Cell for Junior High School Teachers in ...
Strengthening School Learning Action Cell for Junior High School Teachers in ...Strengthening School Learning Action Cell for Junior High School Teachers in ...
Strengthening School Learning Action Cell for Junior High School Teachers in ...ccnhs maincamus
 
Learning Targets by Karen Kidwell
Learning Targets by Karen KidwellLearning Targets by Karen Kidwell
Learning Targets by Karen Kidwellsuehellman
 
Performance Based assessment
Performance Based  assessmentPerformance Based  assessment
Performance Based assessmentMasrurin Lailiyah
 
ELD Standards and CCSS
ELD Standards and CCSSELD Standards and CCSS
ELD Standards and CCSSCarla Piper
 
Lyle F. Bachman Measurement ( Chapter 2 )
Lyle F. Bachman  Measurement ( Chapter 2 )Lyle F. Bachman  Measurement ( Chapter 2 )
Lyle F. Bachman Measurement ( Chapter 2 )Abdolhossein Omidi
 
Formative assessment
Formative assessmentFormative assessment
Formative assessmentCarlo Magno
 

Mais procurados (20)

Authentic Assessment
Authentic AssessmentAuthentic Assessment
Authentic Assessment
 
Performance-based Learning and Assessment: Issues
Performance-based Learning and Assessment: IssuesPerformance-based Learning and Assessment: Issues
Performance-based Learning and Assessment: Issues
 
Criterion-referenced assessment
Criterion-referenced assessmentCriterion-referenced assessment
Criterion-referenced assessment
 
lecture strategy- method of teaching
 lecture strategy- method of teaching lecture strategy- method of teaching
lecture strategy- method of teaching
 
5.4 STAGES IN IMPLEMENTING PORTFOLIO ASSESSMENT
5.4 STAGES IN IMPLEMENTING PORTFOLIO ASSESSMENT5.4 STAGES IN IMPLEMENTING PORTFOLIO ASSESSMENT
5.4 STAGES IN IMPLEMENTING PORTFOLIO ASSESSMENT
 
Curriculum - What the Experts Have to Say
Curriculum - What the Experts Have to SayCurriculum - What the Experts Have to Say
Curriculum - What the Experts Have to Say
 
Performance Based Assessment
Performance  Based AssessmentPerformance  Based Assessment
Performance Based Assessment
 
Inquiry based learning
Inquiry based learningInquiry based learning
Inquiry based learning
 
Practicality and-efficiency
Practicality and-efficiencyPracticality and-efficiency
Practicality and-efficiency
 
Analyzing exemplars
Analyzing exemplarsAnalyzing exemplars
Analyzing exemplars
 
Strengthening School Learning Action Cell for Junior High School Teachers in ...
Strengthening School Learning Action Cell for Junior High School Teachers in ...Strengthening School Learning Action Cell for Junior High School Teachers in ...
Strengthening School Learning Action Cell for Junior High School Teachers in ...
 
Learning Targets by Karen Kidwell
Learning Targets by Karen KidwellLearning Targets by Karen Kidwell
Learning Targets by Karen Kidwell
 
On Constructive Alignment - what & how?
On Constructive Alignment - what & how?On Constructive Alignment - what & how?
On Constructive Alignment - what & how?
 
Performance Based assessment
Performance Based  assessmentPerformance Based  assessment
Performance Based assessment
 
Validation sheet
Validation sheetValidation sheet
Validation sheet
 
Article review sample
Article review sampleArticle review sample
Article review sample
 
ELD Standards and CCSS
ELD Standards and CCSSELD Standards and CCSS
ELD Standards and CCSS
 
Lyle F. Bachman Measurement ( Chapter 2 )
Lyle F. Bachman  Measurement ( Chapter 2 )Lyle F. Bachman  Measurement ( Chapter 2 )
Lyle F. Bachman Measurement ( Chapter 2 )
 
Colloquium PPT
Colloquium PPTColloquium PPT
Colloquium PPT
 
Formative assessment
Formative assessmentFormative assessment
Formative assessment
 

Semelhante a Developing, Validating, and Analyzing Structured Interviews (Overview)

Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAnanya Pani
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAnanya Pani
 
Benchmarking for hrd professionals
Benchmarking for hrd professionalsBenchmarking for hrd professionals
Benchmarking for hrd professionalsSorab Sadri
 
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...Texavi Innovative Solutions
 
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'Emma Mirrington
 
ORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxHR Spot
 
90 days to make a difference - approach
90 days to make a difference - approach90 days to make a difference - approach
90 days to make a difference - approachStuart Creasey
 
Use of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentUse of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentCCH iFirm
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality productCarmen Brion
 
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerImproving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerEdward Byers, PMP, SSGB
 
R a ci & innovation
R a ci & innovationR a ci & innovation
R a ci & innovationAlan Culler
 
Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Abdel-Halim Mahmoud
 
Recruiting 101
Recruiting 101Recruiting 101
Recruiting 101Meemz11
 
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, SonruEmma Mirrington
 

Semelhante a Developing, Validating, and Analyzing Structured Interviews (Overview) (20)

Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Benchmarking for hrd professionals
Benchmarking for hrd professionalsBenchmarking for hrd professionals
Benchmarking for hrd professionals
 
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
 
Sanitized tb swstmppp1516july
Sanitized tb swstmppp1516julySanitized tb swstmppp1516july
Sanitized tb swstmppp1516july
 
Vijay Sharma
Vijay SharmaVijay Sharma
Vijay Sharma
 
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
 
Beginning auditor (1)
Beginning auditor (1)Beginning auditor (1)
Beginning auditor (1)
 
Business Analysis.pdf
Business Analysis.pdfBusiness Analysis.pdf
Business Analysis.pdf
 
ORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptx
 
90 days to make a difference - approach
90 days to make a difference - approach90 days to make a difference - approach
90 days to make a difference - approach
 
Use of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentUse of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitment
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerImproving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
 
R a ci & innovation
R a ci & innovationR a ci & innovation
R a ci & innovation
 
Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model"
 
Recruiting 101
Recruiting 101Recruiting 101
Recruiting 101
 
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
 
360 performance appraisal
360 performance appraisal360 performance appraisal
360 performance appraisal
 
Ch06
Ch06 Ch06
Ch06
 

Developing, Validating, and Analyzing Structured Interviews (Overview)

  • 1. Developing, Validating, and Analyzing Structured Interviews BCGi: Adverse Impact & Test Validation Book Series
  • 2. What are Structured Interviews and How are they Scored and Analyzed? • Structured Interviews are oral interview sessions for hiring or promotional selection processes • They are different than many ad-hoc, informal interviews in both the way they are given and how they are scored • Structured Interviews can include several types of questions: – Situational questions – Behavioral questions – Competency-based questions • And typically involve several raters and pre-defined scoring routines www.BCGinstitute.org
  • 3. Why is this Topic Important to HR/EEO Professionals? • Why do I need to know about this topic? – Yes… Interviews are “tests” and they are also subject to Title VII validation laws and are frequently litigated – Informal, ad-hoc interviews are generally not as effective as validated, structured interviews – There is a process for building and developing strong interviews, but many employers don’t take the time • What are the key essentials I need to know about this topic? – Structured interviews are not too difficult to develop – Using multiple raters and rating scales can improve the effectiveness and validity of your interview process • What are the consequences surrounding these issues? – Ad-hoc, informal interviews can possibly introduce liability and lower the quality of your workforce – The “start up” cost of a validation case is $30k to $80k www.BCGinstitute.org
  • 4. Presentation Overview • Overview & Background • Methods for Improving the Interview Process • Types of Questions to Include in Structured Interviews • Steps for Developing Situational Questions • Administering and Scoring an Interview www.BCGinstitute.org
  • 5. Presentation Overview • Methods for Improving the Interview Process – How valid and reliable the interview is may be highly specific to both the situation and to the rater. • Types of Questions to Include in Structured Interviews – Situational questions – Behavioral questions – Competency-based questions www.BCGinstitute.org
  • 6. Presentation Overview • Steps for Developing Situational Questions – We’ll cover 13 steps that are typically involved in the Interview development process • Administering and Scoring an Interview – Selecting raters – Training raters – Assembling panels – Administering/scoring the interview – Combining applicant scores from multiple panels www.BCGinstitute.org
  • 7. Resources • Adverse Impact and Test Validation: A Practitioner's Handbook by Daniel A. Biddle, Ph.D. – Purchase online at www.BCGinstitute.org • Adverse Impact and Test Validation Book Series Webinars – Recordings available online for all BCGi Platinum Members – Webinar slides available online to all BCGi Standard & Platinum Members • BCGi Membership – Free Standard Membership – Premium Platinum Membership www.BCGinstitute.org
  • 8. About Our Sponsor: Biddle Consulting Group (BCG) BCG is an HR firm dedicated to providing the highest products and services related to Equal Employment Opportunity (EEO), Affirmative Action and Employee Selection. • BCG’s Consulting Services ― Affirmative Action Plan Outsourcing ― Compensation Analysis ― EEO/AA Litigation Support (Plaintiff and Defendant) ― Job Analysis ― Test Development and Test Validation • BCG’s Software Products ― Adverse Impact Toolkit™ ― AutoAAP® affirmative action plan development software ― AutoGOJA® job analysis software ― C4 call center testing software ― COMPARE™ compensation analysis software ― CritiCall® dispatcher/call-taker personnel selection software ― ENCOUNTER soft skills video situational judgment testing software ― OPAC® office skills testing software ― TVAP™ Test Validation & Analysis Program software www.Biddle.com