SlideShare uma empresa Scribd logo
1 de 31
Developing Affective Constructs



               Dr. Carlo Magno
 Counseling and Educational Psychology Department
           De La Salle University-Manila



                                                    1
Affective characteristics
• Anderson (1981) explained affective characteristics as
  “qualities which presents people’s typical ways of
  feeling, or expressing their emotions” (p. 3).
• Sta. Maria and Magno (2007) found that affective
  characteristics run on two dimensions: Intensity and
  direction.
• Intensity refers to the strength of the characteristic
  expressed.
• Direction of affect refers to the cause of the affect from
  object external factors to person factors.
                                                           2
Dimensions of Affect




                       3
Classifications of Affective Scales
• Attitude. Learned predispositions to respond in a
   consistently favorable or unfavorable manner with
   respect to a given object (Meece et al. 1982).
• Attitude Towards Church Scale” by Thurstone and
   Chave (1929):
1. I think the teaching of the church is altogether too
   superficial to have much social and significance.
2. I feel the church services give me inspiration and help
   me to live up to my best during the following week.

                                                             4
Classifications of Affective Scales
• Beliefs. Judgments and evaluations that we make about
  ourselves, about others, and about the world around us
  (Dilts, 1999).
• Examples of belief statements:
• “A quiet classroom is conducive to learning”
• “Studying longer will improve a student’s score on the
  test”
• “Grades encourage students to work harder”
• Interests. "a liking/disliking state of mind
  accompanying the doing of an activity" (Strong, 1955,
  p. 138).
                                                       5
Classifications of Affective Scales
• Values. “the principles and fundamental convictions
  which act as general guides to behavior, the standards
  by which particular actions are judged to be good or
  desirable (Halstead & Taylor, 2000, p. 169).
• Dispositions are guided by beliefs and attitudes related
  to values such as caring, fairness, honesty,
  responsibility, and social justice. Examples of
  dispositions include fairness, being democratic,
  empathy, enthusiasm, thoughtfulness, and
  respectfulness.

                                                             6
Steps in Constructing Non-Cognitive
                 Measures
• Decide what information should be sought
   – (1) No scales are available to measure such construct
   – (2) All scales are foreign and it is not suitable for the
     stakeholders or sample that will take the measure
   – (3) Existing measures are not appropriate for the purpose of
     assessment
   – (4) The test developer intends to explore the underlying
     factors of a construct and eventually confirm it
• Search for Content Domain:
   – Search for relevant literature reviews
   – Look for the appropriate definition
   – Explain the theory
   – Specify the underlying variables (deconstruction)
                                                                    7
Steps in Constructing Non-Cognitive
             Measures
                    Subscale 1


                    Subscale 2


                    Subscale 3
    Factor

                    Subscale 4


                    Subscale 5




                                      8
Steps in Constructing Non-Cognitive
             Measures

                            item 1

           Factor1          Item 2


                            item 3


                            item 4
           Factor2

                            item 5




                                      9
Steps in Constructing Non-Cognitive
                 Measures
• Write the first draft of items:
• Items are created for each subscale as guided by the conceptual
  definition.
• The number of items as planned in the Table of Specifications
  is also considered.
• As much as possible, a large number of items are written to
  represent well the behavior being measured.
• How to write Items:
   –   Items are based on the definition of the subscales
   –   Provide the manifestation of the construct
   –   Descriptions from references
   –   Conduct an open ended surveys, interview, FGD’s


                                                                10
Steps in Constructing Non-Cognitive
                 Measures
Good questionnaire items should:
1. Include a vocabulary that is simple, direct, and familiar to all
   respondents
2. Be clear and specific
3. Not involve leading, loaded or double barreled questions
4. Be as short as possible
5. Include all conditional information prior to the key ideas
6. Be edited for readability
7. Generalizable for a large sample.
8. Avoid time-bound situations.


                                                                      11
Steps in Constructing Non-Cognitive
                 Measures
• Example of bad items:
• I am satisfied with my wages and hours at the place where I
  work. (Double Barreled)
• I not in favor congress passing a law not allowing any employer
  to force any employee to retire
• at any age. (Double Negative)
• Most people favor death penalty. What do you think? (Leading
  Question)




                                                                12
Steps in Constructing Non-Cognitive
                 Measures
• Select a scaling technique:
• After writing the items, the test developer decides on the appropriate
  response format to be used in the scale.
• The most common response formats used:
   – Lickert scale (measure of position in an opinion)
   – Verbal frequency scale (measure of a habit)
   – Ordinal scale (ordering of responses)
   – Linear numeric scale (judging a single dimension in an array)
• Develop directions for responding:
• Directions or instructions for the target respondents be created as early as
  when the items are created.
• Clear and concise.
• Respondents should be informed how to answer.
• When you intend to have a separate answer sheet, make sure to inform the
  respondents about it in the instructions.
• Instructions should also include ways of changing answers, how to answer
  (encircle, check, or shade).
• Inform the respondents in the instructions specifically what they need to do.
                                                                              13
Steps in Constructing Non-Cognitive
                Measures
• Conduct a judgmental review of items
• Have experts review your items.




                                         14
Steps in Constructing Non-Cognitive
                  Measures
•   Reexamine and revise the questionnaire
•   Prepare a draft and gather preliminary pilot data:
•   Requires a layout of the test for the respondents.
•   Make the scale as easy as possible to use.
•   Each item can be identified with a number or a letter to
    facilitate scoring of responses later.
•   The items should be structured for readability and recording
    responses.
•   Whenever possible items with the same response formats are
    placed together.
•   In designing self-administered scales, it is suggested to make it
    visually appealing to increase response rate.
•   Self-explanatory and the respondents can complete it in a short
    time.
•   Ordering of items: The first few questions set the tone for the
    rest of the items and determine how willingly and                 15
    conscientiously respondents will work on subsequent questions.
Steps in Constructing Non-Cognitive
                 Measures
• Analyze Pilot data:
• The responses in the scale should be recorded using a
  spreadsheet.
• The numerical responses are then analyzed.
• The analysis consists of determining whether the test is reliable
  or valid.
• Revise the Instrument:
• The instrument is then revised because items with low factor
  loadings are removed
• Items when removed will increase Cronbach’s alpha.



                                                                  16
Steps in Constructing Non-Cognitive
                 Measures
• Gather final pilot data
• A large sample is again selected which is three times the
  number of items.
• Conduct Additional Validity and Reliability Analysis
• The validity and reliability is again analyzed using the new pilot
  data.
• Edit the questionnaire and specify the procedures for its use
• Items with low factor loadings are again removed resulting to
  less items.
• A new form of the test with reduced items will be formed.
• Prepare the Test Manual
• The test manual indicates the purpose of the test, instructions in
  administering, procedure for scoring, interpreting the scores
                                                                    17
  including the norms.
Examples of Response Formats
• Multiple response item:




• Single-response item




                                       18
Examples of Response Formats

• Lickert Scale




                                        19
Examples of Response Formats

• Verbal frequency scale




                                       20
Examples of Response Formats

• Ordinal scale




                                       21
Examples of Response Formats
• Forced Ranking Scale




• Paired Comparison Scale




                                       22
Examples of Response Formats

• Comparative Scale




                                       23
Examples of Response Formats

• Linear Numeric Scale




                                       24
Examples of Response Formats

• Semantic differential scale




                                        25
Examples of Response Formats

• Adjective checklist




• Semantic distance scale




                                        26
Examples of Response Formats

• Fixed sum scale




                                      27
Examples of Response Formats

• Multiple rating list




                                        28
Examples of Response Formats

• Multiple rating matrix




                                        29
Examples of Response Formats

• Diagram scale




                                      30
Examples of Response Formats
• Graphic scale




                                         31

Mais conteúdo relacionado

Mais procurados

Portfolio assessment
Portfolio assessmentPortfolio assessment
Portfolio assessmentCarlo Magno
 
STEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSSTEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSLoradelLegaspi
 
Essay question construction
Essay  question constructionEssay  question construction
Essay question constructionCLINIE JONATHAN
 
Assessment principles
Assessment principlesAssessment principles
Assessment principlesCarlo Magno
 
Guidelines for Constructing Effective Test Items
Guidelines for Constructing Effective Test ItemsGuidelines for Constructing Effective Test Items
Guidelines for Constructing Effective Test ItemsKimverly Torres
 
Principles of Test Construction 1
Principles of Test Construction 1Principles of Test Construction 1
Principles of Test Construction 1Monica P
 
Properties of Assessment Method
Properties of Assessment MethodProperties of Assessment Method
Properties of Assessment MethodLarry Sultiz
 
Performance based assessment
Performance based assessmentPerformance based assessment
Performance based assessmentJen_castle
 
TABLE OF SPECIFICATION
TABLE OF SPECIFICATIONTABLE OF SPECIFICATION
TABLE OF SPECIFICATIONfloriejean
 
Lesson 5 performance based assessment
Lesson 5 performance based assessmentLesson 5 performance based assessment
Lesson 5 performance based assessmentCarlo Magno
 
Action Research Lit Review
Action Research Lit ReviewAction Research Lit Review
Action Research Lit Reviewcfmorr
 
Characteristics of 21st Century Assessment
Characteristics of 21st Century AssessmentCharacteristics of 21st Century Assessment
Characteristics of 21st Century AssessmentSarah Mae Moniva
 
Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)Jeziel Dela Cruz
 
Assessment Of Student Learning
Assessment Of Student LearningAssessment Of Student Learning
Assessment Of Student LearningArlan Villanueva
 

Mais procurados (20)

Portfolio assessment
Portfolio assessmentPortfolio assessment
Portfolio assessment
 
STEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSSTEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLS
 
Essay question construction
Essay  question constructionEssay  question construction
Essay question construction
 
Assessment principles
Assessment principlesAssessment principles
Assessment principles
 
Guidelines for Constructing Effective Test Items
Guidelines for Constructing Effective Test ItemsGuidelines for Constructing Effective Test Items
Guidelines for Constructing Effective Test Items
 
Test Construction
Test ConstructionTest Construction
Test Construction
 
Principles of Test Construction 1
Principles of Test Construction 1Principles of Test Construction 1
Principles of Test Construction 1
 
Properties of Assessment Method
Properties of Assessment MethodProperties of Assessment Method
Properties of Assessment Method
 
Performance based Assessment
Performance based AssessmentPerformance based Assessment
Performance based Assessment
 
Types of Test
Types of Test Types of Test
Types of Test
 
Performance based assessment
Performance based assessmentPerformance based assessment
Performance based assessment
 
TABLE OF SPECIFICATION
TABLE OF SPECIFICATIONTABLE OF SPECIFICATION
TABLE OF SPECIFICATION
 
Lesson 5 performance based assessment
Lesson 5 performance based assessmentLesson 5 performance based assessment
Lesson 5 performance based assessment
 
Action Research Lit Review
Action Research Lit ReviewAction Research Lit Review
Action Research Lit Review
 
ESSAY TYPE OF TEST
ESSAY TYPE OF TESTESSAY TYPE OF TEST
ESSAY TYPE OF TEST
 
Characteristics of 21st Century Assessment
Characteristics of 21st Century AssessmentCharacteristics of 21st Century Assessment
Characteristics of 21st Century Assessment
 
Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)
 
Portfolio assessment
Portfolio assessmentPortfolio assessment
Portfolio assessment
 
Assessment Of Student Learning
Assessment Of Student LearningAssessment Of Student Learning
Assessment Of Student Learning
 
Rubrics ppt
Rubrics pptRubrics ppt
Rubrics ppt
 

Semelhante a Developing affective constructs

Scale development -- Steps
Scale development -- StepsScale development -- Steps
Scale development -- StepsKhalid Mahmood
 
Survey design-workshop-1234170716539145-3[1]
Survey design-workshop-1234170716539145-3[1]Survey design-workshop-1234170716539145-3[1]
Survey design-workshop-1234170716539145-3[1]nemururati
 
Bmgt 311 chapter_8
Bmgt 311 chapter_8Bmgt 311 chapter_8
Bmgt 311 chapter_8Chris Lovett
 
How to conduct a questionnaire for a scientific survey
How to conduct a questionnaire for a scientific surveyHow to conduct a questionnaire for a scientific survey
How to conduct a questionnaire for a scientific surveyNermin Osman
 
Lecture_4_Data_Gathering_and_Analysis.pdf
Lecture_4_Data_Gathering_and_Analysis.pdfLecture_4_Data_Gathering_and_Analysis.pdf
Lecture_4_Data_Gathering_and_Analysis.pdfAbdullahOmar64
 
Observation and Research: Session 1 (Blended TEFL course)
Observation and Research: Session 1 (Blended TEFL course)Observation and Research: Session 1 (Blended TEFL course)
Observation and Research: Session 1 (Blended TEFL course)Maria Mu
 
Business Research Methods Unit II
Business Research Methods Unit IIBusiness Research Methods Unit II
Business Research Methods Unit IIKartikeya Singh
 
Measurement in Marketing Research
Measurement in Marketing ResearchMeasurement in Marketing Research
Measurement in Marketing ResearchShameem Ali
 
Psychological assessments and tests.pptx
Psychological assessments and tests.pptxPsychological assessments and tests.pptx
Psychological assessments and tests.pptxCafeWandererNoida
 
Ch05 Concepts, Operationalization, and Measurement
Ch05 Concepts, Operationalization, and MeasurementCh05 Concepts, Operationalization, and Measurement
Ch05 Concepts, Operationalization, and Measurementyxl007
 
Rss Oct 2011 Mixed Modes Pres2
Rss Oct 2011 Mixed Modes Pres2Rss Oct 2011 Mixed Modes Pres2
Rss Oct 2011 Mixed Modes Pres2GerryNicolaas
 
M.Ed Guidance & Counselling II Topic-administration ofPsychological testing- ...
M.Ed Guidance & Counselling II Topic-administration ofPsychological testing- ...M.Ed Guidance & Counselling II Topic-administration ofPsychological testing- ...
M.Ed Guidance & Counselling II Topic-administration ofPsychological testing- ...fatima roshan
 
Collecting Research Data With Questionnaires And Interviews
Collecting Research Data With Questionnaires And InterviewsCollecting Research Data With Questionnaires And Interviews
Collecting Research Data With Questionnaires And InterviewsAmanda Walker
 

Semelhante a Developing affective constructs (20)

Scale development -- Steps
Scale development -- StepsScale development -- Steps
Scale development -- Steps
 
MoE.pptx
MoE.pptxMoE.pptx
MoE.pptx
 
Survey design-workshop-1234170716539145-3[1]
Survey design-workshop-1234170716539145-3[1]Survey design-workshop-1234170716539145-3[1]
Survey design-workshop-1234170716539145-3[1]
 
Bmgt 311 chapter_8
Bmgt 311 chapter_8Bmgt 311 chapter_8
Bmgt 311 chapter_8
 
How to conduct a questionnaire for a scientific survey
How to conduct a questionnaire for a scientific surveyHow to conduct a questionnaire for a scientific survey
How to conduct a questionnaire for a scientific survey
 
Methodology and IRB/URR
Methodology and IRB/URRMethodology and IRB/URR
Methodology and IRB/URR
 
Authentic Tasks
Authentic TasksAuthentic Tasks
Authentic Tasks
 
Lecture_4_Data_Gathering_and_Analysis.pdf
Lecture_4_Data_Gathering_and_Analysis.pdfLecture_4_Data_Gathering_and_Analysis.pdf
Lecture_4_Data_Gathering_and_Analysis.pdf
 
Observation and Research: Session 1 (Blended TEFL course)
Observation and Research: Session 1 (Blended TEFL course)Observation and Research: Session 1 (Blended TEFL course)
Observation and Research: Session 1 (Blended TEFL course)
 
Business Research Methods Unit II
Business Research Methods Unit IIBusiness Research Methods Unit II
Business Research Methods Unit II
 
Measurement in Marketing Research
Measurement in Marketing ResearchMeasurement in Marketing Research
Measurement in Marketing Research
 
ICAR-IFPRI - Basic Research Questions lecture 1 - Devesh Roy, IFPRI
ICAR-IFPRI - Basic Research Questions lecture 1 - Devesh Roy, IFPRIICAR-IFPRI - Basic Research Questions lecture 1 - Devesh Roy, IFPRI
ICAR-IFPRI - Basic Research Questions lecture 1 - Devesh Roy, IFPRI
 
Issue-based metrics
Issue-based metricsIssue-based metrics
Issue-based metrics
 
Psychological assessments and tests.pptx
Psychological assessments and tests.pptxPsychological assessments and tests.pptx
Psychological assessments and tests.pptx
 
Psychological assessments and tests.pptx
Psychological assessments and tests.pptxPsychological assessments and tests.pptx
Psychological assessments and tests.pptx
 
Ch05 Concepts, Operationalization, and Measurement
Ch05 Concepts, Operationalization, and MeasurementCh05 Concepts, Operationalization, and Measurement
Ch05 Concepts, Operationalization, and Measurement
 
Operational research ppt
Operational research pptOperational research ppt
Operational research ppt
 
Rss Oct 2011 Mixed Modes Pres2
Rss Oct 2011 Mixed Modes Pres2Rss Oct 2011 Mixed Modes Pres2
Rss Oct 2011 Mixed Modes Pres2
 
M.Ed Guidance & Counselling II Topic-administration ofPsychological testing- ...
M.Ed Guidance & Counselling II Topic-administration ofPsychological testing- ...M.Ed Guidance & Counselling II Topic-administration ofPsychological testing- ...
M.Ed Guidance & Counselling II Topic-administration ofPsychological testing- ...
 
Collecting Research Data With Questionnaires And Interviews
Collecting Research Data With Questionnaires And InterviewsCollecting Research Data With Questionnaires And Interviews
Collecting Research Data With Questionnaires And Interviews
 

Mais de Carlo Magno

Assessment Using the SOLO Framework.pptx
Assessment Using the SOLO Framework.pptxAssessment Using the SOLO Framework.pptx
Assessment Using the SOLO Framework.pptxCarlo Magno
 
Social and Emotional Learning
Social and Emotional LearningSocial and Emotional Learning
Social and Emotional LearningCarlo Magno
 
Educational assessment in the 4 ir
Educational assessment in the 4 irEducational assessment in the 4 ir
Educational assessment in the 4 irCarlo Magno
 
The process of research mentoring
The process of research mentoringThe process of research mentoring
The process of research mentoringCarlo Magno
 
Quality management services sustainability training
Quality management services sustainability trainingQuality management services sustainability training
Quality management services sustainability trainingCarlo Magno
 
Managing technology integration in schools
Managing technology integration in schoolsManaging technology integration in schools
Managing technology integration in schoolsCarlo Magno
 
Integrating technology in teaching
Integrating technology in teachingIntegrating technology in teaching
Integrating technology in teachingCarlo Magno
 
Empowering educators on technology integration
Empowering educators on technology integrationEmpowering educators on technology integration
Empowering educators on technology integrationCarlo Magno
 
Designing an online lesson
Designing an online lessonDesigning an online lesson
Designing an online lessonCarlo Magno
 
Curriculum integration
Curriculum integrationCurriculum integration
Curriculum integrationCarlo Magno
 
Accountability in Developing Student Learning
Accountability in Developing Student LearningAccountability in Developing Student Learning
Accountability in Developing Student LearningCarlo Magno
 
The Instructional leader: TOwards School Improvement
The Instructional leader: TOwards School ImprovementThe Instructional leader: TOwards School Improvement
The Instructional leader: TOwards School ImprovementCarlo Magno
 
Guiding your child on their career decision making
Guiding your child on their career decision makingGuiding your child on their career decision making
Guiding your child on their career decision makingCarlo Magno
 
Assessing Science Inquiry Skills
Assessing Science Inquiry SkillsAssessing Science Inquiry Skills
Assessing Science Inquiry SkillsCarlo Magno
 
Assessment in the Social Studies Curriculum
Assessment in the Social Studies CurriculumAssessment in the Social Studies Curriculum
Assessment in the Social Studies CurriculumCarlo Magno
 
Quantitative analysis in language research
Quantitative analysis in language researchQuantitative analysis in language research
Quantitative analysis in language researchCarlo Magno
 
Integrating technology in teaching
Integrating technology in teachingIntegrating technology in teaching
Integrating technology in teachingCarlo Magno
 
Hallmarks of textbook
Hallmarks of textbookHallmarks of textbook
Hallmarks of textbookCarlo Magno
 
managing the learner centered-classroom
managing the learner centered-classroommanaging the learner centered-classroom
managing the learner centered-classroomCarlo Magno
 
Assessing learning objectives
Assessing learning objectivesAssessing learning objectives
Assessing learning objectivesCarlo Magno
 

Mais de Carlo Magno (20)

Assessment Using the SOLO Framework.pptx
Assessment Using the SOLO Framework.pptxAssessment Using the SOLO Framework.pptx
Assessment Using the SOLO Framework.pptx
 
Social and Emotional Learning
Social and Emotional LearningSocial and Emotional Learning
Social and Emotional Learning
 
Educational assessment in the 4 ir
Educational assessment in the 4 irEducational assessment in the 4 ir
Educational assessment in the 4 ir
 
The process of research mentoring
The process of research mentoringThe process of research mentoring
The process of research mentoring
 
Quality management services sustainability training
Quality management services sustainability trainingQuality management services sustainability training
Quality management services sustainability training
 
Managing technology integration in schools
Managing technology integration in schoolsManaging technology integration in schools
Managing technology integration in schools
 
Integrating technology in teaching
Integrating technology in teachingIntegrating technology in teaching
Integrating technology in teaching
 
Empowering educators on technology integration
Empowering educators on technology integrationEmpowering educators on technology integration
Empowering educators on technology integration
 
Designing an online lesson
Designing an online lessonDesigning an online lesson
Designing an online lesson
 
Curriculum integration
Curriculum integrationCurriculum integration
Curriculum integration
 
Accountability in Developing Student Learning
Accountability in Developing Student LearningAccountability in Developing Student Learning
Accountability in Developing Student Learning
 
The Instructional leader: TOwards School Improvement
The Instructional leader: TOwards School ImprovementThe Instructional leader: TOwards School Improvement
The Instructional leader: TOwards School Improvement
 
Guiding your child on their career decision making
Guiding your child on their career decision makingGuiding your child on their career decision making
Guiding your child on their career decision making
 
Assessing Science Inquiry Skills
Assessing Science Inquiry SkillsAssessing Science Inquiry Skills
Assessing Science Inquiry Skills
 
Assessment in the Social Studies Curriculum
Assessment in the Social Studies CurriculumAssessment in the Social Studies Curriculum
Assessment in the Social Studies Curriculum
 
Quantitative analysis in language research
Quantitative analysis in language researchQuantitative analysis in language research
Quantitative analysis in language research
 
Integrating technology in teaching
Integrating technology in teachingIntegrating technology in teaching
Integrating technology in teaching
 
Hallmarks of textbook
Hallmarks of textbookHallmarks of textbook
Hallmarks of textbook
 
managing the learner centered-classroom
managing the learner centered-classroommanaging the learner centered-classroom
managing the learner centered-classroom
 
Assessing learning objectives
Assessing learning objectivesAssessing learning objectives
Assessing learning objectives
 

Developing affective constructs

  • 1. Developing Affective Constructs Dr. Carlo Magno Counseling and Educational Psychology Department De La Salle University-Manila 1
  • 2. Affective characteristics • Anderson (1981) explained affective characteristics as “qualities which presents people’s typical ways of feeling, or expressing their emotions” (p. 3). • Sta. Maria and Magno (2007) found that affective characteristics run on two dimensions: Intensity and direction. • Intensity refers to the strength of the characteristic expressed. • Direction of affect refers to the cause of the affect from object external factors to person factors. 2
  • 4. Classifications of Affective Scales • Attitude. Learned predispositions to respond in a consistently favorable or unfavorable manner with respect to a given object (Meece et al. 1982). • Attitude Towards Church Scale” by Thurstone and Chave (1929): 1. I think the teaching of the church is altogether too superficial to have much social and significance. 2. I feel the church services give me inspiration and help me to live up to my best during the following week. 4
  • 5. Classifications of Affective Scales • Beliefs. Judgments and evaluations that we make about ourselves, about others, and about the world around us (Dilts, 1999). • Examples of belief statements: • “A quiet classroom is conducive to learning” • “Studying longer will improve a student’s score on the test” • “Grades encourage students to work harder” • Interests. "a liking/disliking state of mind accompanying the doing of an activity" (Strong, 1955, p. 138). 5
  • 6. Classifications of Affective Scales • Values. “the principles and fundamental convictions which act as general guides to behavior, the standards by which particular actions are judged to be good or desirable (Halstead & Taylor, 2000, p. 169). • Dispositions are guided by beliefs and attitudes related to values such as caring, fairness, honesty, responsibility, and social justice. Examples of dispositions include fairness, being democratic, empathy, enthusiasm, thoughtfulness, and respectfulness. 6
  • 7. Steps in Constructing Non-Cognitive Measures • Decide what information should be sought – (1) No scales are available to measure such construct – (2) All scales are foreign and it is not suitable for the stakeholders or sample that will take the measure – (3) Existing measures are not appropriate for the purpose of assessment – (4) The test developer intends to explore the underlying factors of a construct and eventually confirm it • Search for Content Domain: – Search for relevant literature reviews – Look for the appropriate definition – Explain the theory – Specify the underlying variables (deconstruction) 7
  • 8. Steps in Constructing Non-Cognitive Measures Subscale 1 Subscale 2 Subscale 3 Factor Subscale 4 Subscale 5 8
  • 9. Steps in Constructing Non-Cognitive Measures item 1 Factor1 Item 2 item 3 item 4 Factor2 item 5 9
  • 10. Steps in Constructing Non-Cognitive Measures • Write the first draft of items: • Items are created for each subscale as guided by the conceptual definition. • The number of items as planned in the Table of Specifications is also considered. • As much as possible, a large number of items are written to represent well the behavior being measured. • How to write Items: – Items are based on the definition of the subscales – Provide the manifestation of the construct – Descriptions from references – Conduct an open ended surveys, interview, FGD’s 10
  • 11. Steps in Constructing Non-Cognitive Measures Good questionnaire items should: 1. Include a vocabulary that is simple, direct, and familiar to all respondents 2. Be clear and specific 3. Not involve leading, loaded or double barreled questions 4. Be as short as possible 5. Include all conditional information prior to the key ideas 6. Be edited for readability 7. Generalizable for a large sample. 8. Avoid time-bound situations. 11
  • 12. Steps in Constructing Non-Cognitive Measures • Example of bad items: • I am satisfied with my wages and hours at the place where I work. (Double Barreled) • I not in favor congress passing a law not allowing any employer to force any employee to retire • at any age. (Double Negative) • Most people favor death penalty. What do you think? (Leading Question) 12
  • 13. Steps in Constructing Non-Cognitive Measures • Select a scaling technique: • After writing the items, the test developer decides on the appropriate response format to be used in the scale. • The most common response formats used: – Lickert scale (measure of position in an opinion) – Verbal frequency scale (measure of a habit) – Ordinal scale (ordering of responses) – Linear numeric scale (judging a single dimension in an array) • Develop directions for responding: • Directions or instructions for the target respondents be created as early as when the items are created. • Clear and concise. • Respondents should be informed how to answer. • When you intend to have a separate answer sheet, make sure to inform the respondents about it in the instructions. • Instructions should also include ways of changing answers, how to answer (encircle, check, or shade). • Inform the respondents in the instructions specifically what they need to do. 13
  • 14. Steps in Constructing Non-Cognitive Measures • Conduct a judgmental review of items • Have experts review your items. 14
  • 15. Steps in Constructing Non-Cognitive Measures • Reexamine and revise the questionnaire • Prepare a draft and gather preliminary pilot data: • Requires a layout of the test for the respondents. • Make the scale as easy as possible to use. • Each item can be identified with a number or a letter to facilitate scoring of responses later. • The items should be structured for readability and recording responses. • Whenever possible items with the same response formats are placed together. • In designing self-administered scales, it is suggested to make it visually appealing to increase response rate. • Self-explanatory and the respondents can complete it in a short time. • Ordering of items: The first few questions set the tone for the rest of the items and determine how willingly and 15 conscientiously respondents will work on subsequent questions.
  • 16. Steps in Constructing Non-Cognitive Measures • Analyze Pilot data: • The responses in the scale should be recorded using a spreadsheet. • The numerical responses are then analyzed. • The analysis consists of determining whether the test is reliable or valid. • Revise the Instrument: • The instrument is then revised because items with low factor loadings are removed • Items when removed will increase Cronbach’s alpha. 16
  • 17. Steps in Constructing Non-Cognitive Measures • Gather final pilot data • A large sample is again selected which is three times the number of items. • Conduct Additional Validity and Reliability Analysis • The validity and reliability is again analyzed using the new pilot data. • Edit the questionnaire and specify the procedures for its use • Items with low factor loadings are again removed resulting to less items. • A new form of the test with reduced items will be formed. • Prepare the Test Manual • The test manual indicates the purpose of the test, instructions in administering, procedure for scoring, interpreting the scores 17 including the norms.
  • 18. Examples of Response Formats • Multiple response item: • Single-response item 18
  • 19. Examples of Response Formats • Lickert Scale 19
  • 20. Examples of Response Formats • Verbal frequency scale 20
  • 21. Examples of Response Formats • Ordinal scale 21
  • 22. Examples of Response Formats • Forced Ranking Scale • Paired Comparison Scale 22
  • 23. Examples of Response Formats • Comparative Scale 23
  • 24. Examples of Response Formats • Linear Numeric Scale 24
  • 25. Examples of Response Formats • Semantic differential scale 25
  • 26. Examples of Response Formats • Adjective checklist • Semantic distance scale 26
  • 27. Examples of Response Formats • Fixed sum scale 27
  • 28. Examples of Response Formats • Multiple rating list 28
  • 29. Examples of Response Formats • Multiple rating matrix 29
  • 30. Examples of Response Formats • Diagram scale 30
  • 31. Examples of Response Formats • Graphic scale 31