SlideShare uma empresa Scribd logo
1 de 23
Baixar para ler offline
Instructional Design and
  Content Development
       Workshop
Topics

Define a program of evaluation
Evaluation in learning
Outline major reasons to conduct a program
evaluation
Why conduct an evaluation?
General evaluation models.
Who is Kirkpatrick?
Kirkpatrick’s four level learning evaluation
model
Write questions for each level to assess and
What is an evaluation?


Evaluation is a systematic method for collecting, analyzing, and
using information to answer basic questions about a program.

Evaluation is valuable for strengthen the quality of the
program and improve outcomes for the learners.

Evaluation answers basic questions about a program’s
effectiveness, and evaluation data can be used to improve
program services.
Evaluation In Learning

- Evaluation means assessing the effectiveness and
  possible improvement of a course.
- Evaluation is part of any instructional design model.
- Evaluation provides review checkpoints for each
  phase of ADDIE that allow the instructor to evaluate
- Without completing this produced.
  the work that has been portion
  of ADDIE model, the e-course
  is incomplete because the
  course cannot be redesigned
  and improved without
MAJOR REASONS TO CONDUCT AN EVALUATION




Evaluation finds out “what works” and “what does not work.”

Evaluation showcases the effectiveness of a program to the community.

Evaluation improves staff’s practice with participants.

Evaluation increases transfer of learning to behavior/performance in
order to maximize program results.

Evaluation increases a program’s capacity to conduct a critical self
assessment and plan for the future.

Evaluation builds knowledge for the out-of-campus time field.
Why conduct an evaluation?


The ADDIE model stresses the concept that
good training programs require
planning, review, and revision.
The evaluation phase focuses on gabs to mend
them.
Increase transfer of learning in order to maximize
learning / e-content results.
The evaluation phase measures the course's
Benefits of Evaluation

Effectiveness: It shows the progress made toward program goals and objectives.

Best Practices: It provides the ability to determine what program approaches are most
effective.

Improvement: It provides ongoing assessment of program design and implementation
to identify areas of improvement.

Impact: It demonstrates economic or human impact.

Accountability: It provides the base for interpreting an organization or programs’ worth
to its stakeholders.

Promotion & Advocacy: It informs policymakers about programs successes.

Appraisal & Coordination: It gives managers the performance information to make
better operational decisions.
General Evaluation Models


There are a lot of models clarifying the evaluation process and determining the
information needs of the intended audiences of the evaluation, these models
such as:

  Tyler’s early conception of assessing attainment of program objectives.

  Decision-Making Evaluation Approaches.

  Naturalistic Evaluation Approaches

  Kirkpatrick’s Four Levels for evaluating program effectiveness; which suggests
  the most appropriate evaluation methodology to be used.
Who is Kirkpatrick?


Donald Kirkpartick is Professor of the
University of Wisconsin in the USA and a
past president of the American Society for
Training and Development.
He has developed a very popular evaluation
model that has been used by the
training/learning community.

He focused on measuring four kinds of
Kirkpatrick’s four levels of
           evaluating learning

Kirkpatrick’s model includes four levels or steps of
outcome evaluation:
Level one - Evaluate Learner Reaction


Level One: Evaluate Learner Reaction
          How well did the learners like the learning process?


  The goal is find out the reaction of the learners to the
  instructor, course and learning environment.

  The purpose is not to measure what the learners has learned, but
  whether the delivery method was effective and appreciated.

  This type of evaluation can be incorporated at the end of the
  instruction and can be delivered online.
Level one - Evaluate Learner Reaction

General questions can include the following:
  •   Did the instructor attend the sessions on time?
  •   Did the instructor respond to learners’ comments and questions?
  •   Did the instructor deliver the information clearly and smoothly?
  •   Were there distraction?
  •   Did the learners feel comfortable in the surroundings?


E-content questions can include the following:
  •   Level of appeal of the instruction.
  •   The ease of navigation and use of tools.
  •   The ability of the course to motivate and retain interest.
  •   The amount of interactive exercises.
  •   The relevance of the objectives.
  •   Quality and relevance of multimedia.
  •   The ease of navigation and use of tools.
Level two - Evaluate Learning



Level two: Evaluate Learning
   What did learners learn? (the extent to which
   they gain knowledge, skills and attitude)



  The goal is measuring learning results.
  In other words: did the learners learn what
  intended to be taught?
Level two - Evaluate Learning


Measurement methods of level two include:
 Formal and informal testing.

  Self assessments at the beginning (pre-test) and end (post-test) for
  learners.
                 http://www.reap.ac.uk/reap/public/papers//DN_SHE_Final.pdf

  Interviews, observation and feedback.

  Product Assessment. Creation of a project as an authentic assessment to
  showcase the knowledge and talents.

  This form of assessment evaluates whether the learner can apply the learned
  skills or concepts in a concrete fashion.
Level three - Evaluate Performance


Level three: Evaluate Performance
              What changes in performance resulted from the learning process?

  To what degree participants apply what they learned during training when they are back on the job.
  The goal is measuring “what happens when learners leave the classroom and return
  to their daily lives/job.

  Did the learners put their learning into effect when back on the job/live?

  Would the learners be able to transfer their learning to another person?

  How much transfer of learning occurs?

  It is the most obvious sign to evaluate the training program’s effectiveness.
Level three - Evaluate Performance



Measurement methods of level two include:
Allow time for a change in behavior to take place
     Testing
     Observation, interview and survey.
     The learner interactions on the job.
     Evaluate both before and after the program if that is
     practical
Level four - Evaluate Results

Level four: Evaluate Results
             What are the tangible results of the learning process in terms improved
             quality, increased production, efficiency, etc.?
  To what degree targeted outcomes occur as a result of learning event(s) and subsequent
  reinforcement
  The goal is to find out if the training program led to final
  results, especially business or environment results
  Level four outcomes include the major results that contribute to the
  well functioning of an organization.
  Level four outcomes Improve quality of work, increase productivity and
  profits.
  Across an entire organization it becomes more challenging and affect
  organizational and business performance, which cloud the true cause
  of good or poor results.
Level four - Evaluate Results


Measurement methods of level four include:

 Methods of Measuring Learning Outcomes Grid
 How colleges and universities can measure and report on the knowledge and
 abilities their students have acquired during their college years is an issue of
 growing interest.
     http://web.mit.edu/tll/assessment-evaluation/methods-of-measuring-learning-outcomes-
 grid.doc
    http://www.elcamino.edu/academics/slo/docs/SLOFocusOnResults.doc


 Course-embedded assessment/Assurance of Learning Standards.
        http://www2.cortland.edu/dotAsset/f2e9f1ee-0100-40ab-b78d-48ead9c047d3.pdf
To Sum Up
Checklist for effective questions

Do                                                                 Do Not
Give clear instructions                                            Use complex phrases

Keep questions structure simple                                    Frame questions in the negative

Ask one question at a time                                         Use abbreviations, contractions or symbols

Maintain a parallel structure for all questions                    Mix different words for the same concept

Define terms before asking the question                            Use “loaded” words or phrases

Be explicit about the period of time being referenced by the       Combine multiple response dimensions in the same question
question
Provide a list of acceptable responses to closed questions         Give the impression that you are expecting a certain response

Ensure that response categories are both exhaustive and mutually   Bounce around between topics or time periods
exclusive
Label response categories with words rather than numbers           Insert unnecessary graphics or mix many font styles and sizes

Ask for number of occurrences, rather than providing response      Forget to provide instructions for returning the completed survey


Save personal and demographic questions for the end of the
survey
Activity



 Based on your study of
Kirkpatrick's model of learning
/ training programs
evaluation, apply this model to
evaluate your course using the
4 levels of Kirkpatrick's model.
o Write questions that explores
  the items within each level
ONLINE DETAILED COURSE MANUAL


http://www.kirkpatrickpartners.com/Portals/0/Training-
Events/Program%20Prework/Kirkpatrick%20Four%20Levels(t
m)%20Evaluation%20Online%20Certificate%20Manual.pdf
Evaluation

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

TYPES OF MUSIC NOTATION.pptx
TYPES OF MUSIC NOTATION.pptxTYPES OF MUSIC NOTATION.pptx
TYPES OF MUSIC NOTATION.pptx
 
16 primitivism, nationalism, neoclassicism (oer)
16 primitivism, nationalism, neoclassicism (oer)16 primitivism, nationalism, neoclassicism (oer)
16 primitivism, nationalism, neoclassicism (oer)
 
Elements of Music: Form
Elements of Music: FormElements of Music: Form
Elements of Music: Form
 
Music
MusicMusic
Music
 
Gregorian Chants
Gregorian ChantsGregorian Chants
Gregorian Chants
 
Melody
MelodyMelody
Melody
 
Musical form
Musical formMusical form
Musical form
 
Presentation mipv2
Presentation   mipv2Presentation   mipv2
Presentation mipv2
 
Elements of Music
Elements of MusicElements of Music
Elements of Music
 
Grade 9 health intentional injuries
Grade 9 health intentional injuriesGrade 9 health intentional injuries
Grade 9 health intentional injuries
 
Pentatonic scale
Pentatonic scalePentatonic scale
Pentatonic scale
 
Vocal technique
Vocal techniqueVocal technique
Vocal technique
 
Tip completion report
Tip completion reportTip completion report
Tip completion report
 
375912238-Daily-Lesson-Log-Template-DO-42-s-2016.docx
375912238-Daily-Lesson-Log-Template-DO-42-s-2016.docx375912238-Daily-Lesson-Log-Template-DO-42-s-2016.docx
375912238-Daily-Lesson-Log-Template-DO-42-s-2016.docx
 
Music-4-Lesson-1.pptx
Music-4-Lesson-1.pptxMusic-4-Lesson-1.pptx
Music-4-Lesson-1.pptx
 
Elements of music
Elements of musicElements of music
Elements of music
 
Mapeh what is music and its objectives
Mapeh what is music and its objectivesMapeh what is music and its objectives
Mapeh what is music and its objectives
 
Classical period
Classical periodClassical period
Classical period
 
Lifestyle and weight management pe 9
Lifestyle and weight management pe 9 Lifestyle and weight management pe 9
Lifestyle and weight management pe 9
 
HEALTH 9 Quarter 3 Module 3 Substance Use and Abuse.pptx
HEALTH 9 Quarter 3 Module 3 Substance Use and Abuse.pptxHEALTH 9 Quarter 3 Module 3 Substance Use and Abuse.pptx
HEALTH 9 Quarter 3 Module 3 Substance Use and Abuse.pptx
 

Semelhante a Evaluation

Creating Assessments
Creating AssessmentsCreating Assessments
Creating AssessmentsChristina Sax
 
National university assessment process
National university assessment processNational university assessment process
National university assessment processAshley Kovacs
 
Learning Outcomes Discussion
Learning Outcomes DiscussionLearning Outcomes Discussion
Learning Outcomes DiscussionLuke Dowden
 
Chapter 10 Designing and Conducting Formative Evaluations
Chapter 10 Designing and Conducting Formative EvaluationsChapter 10 Designing and Conducting Formative Evaluations
Chapter 10 Designing and Conducting Formative Evaluationscdjhaigler
 
Training &n Development Studies & Evaluation
Training &n Development Studies & EvaluationTraining &n Development Studies & Evaluation
Training &n Development Studies & EvaluationElsaCherian1
 
Chapter 4: Evaluating the curriculum
Chapter 4: Evaluating the curriculumChapter 4: Evaluating the curriculum
Chapter 4: Evaluating the curriculumRizza Lynn Labastida
 
Assessment as learning
Assessment as learningAssessment as learning
Assessment as learningAnup Singh
 
Krickpatrick basic level of evaluation
Krickpatrick basic level of evaluationKrickpatrick basic level of evaluation
Krickpatrick basic level of evaluationSajan Ks
 
9. Evaluation of Training Effectiveness
9. Evaluation of Training Effectiveness9. Evaluation of Training Effectiveness
9. Evaluation of Training EffectivenessISEAL Alliance
 
9:Evaluation of Training Effectiveness
9:Evaluation of Training Effectiveness9:Evaluation of Training Effectiveness
9:Evaluation of Training EffectivenessRichardBrennan
 
evaluation of program.pptx
evaluation of program.pptxevaluation of program.pptx
evaluation of program.pptxMahwishBukhari3
 
Assessment: Achieving improved efficiency, effectiveness, educational integri...
Assessment:Achieving improved efficiency, effectiveness, educational integri...Assessment:Achieving improved efficiency, effectiveness, educational integri...
Assessment: Achieving improved efficiency, effectiveness, educational integri...Diana Quinn
 
FINAL PRESENTATION on OBE using TDD.pptx
FINAL PRESENTATION on OBE using TDD.pptxFINAL PRESENTATION on OBE using TDD.pptx
FINAL PRESENTATION on OBE using TDD.pptxgznfrch1
 
Curriculum (formative & summative) evaluation
Curriculum (formative & summative) evaluationCurriculum (formative & summative) evaluation
Curriculum (formative & summative) evaluationDrGavisiddappa Angadi
 
Appendix 4 Quality Of Assessment Practices Presentation
Appendix 4    Quality Of Assessment Practices PresentationAppendix 4    Quality Of Assessment Practices Presentation
Appendix 4 Quality Of Assessment Practices PresentationKathleen Zarubin
 
Developing Assessment Instruments
Developing Assessment InstrumentsDeveloping Assessment Instruments
Developing Assessment InstrumentsAngel Jones
 
Continuous asessment / Testing guidelines summary
Continuous asessment / Testing guidelines summaryContinuous asessment / Testing guidelines summary
Continuous asessment / Testing guidelines summaryManolo05
 

Semelhante a Evaluation (20)

Creating Assessments
Creating AssessmentsCreating Assessments
Creating Assessments
 
National university assessment process
National university assessment processNational university assessment process
National university assessment process
 
Learning Outcomes Discussion
Learning Outcomes DiscussionLearning Outcomes Discussion
Learning Outcomes Discussion
 
Chapter 10 Designing and Conducting Formative Evaluations
Chapter 10 Designing and Conducting Formative EvaluationsChapter 10 Designing and Conducting Formative Evaluations
Chapter 10 Designing and Conducting Formative Evaluations
 
Assessment 2
Assessment 2Assessment 2
Assessment 2
 
Training &n Development Studies & Evaluation
Training &n Development Studies & EvaluationTraining &n Development Studies & Evaluation
Training &n Development Studies & Evaluation
 
Chapter 4: Evaluating the curriculum
Chapter 4: Evaluating the curriculumChapter 4: Evaluating the curriculum
Chapter 4: Evaluating the curriculum
 
Assessment as learning
Assessment as learningAssessment as learning
Assessment as learning
 
Krickpatrick basic level of evaluation
Krickpatrick basic level of evaluationKrickpatrick basic level of evaluation
Krickpatrick basic level of evaluation
 
9. Evaluation of Training Effectiveness
9. Evaluation of Training Effectiveness9. Evaluation of Training Effectiveness
9. Evaluation of Training Effectiveness
 
9:Evaluation of Training Effectiveness
9:Evaluation of Training Effectiveness9:Evaluation of Training Effectiveness
9:Evaluation of Training Effectiveness
 
evaluation of program.pptx
evaluation of program.pptxevaluation of program.pptx
evaluation of program.pptx
 
Assessment: Achieving improved efficiency, effectiveness, educational integri...
Assessment:Achieving improved efficiency, effectiveness, educational integri...Assessment:Achieving improved efficiency, effectiveness, educational integri...
Assessment: Achieving improved efficiency, effectiveness, educational integri...
 
Intro to rubrics
Intro to rubricsIntro to rubrics
Intro to rubrics
 
Intro to rubrics
Intro to rubricsIntro to rubrics
Intro to rubrics
 
FINAL PRESENTATION on OBE using TDD.pptx
FINAL PRESENTATION on OBE using TDD.pptxFINAL PRESENTATION on OBE using TDD.pptx
FINAL PRESENTATION on OBE using TDD.pptx
 
Curriculum (formative & summative) evaluation
Curriculum (formative & summative) evaluationCurriculum (formative & summative) evaluation
Curriculum (formative & summative) evaluation
 
Appendix 4 Quality Of Assessment Practices Presentation
Appendix 4    Quality Of Assessment Practices PresentationAppendix 4    Quality Of Assessment Practices Presentation
Appendix 4 Quality Of Assessment Practices Presentation
 
Developing Assessment Instruments
Developing Assessment InstrumentsDeveloping Assessment Instruments
Developing Assessment Instruments
 
Continuous asessment / Testing guidelines summary
Continuous asessment / Testing guidelines summaryContinuous asessment / Testing guidelines summary
Continuous asessment / Testing guidelines summary
 

Mais de Nelly Kamel

I nacol coursestandards_2011
I nacol coursestandards_2011I nacol coursestandards_2011
I nacol coursestandards_2011Nelly Kamel
 
How to embed a youtube video in a presentation
How to embed a youtube video in a presentationHow to embed a youtube video in a presentation
How to embed a youtube video in a presentationNelly Kamel
 
Analysis presentation
Analysis presentationAnalysis presentation
Analysis presentationNelly Kamel
 
E learning fundanemtals and standards
E learning fundanemtals and standardsE learning fundanemtals and standards
E learning fundanemtals and standardsNelly Kamel
 
Chunking and storyboarding
Chunking and storyboardingChunking and storyboarding
Chunking and storyboardingNelly Kamel
 
The_Lecture_Presentation
The_Lecture_PresentationThe_Lecture_Presentation
The_Lecture_PresentationNelly Kamel
 

Mais de Nelly Kamel (10)

I nacol coursestandards_2011
I nacol coursestandards_2011I nacol coursestandards_2011
I nacol coursestandards_2011
 
How to embed a youtube video in a presentation
How to embed a youtube video in a presentationHow to embed a youtube video in a presentation
How to embed a youtube video in a presentation
 
Analysis presentation
Analysis presentationAnalysis presentation
Analysis presentation
 
E learning fundanemtals and standards
E learning fundanemtals and standardsE learning fundanemtals and standards
E learning fundanemtals and standards
 
Implementaion
ImplementaionImplementaion
Implementaion
 
Development
DevelopmentDevelopment
Development
 
Chunking and storyboarding
Chunking and storyboardingChunking and storyboarding
Chunking and storyboarding
 
Implementaion
ImplementaionImplementaion
Implementaion
 
Design
DesignDesign
Design
 
The_Lecture_Presentation
The_Lecture_PresentationThe_Lecture_Presentation
The_Lecture_Presentation
 

Evaluation

  • 1. Instructional Design and Content Development Workshop
  • 2. Topics Define a program of evaluation Evaluation in learning Outline major reasons to conduct a program evaluation Why conduct an evaluation? General evaluation models. Who is Kirkpatrick? Kirkpatrick’s four level learning evaluation model Write questions for each level to assess and
  • 3. What is an evaluation? Evaluation is a systematic method for collecting, analyzing, and using information to answer basic questions about a program. Evaluation is valuable for strengthen the quality of the program and improve outcomes for the learners. Evaluation answers basic questions about a program’s effectiveness, and evaluation data can be used to improve program services.
  • 4. Evaluation In Learning - Evaluation means assessing the effectiveness and possible improvement of a course. - Evaluation is part of any instructional design model. - Evaluation provides review checkpoints for each phase of ADDIE that allow the instructor to evaluate - Without completing this produced. the work that has been portion of ADDIE model, the e-course is incomplete because the course cannot be redesigned and improved without
  • 5. MAJOR REASONS TO CONDUCT AN EVALUATION Evaluation finds out “what works” and “what does not work.” Evaluation showcases the effectiveness of a program to the community. Evaluation improves staff’s practice with participants. Evaluation increases transfer of learning to behavior/performance in order to maximize program results. Evaluation increases a program’s capacity to conduct a critical self assessment and plan for the future. Evaluation builds knowledge for the out-of-campus time field.
  • 6. Why conduct an evaluation? The ADDIE model stresses the concept that good training programs require planning, review, and revision. The evaluation phase focuses on gabs to mend them. Increase transfer of learning in order to maximize learning / e-content results. The evaluation phase measures the course's
  • 7. Benefits of Evaluation Effectiveness: It shows the progress made toward program goals and objectives. Best Practices: It provides the ability to determine what program approaches are most effective. Improvement: It provides ongoing assessment of program design and implementation to identify areas of improvement. Impact: It demonstrates economic or human impact. Accountability: It provides the base for interpreting an organization or programs’ worth to its stakeholders. Promotion & Advocacy: It informs policymakers about programs successes. Appraisal & Coordination: It gives managers the performance information to make better operational decisions.
  • 8. General Evaluation Models There are a lot of models clarifying the evaluation process and determining the information needs of the intended audiences of the evaluation, these models such as: Tyler’s early conception of assessing attainment of program objectives. Decision-Making Evaluation Approaches. Naturalistic Evaluation Approaches Kirkpatrick’s Four Levels for evaluating program effectiveness; which suggests the most appropriate evaluation methodology to be used.
  • 9. Who is Kirkpatrick? Donald Kirkpartick is Professor of the University of Wisconsin in the USA and a past president of the American Society for Training and Development. He has developed a very popular evaluation model that has been used by the training/learning community. He focused on measuring four kinds of
  • 10. Kirkpatrick’s four levels of evaluating learning Kirkpatrick’s model includes four levels or steps of outcome evaluation:
  • 11. Level one - Evaluate Learner Reaction Level One: Evaluate Learner Reaction How well did the learners like the learning process? The goal is find out the reaction of the learners to the instructor, course and learning environment. The purpose is not to measure what the learners has learned, but whether the delivery method was effective and appreciated. This type of evaluation can be incorporated at the end of the instruction and can be delivered online.
  • 12. Level one - Evaluate Learner Reaction General questions can include the following: • Did the instructor attend the sessions on time? • Did the instructor respond to learners’ comments and questions? • Did the instructor deliver the information clearly and smoothly? • Were there distraction? • Did the learners feel comfortable in the surroundings? E-content questions can include the following: • Level of appeal of the instruction. • The ease of navigation and use of tools. • The ability of the course to motivate and retain interest. • The amount of interactive exercises. • The relevance of the objectives. • Quality and relevance of multimedia. • The ease of navigation and use of tools.
  • 13. Level two - Evaluate Learning Level two: Evaluate Learning What did learners learn? (the extent to which they gain knowledge, skills and attitude) The goal is measuring learning results. In other words: did the learners learn what intended to be taught?
  • 14. Level two - Evaluate Learning Measurement methods of level two include: Formal and informal testing. Self assessments at the beginning (pre-test) and end (post-test) for learners. http://www.reap.ac.uk/reap/public/papers//DN_SHE_Final.pdf Interviews, observation and feedback. Product Assessment. Creation of a project as an authentic assessment to showcase the knowledge and talents. This form of assessment evaluates whether the learner can apply the learned skills or concepts in a concrete fashion.
  • 15. Level three - Evaluate Performance Level three: Evaluate Performance What changes in performance resulted from the learning process? To what degree participants apply what they learned during training when they are back on the job. The goal is measuring “what happens when learners leave the classroom and return to their daily lives/job. Did the learners put their learning into effect when back on the job/live? Would the learners be able to transfer their learning to another person? How much transfer of learning occurs? It is the most obvious sign to evaluate the training program’s effectiveness.
  • 16. Level three - Evaluate Performance Measurement methods of level two include: Allow time for a change in behavior to take place Testing Observation, interview and survey. The learner interactions on the job. Evaluate both before and after the program if that is practical
  • 17. Level four - Evaluate Results Level four: Evaluate Results What are the tangible results of the learning process in terms improved quality, increased production, efficiency, etc.? To what degree targeted outcomes occur as a result of learning event(s) and subsequent reinforcement The goal is to find out if the training program led to final results, especially business or environment results Level four outcomes include the major results that contribute to the well functioning of an organization. Level four outcomes Improve quality of work, increase productivity and profits. Across an entire organization it becomes more challenging and affect organizational and business performance, which cloud the true cause of good or poor results.
  • 18. Level four - Evaluate Results Measurement methods of level four include: Methods of Measuring Learning Outcomes Grid How colleges and universities can measure and report on the knowledge and abilities their students have acquired during their college years is an issue of growing interest. http://web.mit.edu/tll/assessment-evaluation/methods-of-measuring-learning-outcomes- grid.doc http://www.elcamino.edu/academics/slo/docs/SLOFocusOnResults.doc Course-embedded assessment/Assurance of Learning Standards. http://www2.cortland.edu/dotAsset/f2e9f1ee-0100-40ab-b78d-48ead9c047d3.pdf
  • 20. Checklist for effective questions Do Do Not Give clear instructions Use complex phrases Keep questions structure simple Frame questions in the negative Ask one question at a time Use abbreviations, contractions or symbols Maintain a parallel structure for all questions Mix different words for the same concept Define terms before asking the question Use “loaded” words or phrases Be explicit about the period of time being referenced by the Combine multiple response dimensions in the same question question Provide a list of acceptable responses to closed questions Give the impression that you are expecting a certain response Ensure that response categories are both exhaustive and mutually Bounce around between topics or time periods exclusive Label response categories with words rather than numbers Insert unnecessary graphics or mix many font styles and sizes Ask for number of occurrences, rather than providing response Forget to provide instructions for returning the completed survey Save personal and demographic questions for the end of the survey
  • 21. Activity Based on your study of Kirkpatrick's model of learning / training programs evaluation, apply this model to evaluate your course using the 4 levels of Kirkpatrick's model. o Write questions that explores the items within each level
  • 22. ONLINE DETAILED COURSE MANUAL http://www.kirkpatrickpartners.com/Portals/0/Training- Events/Program%20Prework/Kirkpatrick%20Four%20Levels(t m)%20Evaluation%20Online%20Certificate%20Manual.pdf

Notas do Editor

  1. Evaluation finds out “what works” and “what does not work.” A process or outcome evaluation enables to answer basic questions about a program’s effectiveness, including: Are participants benefiting from program services? Do instructors have the necessary skills and training to deliver services? Are participants satisfied with the program? Are some sub-groups benefiting, but not others?Knowing “what works” helps to focus resources on the essential components of the program that benefit participants.Knowing “what does not work” allows to improve and strengthen the service delivery models. Not knowing what is working may waste valuable time and resources.