1. Module 8:
Assessment and Evaluation
Overview of Assessment and Evaluation
1Course Title:Designing and Delivering Successful Training Programs
2. • Measure whether or not the learning
objectives are being met.
2
Assessment and Evaluation
3. • Gathers information in order to make decisions
about improvements in teaching and learning.
3
Assessment
4. • Gathers information in order to make judgments
aboutlearners’ performance.
• Compares a learner’s performance
▫ with other learners
▫ with a set of standards
to determine a grade or a decision regarding
overall success.
4
Evaluation
5. • Ongoing
• Purpose: to improve instruction and learning
Example:
▫ Asking students to submit
an outline for a term paper
5
Formative Assessment or Evaluation
6. • Final
• Purpose: to measure quality of learning
Example:
▫ Assigning a final grade
to a term paper
6
Summative Assessment or Evaluation
7. • Quizzes/Tests
• Pre and post-tests
• Homework Assignments
• Classroom activities/products
• Case Studies
• Papers/Essays
• Portfolios
• Projects
• Surveys/Interviews
• Discussion Forums/Boards
7
Assessment/Evaluation Methods
8. Obtaining feedback from learners is also
important.
Areas to be evaluated could include:
1. Practicality of Content
2. Instructor’s Presentation Style
3. Level of Participant Interaction and
Activity
4. Training Materials and Resources
5. Training Environment
6. Meeting the Expectations of Participants
8
Assessing Teaching
10. 10
Kirkpatrick's Training Evaluation Model
RESULTS
BEHAVIOR
LEARNING
REACTION
LEVEL 4:To what degree the targeted
outcome occurs, as a result of the learning
event(s) and subsequent reinforcement.
LEVEL 3:To what degree participants apply
what they learned during the training when
they are back on the job.
LEVEL 2:To what degree participants
acquire the indented knowledge, skills
and attitudes based on their participation
in the learning event.
LEVEL 1: To what degree
participants react favorably to
the learning event.
13. • Is the assessment for formative or
summative purposes?
• What knowledge and/or skills do you want to
emphasize?
• What are the evaluation objectives?
• What are the instructional objectives and
the method of delivery?
13
Tips and Issues to consider when Developing
Assessment or Evaluation
14. • How large is the class and what is the best
way to assess all learners effectively?
• Is the assessment reusable?
• Can you provide meaningful feedback?
• Can you administer tests frequently in order
to keep learners on task?
14
Tips and Issues to consider when Developing
Assessment or Evaluation
15. • Use Rubrics
▫ to assist learners in successfully completing
the assessment tasks
▫ to assist the instructor to successfully assess
learning
15
Tips and Issues to consider when Developing
Assessment or Evaluation
Assessment and evaluation measure whether or not learning objectives are being met.ImageSource: http://images.google.com/images?hl=en&client=firefox-a&rls=org.mozilla%3Aen-US%3Aofficial&hs=Z73&um=1&sa=1&q=learning+objectives&btnG=Search+Images&aq=f&oq=
Assessment gathers information (through the collection and analysis of data) in order to make decisions about improvements in teaching and learning.Image Source: http://carmodyconsulting.net/db4/00314/carmodyconsulting.net/_uimages/survey.jpg
Evaluation gathers information (through the collection and analysis of data) in order to make judgments about students’ performance. It compares a learner’s performance with other learners or with a set of standards in order to determine a grade or a decision regarding overall success with respect to an assignment or a course.
Formative Assessment or Evaluation: Ongoing, with the purpose of improving instruction and learning. Asking students to submit an outline for a term paper is an example of a formative assessment.Image Source: http://www.taft.cc.ca.us/newtc/Academic/INCO48/images/outline2.gif
Summative Assessment or Evaluation: Final, with the purpose of measuring quality of learning. Assigning a final grade to a term paper is an example of summative assessment.Image Source: http://www.wales.nhs.uk/sites3/documents/582/grade A.jpg
Assessing Teaching is also an important component, as it helps to obtain feedback from learners. Areas to be evaluated could include: 1. Practicality of Content 2. Instructor’s Presentation Style 3. Level of Participant Interaction and Activity 4. Training Materials and Resources 5. Training Environment 6. Meeting the Expectations of Participants
Let’s take a look at a popular and most used model for evaluating training: Kirkpatrick’s Four Levels of Evaluation. These are Results, Behavior, Learning and Reaction.Source: http://coe.sdsu.edu/eet/articles/k4levels/index.htm
The four levels of Kirkpatrick’s evaluation model essentially measure:Level 1: Reaction: what the participant thought and felt about the trainingLevel 2: Learning: the resulting increase in knowledge or capabilityLevel 3: Behavior: the extent of behavior and capability in improvement and implementation/applicationLevel 4: Results: the effects on the business or environment resulting from the participant's performanceSource: http://kirkpatrickpartners.com/AboutUs/OurPhilosophy/tabid/63/Default.aspx
This diagram shows how Kirkpatrick’s 4 levels relate to the learning process. ImageSource: http://kirkpatrickpartners.com/AboutUs/OurPhilosophy/tabid/63/Default.aspx