Presented by: Dan Thompson, Sr. Manager of Education and Assessment, ExamSoft Worldwide At the conclusion of each exam, a wealth of student assessment data is immediately available to faculty. The short term value of this data is evident - evaluate individual question performance. However, that’s only the beginning. Assessment data provides opportunities for in-depth analysis on course, curricular, and instructional method performance. Furthermore, specific performance data can be distributed to students to drive their self-assessment and focused study plans. This presentation addresses the process of using assessment data to make tangible changes to improve instructional and student outcomes.

1. 1
Psychometrics 201:
Putting assessment data
into action
Dan Thompson, M.Ed.
Sr. Manager of Education and Assessment
ExamSoft
#AssessChat
@DanThompsonIDTS
@ExamSoft

2. 2
Before we begin…
• Let’s be social! Tell us about yourself
• Include: name, role (faculty/staff/administration), institution, favorite dessert
• Assessment Real Talk
#AssessChat
@DanThompsonIDTS
@ExamSoft

3. 3
Session Objectives
• At the conclusion of this presentation, participants will be able
to:
1. Provide meaningful feedback to students for self-assessment
2. Evaluate effectiveness of teaching methods
3. Apply use of exam data for student remediation
#AssessChat
@DanThompsonIDTS
@ExamSoft

4. 4
101 Refresher
• P-value (Diff)
• Percent correct
• Point bi-serial
• Indicates whether getting the question correct correlates positively or negatively with
performing well on the exam as a whole.
• Discrimination Index
• Top 27% - Lower 27%
• Category Stats
• Proactively tag your items
#AssessChat
@DanThompsonIDTS
@ExamSoft

5. 5
Student Feedback
• Make it meaningful!
• Timely
• Quality
• Tag items to licensure exam content areas
• Share exam data results with students!
• Strength and Opportunity Reports (S&O)
• Help students self-assess and make the most of their study time
• Students take ownership of their performance
#AssessChat
@DanThompsonIDTS
@ExamSoft

6. 6
Instructional Methods
• Why do we teach?
• It all starts with improving student outcomes
• “What’s next”
• Tag your items by teaching methods
• Ex. Flipped classroom, lecture, team-based learning, self-paced modules
• Identify which teaching method leads to the best student outcomes
• Evaluate use of:
• Formative assessments
• Educational technology
#AssessChat
@DanThompsonIDTS
@ExamSoft

7. 7
#AssessChat
@DanThompsonIDTS
@ExamSoft

8. 8
Student Remediation
• Take a data driven approach!
• Create student specific remediation plans with faculty and/or their academic advisor
#AssessChat
@DanThompsonIDTS
@ExamSoft

9. 9
Exam Construction
• Be aware of your exam make-up
• Create your exams with a purpose
• Select items for exams by:
• Category
• Previous performance
• Exam blueprinting
#AssessChat
@DanThompsonIDTS
@ExamSoft

10. 10
Recommended Order of Operations
1. Write your questions with your learning objectives in mind
2. Tag your items to the appropriate categories
3. Create your exam – be mindful of the exam blueprint
4. Deliver the exam!
5. Review exam stats to make adjustments
6. Review category reports and distribute S&O reports to students
7. Address areas in which students struggled
8. Create targeted remediation plans for individual students when needed
9. Use exam data to evaluate your course, teaching methods, use of ed tech, etc. after the
semester.
#AssessChat
@DanThompsonIDTS
@ExamSoft

11. 11
Take Homes
Use psychometrics to improve student outcomes by:
1. Providing meaningful feedback to students
2. Improving classroom instruction
3. Creating targeted student remediation
4. Construct exams that are fair and appropriately challenging for your students
#AssessChat
@DanThompsonIDTS
@ExamSoft

12. 12
Thank you!!
• Questions?
• Comments?
• Dthompson@examsoft.com
• @DanThompsonIDTS

13. 13
P H O N E
+ 1 . 9 5 4 . 4 2 9 . 8 8 8 9
E M A I L
i n f o @ e x a m s o f t . c o m
W E B S I T E
l e a r n . e x a m s o f t . c o m
THANK YOU!
Questions?