Harnessing the Power of Categories: Using Categories for Building Assessments
•Transferir como PPTX, PDF•
1 gostou•457 visualizações
Presented by Donna K Czarnecki, Lead CBT, Data, and Core Coordinator, University of Nebraska Medical Center, College of Medicine “Tagging” exam items can work to your advantage when building multi-contributor assessments — by including faculty and other stakeholders in this process, the category feature in ExamSoft can be used to foster faculty collaboration in building assessments while maintaining database integrity. This presentation will also include discussion around the historical records gained by using this process.
Recomendados
Mais conteúdo relacionado
Destaque
Mais de ExamSoft
Mais de ExamSoft (20)
Último
Último (20)
Harnessing the Power of Categories: Using Categories for Building Assessments
- 1. HARNESSING THE POWER OF CATEGORIES: USING CATEGORIES FOR BUILDINGASSESSMENTS Donna K. Czarnecki, BS Lead Computer-Based Testing, Data and Core Coordinator University of Nebraska Medical Center, College of Medicine
- 2. Questions by Folder • Database where all of your questions are stored • Arranged by course, content, and/or assessments
- 3. Questions by Category • Access under Questions area, right next to Questions by Folder OR
- 4. Questions by Category • Access under the Categories area
- 5. Questions by Category • Subset of questions from Questions by Folder area • Questions are tagged with categories to group them together. • Think of these groups of questions as being “sorted” out of the Questions by Folder database. Questions by Folder Topic Faculty Name Course Academic Year
- 6. Questions by Category • Questions assigned to a category are not a separate set of questions. • A question can only be in one folder but many different categories. • Do NOT delete questions from category bins, or you will delete them from the database permanently! • Instead, remove the category assignment from a question to remove it from that category bin.
- 7. For Assessment Building To Students To Faculty & Program Work with Focused Set of Items
- 8. Reasons to Categorize – Manage your Items • Allows you and your faculty to work with smaller sets of specific questions. • No need to duplicate questions in another question folder. (andyourfaculty)
- 9. Construction Zone – Assessment FolderAlternative • Categories are set up to tag and edit questions to be used for an exam. • Organization is similar to Questions by Folder, with each assessment listed under each course.
- 10. Construction Zone – Assessment Folder Alternative 16-17 Construction Zone Category 2016 Anatomy Exam 2 Category 2016 Anatomy Exam 1 Category 2017 Cellular Processes Exam 1 Category 2017 Neurosciences Exam 1 Category Questions by Folder
- 11. Construction Zone – Exam Building Benefits • Allows multiple faculty members to directly select which questions they want included in a particular exam. • Faculty do not need access to the assessments area using this method • They tag the questions they want included in a particular exam to the Construction Zone (CZ) category for that assessment. • This can be done in a bulk add or individually in the edit mode, just like adding any other category. • Make sure to include all levels of the category path: for example 16-17 Construction Zone, M1 Exams, 01-Anatomy Exam 1
- 12. Construction Zone – Exam ReviewAdvantages • Allows the course director to view and edit only those questions intended to be included in the exam. • Real-time tally of number of questions included on exam • Ability to ensure the correct number of questions are included to cover course content
- 13. Construction Zone – Exam Review Advantages • Easy to locate new or edited questions • Questions in the Question by Folder area are all put in Approved status after initially being added and updated in ExamSoft. • Edited or new questions in the Construction Zone (CZ) will appear in Draft status. • This decreases final review time for the course director and our office when finalizing exam questions. • Only questions in Draft status need to be reviewed again.
- 14. Construction Zone – Assessment Creation Rewards • Most importantly – Ease & Accuracy of Creating Assessment • Once questions are finalized by the course director, all questions are selected to be Approved. • All Approved questions in the CZ folder are selected and added to Assessment after final approval by our office. • Faculty members and course directors do not actually post assessments.
- 15. Construction Zone – Assessment Creation Rewards
- 16. Construction Zone – Exam Archiving Returns • Archiving Past Academic Year Construction Zones allows the exam questions to remain grouped together. 1. Allows faculty to look back at what was used in an exam without needing access to the Assessment area 2. Easy to make historical notes and comments for future question use. 3. Can be used to populate the next year’s exam if the questions are not changed much from year to year.
- 17. Construction Zone – Tips for Exam Archiving • Rename past Construction Zones so they will not be confused with current academic year • Add the letter “z” in front of the name to move it to the bottom of your category list
- 18. Questions??? My contact info: Donna K. Czarnecki, B.S. Lead Computer-Based Testing, Data and Core Coordinator Office of Medical Education, College of Medicine University of Nebraska Medical Center 402.559.4043 I dczarnec@unmc.edu
Notas do Editor
- As most of you already know, the Questions by Folder area is the database portion of ExamSoft where all of your questions are stored. Questions are entered here manually or by import. General area for editing, duplicating or deleting. At UNMC we currently arrange our questions by course. Some schools may refer to them as blocks. This can also be an area to create your Assessment Questions Folders
- Expand/select category to view sub-categories in that category
- Select blue number to the right of category title to access list of category questions. This is also the area where you can manually create, edit and delete categories
- Questions by category are basically a subset or group of questions from the Folder area. Each institution’s categories are based on their specific needs. Here at UNMC we have the illustrated categories plus many more. Some of these categories will be discussed during my next webinar on 10/18 (yes, this is a shameless plug). Think of it as a way to filter or sort out certain questions you want to see or work with.
- There are many benefits to using categories. Today I will focus on their usefulness in building assessments.
- As I mentioned before, categorizing your questions allows you to work with a smaller set of questions and/or data.
- First example As mentioned previously, most schools create Assessment Folders in the Questions by Folder area, along with their course folders At UNMC we use the Questions by Category area to create our assessments. We call it the Construction Zone The Construction Zone is organized basically like the courses listed in the Questions by Folders area.
- Ideally, you should have more items in the Questions by Folder area than what is needed for an individual exam. This is the basic premise for having a quote “item bank” or pool of questions to choose from each year. This diagram shows how the Construction Zone system works here at UNMC. All of our exam questions are in the Folders area, grouped by course. The Construction Zone (CZ) category is set up for each academic year. Questions are tagged for use in exams by Exam Name categories, also by academic year.
- Multiple faculty members can contribute to one examination. This method limits faculty access to other areas of ExamSoft. Doesn’t require a lot of training for the faculty
- The highlighted exam here contains 61 questions. To access the list of questions for this exam, you just click on the exam name.
- At UNMC, after adding/importing new questions, updates are done soon after. This can include adding categories, internal comments and/or images. Questions are then put into Approved status, by our office, to show that they are ready for selection to be added to an assessment. Final exam approval can be done by only needing to view those questions in Draft status, cutting down on review time.
- With a few simple mouse clicks your assessment will be created with no room for error on what should be included. Faculty aren’t trained on posting assessments ~ only select few are familiar with process, cuts down on posting errors (availability, time limit, settings, etc.)
- Renaming the CZ prevents current year questions from accidentally being placed in the wrong exam building category Moving the old CZs to the bottom of the category list also prevents accidental accessing of old exams. You need to be specifically looking for that material to locate it.