SlideShare uma empresa Scribd logo
1 de 33
Tips For Effective Rubric Design


How to:
   Design  a rubric that does its job
   Write precise criteria and descriptors
   Make your rubric student-friendly
Expert Input

 Experts agree:
  – Rubrics are hard to design.
  – Rubrics are time-consuming to design.
  – “A rubric is only as useful as it is good. Using a bad
    rubric is a waste of time…”
             --Michael Simkins in “Designing Great Rubrics”
  Experts disagree:
  – How to design a “good” rubric
  – Bottom line: Is it working for you and for your
    students?
The Cookie

Task: Make a chocolate chip cookie that I would want
  to eat.
Criteria: Texture, Taste, Number of Chocolate Chips,
  Richness
Range of performance:
   –   Delicious(14-16 pts)
   –   Tasty(11-13 pts)
   –   Edible(8-10 pts)
   –   Not yet edible(0-7 pts)
Analytic Homemade Cookie Rubric

            Delicious       Tasty         Edible        Not yet
            4               3             2             edible
                                                        1
 # chips    Chips in        75% chips     50% chips     Less than
            every bite                                  50% chips

 texture    Consistently    Chewy         Crunchy       Like a dog
            chewy           middle,                     biscuit
                            crispy
                            edges
 color      Even golden     Brown with    All brown     Burned
            brown           pale center   Or all pale
 richness   Buttery, high   Medium fat    Low-fat       Nonfat
            fat                           flavor        flavor
Assess The Cookie

   Overall score
    –   Delicious
    –   Tasty
    –   Edible
    –   Not yet edible
   By criteria
    –   Number of chips
    –   Texture
    –   Taste
    –   Richness
Holistic Rubric

   Views product or performance as a whole; describes
    characteristics of the product or performance
    according criteria expressing “what counts””:
   Each holistic criterion is expressed in a summary
    statement for each score level.
   Levels of performance range from highest (Level 4)
    to lowest (Level 0)
   See example in your text, p. 133
Sample: Holistic Cookie Rubric

Cookie Scored at the “Delicious” level (4)
     Chips in every bite
     Consistently chewy
     Even golden brown
     Buttery, high fat
You must then make a summary statement for
  levels 3, 2, & 1.
Pros & Cons: Holistic Rubric

+       Takes less time to create.
+       Effectively determines a “not fully developed”
    performance as a whole.
+       Efficient for large group scoring; less time to
    assess.
-       Not diagnostic.
-       Student may exhibit traits at two or more levels
        at the same time.
Analytic Rubric

Separate facets of performance are defined, independently
  valued, and scored. See example in text, p. 135.
Example: In music performance, skill might be string
  improvisation.
Each facet of “string improvisation” would be scored separately:
           melody
           harmonics
           rhythm
           bowing & backup
           confidence
Pros & Cons: Analytic Rubric

+       Sharper focus on target
+       Specific feedback (matrix)
+       Instructional emphasis
-       Time consuming to articulate
    components and to find language clear
    enough to       define performance levels
    effectively
Tip #1

Don’t make task-specific rubrics.
     Less efficient
     Make one that can be used for two or more
      products or performances.
     “Generalizable” or template rubric
Tip #2

Don’t use published generic or “canned” rubrics
without careful consideration of their quality
and appropriateness for your project.
      These are your students, not someone
       else’s.
     Your   students have received your
       instruction.
Tip #3

 Avoid   dysfunctional detail.
  –   “…in most instances, lengthy rubrics probably
      can be reduced to succinct…more useful versions
      for classroom instruction. Such abbreviated
      rubrics can still capture the key evaluative criteria
      needed to judge students’ responses. Lengthy
      rubrics, in contrast, will gather dust”
  –   Dysfunctional detail also includes jargon,
      negativity
Tip #4

Limit the number of criteria
   But, don’t combine independent criteria.

   E.g. One criterion that includes “Very clear” and
   “very organized” will often be problematic.
   The product may be clear but not organized or vice
   versa.
Tips #5 and #6

Don’t define levels of quality in vague terms,
e.g.
       ABSTRACT:“poorly organized”
       CONCRETE:
         –   Organization:
                sharply focused thesis,

                topic sentences clearly connected to thesis,

                logical ordering of paragraphs,

                conclusion ends with clincher

       ABSTRACT:    “inventive” “creative” “imaginative”
       CONCRETE: ?? Key Question to ask yourself: What
        does that look like?
Tips #5 and #6
Use measurable criteria.
   – Specify what quality or absence looks like vs.
     comparatives (“not as thorough as”) or value
     language (“excellent content”)
   –   Highlight the impact of the performance: Was the
       paper persuasive or problem solved? (Note
       importance of a statement of purpose for the
       assignment here!)
   –   List the traits of effective persuasion.
   –   Be sure that the descriptor is not the criterion and
       vice versa
Tip #7

Aim for an even number of
performance/product levels
  –   Create continuum between least and most
  –   Define poles and work inward
  –   List skills and traits consistently across levels
Tip #8

 May include students in creating or adapting
 rubrics by listing criteria for “What Counts.”
 Consider  using “I” in the descriptors in the
 criterion statement:
     I   followed APA documentation format:
          –   precisely—consistently—inconsistently—
     I   did not follow MLA documentation format.
Tip #9

   Motivate students to use your rubric as they prepare
    their product or performance:
           “At their very best, rubrics are also
    teaching tools that support student            learning
    . . . ” (13 y.o. student).
   Do students understand the criteria and descriptors?
    How do you know?
   When do you give the rubric to your students?
Tip #10

Provide models of products/performances that
represent different performance levels.
The Assignment Sheet

   Connect the rubric you prepared to the assignment
    guidelines: Use same language in each!
   Project/paper/presentation must meet all requirements of
    assignment
    –   Due date and late penalty
    –   Format requirements
    –   Non-negotiables
Use the Rubric for Draft Reviews or the
“Check-in” Stage of Preparation

Use your rubric as a formative assessment to
give students feedback about how they are
doing.
  –   Isolate a particularly challenging aspect
  –   Have student isolate an area of difficulty
  –   Center revision instruction around rubric
Steps in Developing & Using Rubrics

   Design backwards—rubric first; then product/performance.
   Decide on the criteria for the product or performance to be
    assessed.
   Write a definition or make a list of concrete descriptors for each
    criterion.
   Develop a continuum for describing the range of performance
    for each criterion.
   Keep track of strengths and weaknesses of rubric as you use it
    to assess student work.
   Step back; ask yourself, “What didn’t I make clear
    instructionally?” The weakness may not be the rubric.
Steps in Modifying a “Canned”
Rubric

 Find  a rubric that most closely matches your
  performance task.
 Evaluate and adjust to reflect your
  instruction, language, expectations, content,
  students
  –   Criteria
  –   Descriptors
  –   Performance levels
When to Use Rubrics

Usually with a relatively complex assignment,
such as a long-term project, and essay, or
research-based product.
  –   Informative feedback about work in progress
  –   Detailed evaluations of final projects
The Mini-Rubric

   These are the quick ones.
   Fewer criteria and shorter descriptions of quality
    –   Yes/no checklists
    –   Describe proficient level of quality and leave other boxes for
        commentary during grading.
    –   Use for small products or processes:
          Poster
          Outline
          Journal entry
          Class activity
Sample Mini-rubric for an Assignment
called a “Vocabulary Poster”

Content criterion (50%) 4         3      2       1
____ written explanation of denotation is accurate & thorough
____ examples in action are accurate & of sufficient variety
____ visual symbol or cartoon conveys accurate and clear word
        meaning
____ wordplay is accurate and thorough: weighs synonyms for
        subtleties of meaning;
Presentation criterion (50%)
   4,3,2,1--neat
   4,3,2,1--clear organizational pattern
   4,3,2,1--no error in Conventions
   4,3,2,1--uses visual space to catch and hold attention
Score = Content__+Presentation___divided by 2=______GRADE
Caution

 Don’t let the rubric stand alone!

 ALWAYS, ALWAYS provide specific
   “Comments” on your rubric and/or on the
   student product itself.
Useful Criteria Across The
Curriculum: Content

 Descriptors or indicators R/T content:
   –   Relevant
   –   Specific
   –   Thorough
   –   Synthesized
   –   Balanced
   –   Convincing
   –   Accurate
Useful Criteria Across the
Curriculum: Research

Descriptors or indicators R/T research:
  –   Uses variety of sources (primary, secondary,
      electronic, traditional, human)
        Note:
             Watch minimums—Is minimum “minimal” or is
        minimum “proficient”?
  –   Uses appropriate sources (credible, timely,
      scholarly)
  –   Documents sources accurately
Useful Criteria Across the
Curriculum: Format

Descriptors or indicators R/T format:
Logical
Sequential
According to assignment guidelines
According to standards (e.g. APA Style)
The Best Rubrics

  Analytic and holistic
  Developmental
  “Generalizable” and specific
  Instructional



 The best rubrics WORK
                  for students and teachers!
Acknowledgments

This Slidecast was adapted from “Tips for
  Effective Rubric Design”
daretodifferentiate.wikispaces.com/file/view/rub
  rics.ppt

I am grateful to the unnamed author who also
   acknowledged the assistance of Joyce, Myra,
   Veronica, & Jeff.

Mais conteúdo relacionado

Mais procurados

Portfolio Assessment Basics
Portfolio Assessment BasicsPortfolio Assessment Basics
Portfolio Assessment BasicsRoberta Niche
 
Portfolio Assessment
Portfolio AssessmentPortfolio Assessment
Portfolio AssessmentSel Yan
 
Designing Rubrics for Competency-based Education
Designing Rubrics for Competency-based EducationDesigning Rubrics for Competency-based Education
Designing Rubrics for Competency-based EducationKyle Peck
 
Performance Assessment
Performance AssessmentPerformance Assessment
Performance AssessmentMarsha Ratzel
 
K to 12 classroom assessment ppt
K to 12 classroom assessment pptK to 12 classroom assessment ppt
K to 12 classroom assessment pptCarlo Magno
 
Scoring Rubrics and Rating Scale
Scoring Rubrics and Rating ScaleScoring Rubrics and Rating Scale
Scoring Rubrics and Rating ScaleDr. Amjad Ali Arain
 
PURPOSES OF PORTFOLIO ASSESSMENT
PURPOSES OF PORTFOLIO ASSESSMENTPURPOSES OF PORTFOLIO ASSESSMENT
PURPOSES OF PORTFOLIO ASSESSMENTErwin Ted
 
ITEM ANALYSIS.pptx
ITEM ANALYSIS.pptxITEM ANALYSIS.pptx
ITEM ANALYSIS.pptxRizaGarganza
 
Preformance based assessment
Preformance based assessmentPreformance based assessment
Preformance based assessmentfader2017
 
Why and What Type of Assessment?
Why and What Type of Assessment?Why and What Type of Assessment?
Why and What Type of Assessment?Pashew Majeed
 

Mais procurados (20)

Rubrics
RubricsRubrics
Rubrics
 
Rubric
RubricRubric
Rubric
 
Fatima rubrics2 (1)
Fatima rubrics2 (1)Fatima rubrics2 (1)
Fatima rubrics2 (1)
 
Rubrics.pptx
Rubrics.pptxRubrics.pptx
Rubrics.pptx
 
Rubric with Rubistar
Rubric with RubistarRubric with Rubistar
Rubric with Rubistar
 
Portfolio Assessment Basics
Portfolio Assessment BasicsPortfolio Assessment Basics
Portfolio Assessment Basics
 
Test Construction
Test ConstructionTest Construction
Test Construction
 
Portfolio Assessment
Portfolio AssessmentPortfolio Assessment
Portfolio Assessment
 
Designing Rubrics for Competency-based Education
Designing Rubrics for Competency-based EducationDesigning Rubrics for Competency-based Education
Designing Rubrics for Competency-based Education
 
Rubrics
RubricsRubrics
Rubrics
 
Performance Assessment
Performance AssessmentPerformance Assessment
Performance Assessment
 
Authentic Assessment
Authentic AssessmentAuthentic Assessment
Authentic Assessment
 
K to 12 classroom assessment ppt
K to 12 classroom assessment pptK to 12 classroom assessment ppt
K to 12 classroom assessment ppt
 
Scoring Rubrics and Rating Scale
Scoring Rubrics and Rating ScaleScoring Rubrics and Rating Scale
Scoring Rubrics and Rating Scale
 
Types of Portfolio
Types of PortfolioTypes of Portfolio
Types of Portfolio
 
Rubrics ppt
Rubrics pptRubrics ppt
Rubrics ppt
 
PURPOSES OF PORTFOLIO ASSESSMENT
PURPOSES OF PORTFOLIO ASSESSMENTPURPOSES OF PORTFOLIO ASSESSMENT
PURPOSES OF PORTFOLIO ASSESSMENT
 
ITEM ANALYSIS.pptx
ITEM ANALYSIS.pptxITEM ANALYSIS.pptx
ITEM ANALYSIS.pptx
 
Preformance based assessment
Preformance based assessmentPreformance based assessment
Preformance based assessment
 
Why and What Type of Assessment?
Why and What Type of Assessment?Why and What Type of Assessment?
Why and What Type of Assessment?
 

Destaque

Process oriented performance-based assessment
Process oriented performance-based assessmentProcess oriented performance-based assessment
Process oriented performance-based assessmentrenarch
 
Automating performance based tests
Automating performance based testsAutomating performance based tests
Automating performance based testsfrancelvcg1161997
 
Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)Jeziel Dela Cruz
 
Creating Rubrics with AMS Chandler & Fabry
Creating Rubrics with AMS Chandler & FabryCreating Rubrics with AMS Chandler & Fabry
Creating Rubrics with AMS Chandler & FabryCynthia Sistek-Chandler
 
Assessment & Planning
Assessment & Planning Assessment & Planning
Assessment & Planning Matt Scully
 
Introduction to Rubrics
Introduction to RubricsIntroduction to Rubrics
Introduction to RubricsiBATEFL.COM
 
Reinforcing effort & providing recognition
Reinforcing effort & providing recognitionReinforcing effort & providing recognition
Reinforcing effort & providing recognitionMonica Mendez
 
Effective Instructional Strategies
Effective Instructional StrategiesEffective Instructional Strategies
Effective Instructional StrategiesAya Shalaby
 
Test Process Improvement
Test Process ImprovementTest Process Improvement
Test Process ImprovementMomentum NI
 
Sample rubrics for_physical_education_0
Sample rubrics for_physical_education_0Sample rubrics for_physical_education_0
Sample rubrics for_physical_education_0John Paul Peñaranda
 
Creating Descriptive Rubrics for Educational Assessment
Creating Descriptive Rubrics for Educational AssessmentCreating Descriptive Rubrics for Educational Assessment
Creating Descriptive Rubrics for Educational Assessmentuwaln
 

Destaque (20)

Process oriented performance-based assessment
Process oriented performance-based assessmentProcess oriented performance-based assessment
Process oriented performance-based assessment
 
Rubric PPP
Rubric PPPRubric PPP
Rubric PPP
 
Automating performance based tests
Automating performance based testsAutomating performance based tests
Automating performance based tests
 
RUBRICS - ALL GRADES
RUBRICS - ALL GRADESRUBRICS - ALL GRADES
RUBRICS - ALL GRADES
 
Rubrics presentation
Rubrics presentationRubrics presentation
Rubrics presentation
 
Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)Rubrics (Analytic and Holistic)
Rubrics (Analytic and Holistic)
 
Creating Rubrics with AMS Chandler & Fabry
Creating Rubrics with AMS Chandler & FabryCreating Rubrics with AMS Chandler & Fabry
Creating Rubrics with AMS Chandler & Fabry
 
Assessment & Planning
Assessment & Planning Assessment & Planning
Assessment & Planning
 
Recognition&Rewards
Recognition&RewardsRecognition&Rewards
Recognition&Rewards
 
Introduction to Rubrics
Introduction to RubricsIntroduction to Rubrics
Introduction to Rubrics
 
Reinforcing effort & providing recognition
Reinforcing effort & providing recognitionReinforcing effort & providing recognition
Reinforcing effort & providing recognition
 
Effective Instructional Strategies
Effective Instructional StrategiesEffective Instructional Strategies
Effective Instructional Strategies
 
Test Process Improvement
Test Process ImprovementTest Process Improvement
Test Process Improvement
 
Rubrics sample
Rubrics sampleRubrics sample
Rubrics sample
 
Sample rubrics for_physical_education_0
Sample rubrics for_physical_education_0Sample rubrics for_physical_education_0
Sample rubrics for_physical_education_0
 
Rna synthesis and processing
Rna synthesis  and processing Rna synthesis  and processing
Rna synthesis and processing
 
Creating Descriptive Rubrics for Educational Assessment
Creating Descriptive Rubrics for Educational AssessmentCreating Descriptive Rubrics for Educational Assessment
Creating Descriptive Rubrics for Educational Assessment
 
Rubric On Oral Presentation
Rubric On  Oral  PresentationRubric On  Oral  Presentation
Rubric On Oral Presentation
 
Transcription
TranscriptionTranscription
Transcription
 
Product oriented
Product orientedProduct oriented
Product oriented
 

Semelhante a Creating rubrics

Paratesol Workshop on Rubrics
Paratesol Workshop on RubricsParatesol Workshop on Rubrics
Paratesol Workshop on RubricsMirtha Insfran
 
Building your assessments to meet course objectives -detc
Building your assessments to meet course objectives -detcBuilding your assessments to meet course objectives -detc
Building your assessments to meet course objectives -detcostromae
 
Performance based assessment
Performance based assessmentPerformance based assessment
Performance based assessmentJen_castle
 
Performance based assessment
Performance based assessmentPerformance based assessment
Performance based assessmentJen_castle
 
Chap.4 PROCESS-ORIENTED PERFORMANCE-BASED ASSESSMENT
Chap.4 PROCESS-ORIENTED PERFORMANCE-BASED ASSESSMENTChap.4 PROCESS-ORIENTED PERFORMANCE-BASED ASSESSMENT
Chap.4 PROCESS-ORIENTED PERFORMANCE-BASED ASSESSMENTmayu chan
 
Rubrics Overview
Rubrics OverviewRubrics Overview
Rubrics OverviewPeter Gow
 
Assessment principles
Assessment principlesAssessment principles
Assessment principlesCarlo Magno
 
Process orientedperformance-basedassessment
Process orientedperformance-basedassessmentProcess orientedperformance-basedassessment
Process orientedperformance-basedassessmentjabello glaiza
 
Performance assessment by rubric method
Performance assessment by rubric methodPerformance assessment by rubric method
Performance assessment by rubric methodAbigail Sapico
 
Rubrics: Transparent Assessment in Support of Learning
Rubrics: Transparent Assessment in Support of LearningRubrics: Transparent Assessment in Support of Learning
Rubrics: Transparent Assessment in Support of LearningKenneth Ronkowitz
 
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...Mark Eutsler
 
Scoring Rubric - Michael.pptx
Scoring Rubric - Michael.pptxScoring Rubric - Michael.pptx
Scoring Rubric - Michael.pptxJoanaPerales
 
Performance-based Assessment
Performance-based AssessmentPerformance-based Assessment
Performance-based AssessmentBeberly Fabayos
 
Page 1 of 8 School of Management — BUSM4551 CID
Page 1 of 8 School of Management — BUSM4551 CIDPage 1 of 8 School of Management — BUSM4551 CID
Page 1 of 8 School of Management — BUSM4551 CIDsimisterchristen
 
Comparitive Education Performance Based Assessments vs Traditional Assessment
Comparitive Education Performance Based Assessments vs Traditional AssessmentComparitive Education Performance Based Assessments vs Traditional Assessment
Comparitive Education Performance Based Assessments vs Traditional AssessmentRachael Mann
 

Semelhante a Creating rubrics (20)

Paratesol Workshop on Rubrics
Paratesol Workshop on RubricsParatesol Workshop on Rubrics
Paratesol Workshop on Rubrics
 
Rubrics final 1
Rubrics final 1Rubrics final 1
Rubrics final 1
 
Assessment1
Assessment1Assessment1
Assessment1
 
Building your assessments to meet course objectives -detc
Building your assessments to meet course objectives -detcBuilding your assessments to meet course objectives -detc
Building your assessments to meet course objectives -detc
 
Performance based assessment
Performance based assessmentPerformance based assessment
Performance based assessment
 
Performance based assessment
Performance based assessmentPerformance based assessment
Performance based assessment
 
Chap.4 PROCESS-ORIENTED PERFORMANCE-BASED ASSESSMENT
Chap.4 PROCESS-ORIENTED PERFORMANCE-BASED ASSESSMENTChap.4 PROCESS-ORIENTED PERFORMANCE-BASED ASSESSMENT
Chap.4 PROCESS-ORIENTED PERFORMANCE-BASED ASSESSMENT
 
Rubrics Overview
Rubrics OverviewRubrics Overview
Rubrics Overview
 
Rubric pp
Rubric ppRubric pp
Rubric pp
 
Assessment principles
Assessment principlesAssessment principles
Assessment principles
 
Process orientedperformance-basedassessment
Process orientedperformance-basedassessmentProcess orientedperformance-basedassessment
Process orientedperformance-basedassessment
 
Performance assessment by rubric method
Performance assessment by rubric methodPerformance assessment by rubric method
Performance assessment by rubric method
 
Rubrics: Transparent Assessment in Support of Learning
Rubrics: Transparent Assessment in Support of LearningRubrics: Transparent Assessment in Support of Learning
Rubrics: Transparent Assessment in Support of Learning
 
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
 
Bc week 9
Bc week 9Bc week 9
Bc week 9
 
Rubric
Rubric Rubric
Rubric
 
Scoring Rubric - Michael.pptx
Scoring Rubric - Michael.pptxScoring Rubric - Michael.pptx
Scoring Rubric - Michael.pptx
 
Performance-based Assessment
Performance-based AssessmentPerformance-based Assessment
Performance-based Assessment
 
Page 1 of 8 School of Management — BUSM4551 CID
Page 1 of 8 School of Management — BUSM4551 CIDPage 1 of 8 School of Management — BUSM4551 CID
Page 1 of 8 School of Management — BUSM4551 CID
 
Comparitive Education Performance Based Assessments vs Traditional Assessment
Comparitive Education Performance Based Assessments vs Traditional AssessmentComparitive Education Performance Based Assessments vs Traditional Assessment
Comparitive Education Performance Based Assessments vs Traditional Assessment
 

Último

BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...Sapna Thakur
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajanpragatimahajan3
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 

Último (20)

Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 

Creating rubrics

  • 1. Tips For Effective Rubric Design How to:  Design a rubric that does its job  Write precise criteria and descriptors  Make your rubric student-friendly
  • 2. Expert Input Experts agree: – Rubrics are hard to design. – Rubrics are time-consuming to design. – “A rubric is only as useful as it is good. Using a bad rubric is a waste of time…” --Michael Simkins in “Designing Great Rubrics” Experts disagree: – How to design a “good” rubric – Bottom line: Is it working for you and for your students?
  • 3. The Cookie Task: Make a chocolate chip cookie that I would want to eat. Criteria: Texture, Taste, Number of Chocolate Chips, Richness Range of performance: – Delicious(14-16 pts) – Tasty(11-13 pts) – Edible(8-10 pts) – Not yet edible(0-7 pts)
  • 4. Analytic Homemade Cookie Rubric Delicious Tasty Edible Not yet 4 3 2 edible 1 # chips Chips in 75% chips 50% chips Less than every bite 50% chips texture Consistently Chewy Crunchy Like a dog chewy middle, biscuit crispy edges color Even golden Brown with All brown Burned brown pale center Or all pale richness Buttery, high Medium fat Low-fat Nonfat fat flavor flavor
  • 5. Assess The Cookie  Overall score – Delicious – Tasty – Edible – Not yet edible  By criteria – Number of chips – Texture – Taste – Richness
  • 6. Holistic Rubric  Views product or performance as a whole; describes characteristics of the product or performance according criteria expressing “what counts””:  Each holistic criterion is expressed in a summary statement for each score level.  Levels of performance range from highest (Level 4) to lowest (Level 0)  See example in your text, p. 133
  • 7. Sample: Holistic Cookie Rubric Cookie Scored at the “Delicious” level (4)  Chips in every bite  Consistently chewy  Even golden brown  Buttery, high fat You must then make a summary statement for levels 3, 2, & 1.
  • 8. Pros & Cons: Holistic Rubric + Takes less time to create. + Effectively determines a “not fully developed” performance as a whole. + Efficient for large group scoring; less time to assess. - Not diagnostic. - Student may exhibit traits at two or more levels at the same time.
  • 9. Analytic Rubric Separate facets of performance are defined, independently valued, and scored. See example in text, p. 135. Example: In music performance, skill might be string improvisation. Each facet of “string improvisation” would be scored separately:  melody  harmonics  rhythm  bowing & backup  confidence
  • 10. Pros & Cons: Analytic Rubric + Sharper focus on target + Specific feedback (matrix) + Instructional emphasis - Time consuming to articulate components and to find language clear enough to define performance levels effectively
  • 11. Tip #1 Don’t make task-specific rubrics.  Less efficient  Make one that can be used for two or more products or performances.  “Generalizable” or template rubric
  • 12. Tip #2 Don’t use published generic or “canned” rubrics without careful consideration of their quality and appropriateness for your project. These are your students, not someone else’s. Your students have received your instruction.
  • 13. Tip #3  Avoid dysfunctional detail. – “…in most instances, lengthy rubrics probably can be reduced to succinct…more useful versions for classroom instruction. Such abbreviated rubrics can still capture the key evaluative criteria needed to judge students’ responses. Lengthy rubrics, in contrast, will gather dust” – Dysfunctional detail also includes jargon, negativity
  • 14. Tip #4 Limit the number of criteria But, don’t combine independent criteria. E.g. One criterion that includes “Very clear” and “very organized” will often be problematic. The product may be clear but not organized or vice versa.
  • 15. Tips #5 and #6 Don’t define levels of quality in vague terms, e.g.  ABSTRACT:“poorly organized”  CONCRETE: – Organization:  sharply focused thesis,  topic sentences clearly connected to thesis,  logical ordering of paragraphs,  conclusion ends with clincher  ABSTRACT: “inventive” “creative” “imaginative”  CONCRETE: ?? Key Question to ask yourself: What does that look like?
  • 16. Tips #5 and #6 Use measurable criteria. – Specify what quality or absence looks like vs. comparatives (“not as thorough as”) or value language (“excellent content”) – Highlight the impact of the performance: Was the paper persuasive or problem solved? (Note importance of a statement of purpose for the assignment here!) – List the traits of effective persuasion. – Be sure that the descriptor is not the criterion and vice versa
  • 17. Tip #7 Aim for an even number of performance/product levels – Create continuum between least and most – Define poles and work inward – List skills and traits consistently across levels
  • 18. Tip #8  May include students in creating or adapting rubrics by listing criteria for “What Counts.”  Consider using “I” in the descriptors in the criterion statement: I followed APA documentation format: – precisely—consistently—inconsistently— I did not follow MLA documentation format.
  • 19. Tip #9  Motivate students to use your rubric as they prepare their product or performance: “At their very best, rubrics are also teaching tools that support student learning . . . ” (13 y.o. student).  Do students understand the criteria and descriptors? How do you know?  When do you give the rubric to your students?
  • 20. Tip #10 Provide models of products/performances that represent different performance levels.
  • 21. The Assignment Sheet  Connect the rubric you prepared to the assignment guidelines: Use same language in each!  Project/paper/presentation must meet all requirements of assignment – Due date and late penalty – Format requirements – Non-negotiables
  • 22. Use the Rubric for Draft Reviews or the “Check-in” Stage of Preparation Use your rubric as a formative assessment to give students feedback about how they are doing. – Isolate a particularly challenging aspect – Have student isolate an area of difficulty – Center revision instruction around rubric
  • 23. Steps in Developing & Using Rubrics  Design backwards—rubric first; then product/performance.  Decide on the criteria for the product or performance to be assessed.  Write a definition or make a list of concrete descriptors for each criterion.  Develop a continuum for describing the range of performance for each criterion.  Keep track of strengths and weaknesses of rubric as you use it to assess student work.  Step back; ask yourself, “What didn’t I make clear instructionally?” The weakness may not be the rubric.
  • 24. Steps in Modifying a “Canned” Rubric  Find a rubric that most closely matches your performance task.  Evaluate and adjust to reflect your instruction, language, expectations, content, students – Criteria – Descriptors – Performance levels
  • 25. When to Use Rubrics Usually with a relatively complex assignment, such as a long-term project, and essay, or research-based product. – Informative feedback about work in progress – Detailed evaluations of final projects
  • 26. The Mini-Rubric  These are the quick ones.  Fewer criteria and shorter descriptions of quality – Yes/no checklists – Describe proficient level of quality and leave other boxes for commentary during grading. – Use for small products or processes:  Poster  Outline  Journal entry  Class activity
  • 27. Sample Mini-rubric for an Assignment called a “Vocabulary Poster” Content criterion (50%) 4 3 2 1 ____ written explanation of denotation is accurate & thorough ____ examples in action are accurate & of sufficient variety ____ visual symbol or cartoon conveys accurate and clear word meaning ____ wordplay is accurate and thorough: weighs synonyms for subtleties of meaning; Presentation criterion (50%) 4,3,2,1--neat 4,3,2,1--clear organizational pattern 4,3,2,1--no error in Conventions 4,3,2,1--uses visual space to catch and hold attention Score = Content__+Presentation___divided by 2=______GRADE
  • 28. Caution Don’t let the rubric stand alone! ALWAYS, ALWAYS provide specific “Comments” on your rubric and/or on the student product itself.
  • 29. Useful Criteria Across The Curriculum: Content Descriptors or indicators R/T content: – Relevant – Specific – Thorough – Synthesized – Balanced – Convincing – Accurate
  • 30. Useful Criteria Across the Curriculum: Research Descriptors or indicators R/T research: – Uses variety of sources (primary, secondary, electronic, traditional, human)  Note: Watch minimums—Is minimum “minimal” or is minimum “proficient”? – Uses appropriate sources (credible, timely, scholarly) – Documents sources accurately
  • 31. Useful Criteria Across the Curriculum: Format Descriptors or indicators R/T format: Logical Sequential According to assignment guidelines According to standards (e.g. APA Style)
  • 32. The Best Rubrics  Analytic and holistic  Developmental  “Generalizable” and specific  Instructional The best rubrics WORK for students and teachers!
  • 33. Acknowledgments This Slidecast was adapted from “Tips for Effective Rubric Design” daretodifferentiate.wikispaces.com/file/view/rub rics.ppt I am grateful to the unnamed author who also acknowledged the assistance of Joyce, Myra, Veronica, & Jeff.

Notas do Editor

  1. Checklists do not reflect developmental—indicates only presence or lack of a trait
  2. An overall judgment. Generally speaking, not recommended for classroom use because of diagnostic limitations. If our goal is to give students feedback on performance, the more specific, the better.
  3. Analytic and holistic can be combined—sum of analytical scores =integration or holistic score. Or add scores and take average for holistic representation
  4. If you’re going to invest the effort necessary to make a good rubric, be sure that you can use it in a range of situations. Make a template for kind of product or performance. Adjust accordingly. Departmental, grade level, cross-curricular input Consistency of expectation, language; track students across performances
  5. This is the other extreme of too many task-specific rubrics. A project rubric should not be used to assess everything from a digital montage to a PowerPoint presentation on market economics. Yet, there are excellent resources available for you to adapt. Evaluate the resources available on the Web—don’t just use one because it is “free” and don’t think because it’s in a textbook that it is good! Find the middle ground—a template that you can adjust and tweak according to the specifications of a given task.
  6. This includes educational jargon! Avoid sole adjective descriptors such as “inadequate” and avoid adjectives of “averageness”—below, above. The lowest score should describe what a novice, not “bad” performance looks like. Wordiness—often happens when groups devise—includes a little something for everyone
  7. What’s important?
  8. Not so much an issue of diction as describing the concrete behaviors and evidence of critical thinking Creativity= uses ideas from others (Developing), modifies ideas implemented by others (Basic), composition is self-generated (Proficient), composition is unique and imaginative(Advanced)--Myra
  9. Actual traits that constitute good or poor persuasion, problem-solving. Be careful not to bury criteria—here is where some people find that their rubrics do not match their expectations—be sure that the descriptor is not a criterion and vice versa
  10. 4 or 6 recommended Even recommended for delineating proficiency---Unless you want an equivocal position. Even number requires a decision between almost there and “barebones.” No implied levels.
  11. You may also want students to self-assess and even use highlighters to document their claims.
  12. In their hands at beginning. Use as revision tool. Give a quiz (Veronika!) Add self-assess column and defense piece or use as revision activity—highlight where it is
  13. .
  14. See “cookie”
  15. Eliminate criteria that do not reflect your assignment.
  16. Content criteria repeats phrasing on assignment sheet. Comments allows teacher to “justify” any score not a “4.”
  17. The content is the meat of the project—what are the requirements for successful content for a lab report in science, a pen and ink portrait, a character sketch, a PowerPoint presentation, a math problem? Brainstorm other adjectives that specifically describe what you expect of ANY content. Now use these as a bank from which to draw and insert them in your template.