SlideShare uma empresa Scribd logo
1 de 19
Fevatools: A Toolkit to jump-start formative assessment of student learning and course design Jim Julius SDSU Course Design Institute May 26, 2010
Guiding Questions What does it mean to bring an inquiry mindset to course design? How should one decide what kind of feedback to seek? What tools are available to collect feedback? What do I do with the data?
Summative
Formative
What (and why) are you measuring? Outcomes: tell you what you got, not how or why Inputs Processes  Seeking continuous improvement
Also formative
What (and why) are you measuring?
Outcomes
Inputs, Processes
Refining type and quality of learning materials & activities Optimized Hybrid or Fully  Online Classes ConventionalFace-to-FaceClasses Cycle 1 Cycle 2 Cycle 3 Cycle 4
Narrowing Your Inquiry + Selecting Useful Tools http://fevatools.wikispaces.com
Data from M. Laumakis pICT fellow in 2005 Began teaching parallel 500-student sections of PSYCH 101 in 2006, one traditional and one hybrid First fully online PSYCH 101, Summer 2008 Grade data, attendance data, IDEA survey, clicker survey, observational protocols all part of data gathering
SALG How much did the following aspects of the class help your learning? Rated from 1 (no help) to 5 (great help)
Summer 2008 Fully Online: SALG Data
SALG Data over time & format
Community of Inquiry Survey Statements rated from 1 (strongly disagree) to 5 (strongly agree) Based on the Community of Inquiry framework’s three elements: Social Presence Cognitive Presence Teaching Presence
Community of Inquiry Survey
What would you like to further explore?
Image sources http://www.flickr.com/photos/brockzilla/271302584/ http://www.flickr.com/photos/littledebbie11/3195586863/ http://www.flickr.com/photos/aaronjacobs/2346932630/ http://www.flickr.com/photos/shareski/3044437847/

Mais conteúdo relacionado

Mais procurados

Integrating FB & SBC_ Hooks_10.13.11
Integrating FB & SBC_ Hooks_10.13.11Integrating FB & SBC_ Hooks_10.13.11
Integrating FB & SBC_ Hooks_10.13.11
CORE Group
 
Collaboration feud
Collaboration feudCollaboration feud
Collaboration feud
jenmeltzer
 
From Reporting to Insight to Action
From Reporting to Insight to ActionFrom Reporting to Insight to Action
From Reporting to Insight to Action
Ellen Wagner
 
Co Inst Eval Presentation 09
Co Inst Eval Presentation 09Co Inst Eval Presentation 09
Co Inst Eval Presentation 09
June Gothberg
 
Using Data for Informed Decision Making
Using Data for Informed Decision MakingUsing Data for Informed Decision Making
Using Data for Informed Decision Making
INGovConf
 

Mais procurados (19)

Teaching Presence
Teaching PresenceTeaching Presence
Teaching Presence
 
Program Logic Models
Program Logic ModelsProgram Logic Models
Program Logic Models
 
Evaluation for Impact and Learning Asia Value Advisors Nov 6 2014
Evaluation for Impact and Learning Asia Value Advisors Nov 6 2014Evaluation for Impact and Learning Asia Value Advisors Nov 6 2014
Evaluation for Impact and Learning Asia Value Advisors Nov 6 2014
 
Integrating FB & SBC_ Hooks_10.13.11
Integrating FB & SBC_ Hooks_10.13.11Integrating FB & SBC_ Hooks_10.13.11
Integrating FB & SBC_ Hooks_10.13.11
 
Program logic models: design and use
Program logic models: design and useProgram logic models: design and use
Program logic models: design and use
 
Evaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation ApproachesEvaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation Approaches
 
Research In Action #2
Research In Action #2Research In Action #2
Research In Action #2
 
Introduction to Logic Models
Introduction to Logic ModelsIntroduction to Logic Models
Introduction to Logic Models
 
Beyond Formal: Using Social Media to Develop Personal Learning Environments (...
Beyond Formal: Using Social Media to Develop Personal Learning Environments (...Beyond Formal: Using Social Media to Develop Personal Learning Environments (...
Beyond Formal: Using Social Media to Develop Personal Learning Environments (...
 
Collaboration feud
Collaboration feudCollaboration feud
Collaboration feud
 
Tools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems ChangeTools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems Change
 
From Reporting to Insight to Action
From Reporting to Insight to ActionFrom Reporting to Insight to Action
From Reporting to Insight to Action
 
2. grantseeking creating a program logic model
2. grantseeking   creating a program logic model2. grantseeking   creating a program logic model
2. grantseeking creating a program logic model
 
Introduction to logic models
Introduction to logic modelsIntroduction to logic models
Introduction to logic models
 
Co Inst Eval Presentation 09
Co Inst Eval Presentation 09Co Inst Eval Presentation 09
Co Inst Eval Presentation 09
 
Using Data for Informed Decision Making
Using Data for Informed Decision MakingUsing Data for Informed Decision Making
Using Data for Informed Decision Making
 
Data informed decision-making
Data informed decision-makingData informed decision-making
Data informed decision-making
 
Ellen Wagner: Putting Data to Work
Ellen Wagner: Putting Data to WorkEllen Wagner: Putting Data to Work
Ellen Wagner: Putting Data to Work
 
BetterEvaluation: A framework for planning evaluations
BetterEvaluation: A framework for planning evaluationsBetterEvaluation: A framework for planning evaluations
BetterEvaluation: A framework for planning evaluations
 

Semelhante a Formative evaluation of student learning and course design made simple: Fevatools

Seeking Evidence of Impact: Answering "How Do We Know?"
Seeking Evidence of Impact: Answering "How Do We Know?"Seeking Evidence of Impact: Answering "How Do We Know?"
Seeking Evidence of Impact: Answering "How Do We Know?"
EDUCAUSE
 
Naf powerpoint july9-2010_v5
Naf powerpoint july9-2010_v5Naf powerpoint july9-2010_v5
Naf powerpoint july9-2010_v5
NAFCareerAcads
 
SIGPL Action Research Grant
SIGPL Action Research GrantSIGPL Action Research Grant
SIGPL Action Research Grant
miztech
 
Day 3 action research movie bridgewater
Day 3 action research movie bridgewaterDay 3 action research movie bridgewater
Day 3 action research movie bridgewater
vpriddle
 

Semelhante a Formative evaluation of student learning and course design made simple: Fevatools (20)

Research day 2011
Research day 2011Research day 2011
Research day 2011
 
Seeking Evidence of Impact: Answering "How Do We Know?"
Seeking Evidence of Impact: Answering "How Do We Know?"Seeking Evidence of Impact: Answering "How Do We Know?"
Seeking Evidence of Impact: Answering "How Do We Know?"
 
Using Analytics to Improve Student Success
Using Analytics to Improve Student SuccessUsing Analytics to Improve Student Success
Using Analytics to Improve Student Success
 
Conducting Research on Blended and Online Education: A Research Toolkit
Conducting Research on Blended and Online Education: A Research ToolkitConducting Research on Blended and Online Education: A Research Toolkit
Conducting Research on Blended and Online Education: A Research Toolkit
 
Naf powerpoint july9-2010_v5
Naf powerpoint july9-2010_v5Naf powerpoint july9-2010_v5
Naf powerpoint july9-2010_v5
 
Blended Learning Professional Development Action Research
Blended Learning Professional Development Action ResearchBlended Learning Professional Development Action Research
Blended Learning Professional Development Action Research
 
Information Literacy Assessment: From the Classroom to the Curriculum
Information Literacy Assessment: From the Classroom to the CurriculumInformation Literacy Assessment: From the Classroom to the Curriculum
Information Literacy Assessment: From the Classroom to the Curriculum
 
EMPOWER E-Assessment week: Teachers intentions and students perceptions of wr...
EMPOWER E-Assessment week: Teachers intentions and students perceptions of wr...EMPOWER E-Assessment week: Teachers intentions and students perceptions of wr...
EMPOWER E-Assessment week: Teachers intentions and students perceptions of wr...
 
Lieve Leroy how can grasshoppers change ict practices
Lieve Leroy how can grasshoppers change ict practicesLieve Leroy how can grasshoppers change ict practices
Lieve Leroy how can grasshoppers change ict practices
 
Data analysis 2011
Data analysis 2011Data analysis 2011
Data analysis 2011
 
Precon presentation 2015
Precon presentation 2015Precon presentation 2015
Precon presentation 2015
 
Learning Analytics
Learning AnalyticsLearning Analytics
Learning Analytics
 
FerrellWalker.pptx
FerrellWalker.pptxFerrellWalker.pptx
FerrellWalker.pptx
 
CCJ DL Training
CCJ DL TrainingCCJ DL Training
CCJ DL Training
 
SIGPL Action Research Grant
SIGPL Action Research GrantSIGPL Action Research Grant
SIGPL Action Research Grant
 
Online Course Assessment Part 1
Online Course Assessment  Part 1Online Course Assessment  Part 1
Online Course Assessment Part 1
 
MVUSD Aug 2011 Day 1
MVUSD Aug 2011 Day 1MVUSD Aug 2011 Day 1
MVUSD Aug 2011 Day 1
 
MVUSD Aug 2011 Day 1
MVUSD Aug 2011 Day 1MVUSD Aug 2011 Day 1
MVUSD Aug 2011 Day 1
 
Teacher action research
Teacher action researchTeacher action research
Teacher action research
 
Day 3 action research movie bridgewater
Day 3 action research movie bridgewaterDay 3 action research movie bridgewater
Day 3 action research movie bridgewater
 

Mais de Course Design Institute and pICT SDSU

Formative evaluation of student learning and course design made simple: Fevat...
Formative evaluation of student learning and course design made simple: Fevat...Formative evaluation of student learning and course design made simple: Fevat...
Formative evaluation of student learning and course design made simple: Fevat...
Course Design Institute and pICT SDSU
 

Mais de Course Design Institute and pICT SDSU (20)

Four Ways You Can Leverage the Internet
Four Ways You Can Leverage the InternetFour Ways You Can Leverage the Internet
Four Ways You Can Leverage the Internet
 
And What About Free and Low Cost Learning Resources
And What About Free and Low  Cost Learning ResourcesAnd What About Free and Low  Cost Learning Resources
And What About Free and Low Cost Learning Resources
 
Peer review in an economics writing course: the Pen is still mightier than th...
Peer review in an economics writing course: the Pen is still mightier than th...Peer review in an economics writing course: the Pen is still mightier than th...
Peer review in an economics writing course: the Pen is still mightier than th...
 
Community Collaboration
Community CollaborationCommunity Collaboration
Community Collaboration
 
Next Generation Response Systems at SDSU
Next Generation Response Systems at SDSUNext Generation Response Systems at SDSU
Next Generation Response Systems at SDSU
 
The iPad: Sign of the times, but which way does it point?
The iPad: Sign of the times, but which way does it point?The iPad: Sign of the times, but which way does it point?
The iPad: Sign of the times, but which way does it point?
 
Expanding Minds with Library Resources and Services
Expanding Minds with Library Resources and ServicesExpanding Minds with Library Resources and Services
Expanding Minds with Library Resources and Services
 
Reljic
ReljicReljic
Reljic
 
Formative evaluation of student learning and course design made simple: Fevat...
Formative evaluation of student learning and course design made simple: Fevat...Formative evaluation of student learning and course design made simple: Fevat...
Formative evaluation of student learning and course design made simple: Fevat...
 
Ocean320 Syllabus
 Ocean320 Syllabus Ocean320 Syllabus
Ocean320 Syllabus
 
Ocean320 Learning Guide
Ocean320 Learning GuideOcean320 Learning Guide
Ocean320 Learning Guide
 
Ocean320 Learning Guide
Ocean320 Learning GuideOcean320 Learning Guide
Ocean320 Learning Guide
 
Ocean320 summerschellenberg1
 Ocean320 summerschellenberg1 Ocean320 summerschellenberg1
Ocean320 summerschellenberg1
 
Oceans (320) of Opportunity: Rebooting a GE Explorations course,
Oceans (320) of Opportunity: Rebooting a GE Explorations course, Oceans (320) of Opportunity: Rebooting a GE Explorations course,
Oceans (320) of Opportunity: Rebooting a GE Explorations course,
 
Reljic on The Impact of Instructor Immediacy Behaviors in Online Learning Env...
Reljic on The Impact of Instructor Immediacy Behaviors in Online Learning Env...Reljic on The Impact of Instructor Immediacy Behaviors in Online Learning Env...
Reljic on The Impact of Instructor Immediacy Behaviors in Online Learning Env...
 
How i use Blackboard Discussion Boards
How i use Blackboard Discussion BoardsHow i use Blackboard Discussion Boards
How i use Blackboard Discussion Boards
 
Oh, The Places You Will Go!
Oh, The Places You Will Go! Oh, The Places You Will Go!
Oh, The Places You Will Go!
 
Providing Online Support for Student Writing
Providing Online Support for Student WritingProviding Online Support for Student Writing
Providing Online Support for Student Writing
 
An Experimental Study of Instructor Immediacy
An Experimental Study of Instructor Immediacy An Experimental Study of Instructor Immediacy
An Experimental Study of Instructor Immediacy
 
Dr. Mohammed's Religion 101 Syllabus
Dr. Mohammed's Religion 101 Syllabus Dr. Mohammed's Religion 101 Syllabus
Dr. Mohammed's Religion 101 Syllabus
 

Último

Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 

Último (20)

Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Asian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptxAsian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptx
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 

Formative evaluation of student learning and course design made simple: Fevatools

  • 1. Fevatools: A Toolkit to jump-start formative assessment of student learning and course design Jim Julius SDSU Course Design Institute May 26, 2010
  • 2. Guiding Questions What does it mean to bring an inquiry mindset to course design? How should one decide what kind of feedback to seek? What tools are available to collect feedback? What do I do with the data?
  • 5. What (and why) are you measuring? Outcomes: tell you what you got, not how or why Inputs Processes Seeking continuous improvement
  • 7. What (and why) are you measuring?
  • 10. Refining type and quality of learning materials & activities Optimized Hybrid or Fully Online Classes ConventionalFace-to-FaceClasses Cycle 1 Cycle 2 Cycle 3 Cycle 4
  • 11. Narrowing Your Inquiry + Selecting Useful Tools http://fevatools.wikispaces.com
  • 12. Data from M. Laumakis pICT fellow in 2005 Began teaching parallel 500-student sections of PSYCH 101 in 2006, one traditional and one hybrid First fully online PSYCH 101, Summer 2008 Grade data, attendance data, IDEA survey, clicker survey, observational protocols all part of data gathering
  • 13. SALG How much did the following aspects of the class help your learning? Rated from 1 (no help) to 5 (great help)
  • 14. Summer 2008 Fully Online: SALG Data
  • 15. SALG Data over time & format
  • 16. Community of Inquiry Survey Statements rated from 1 (strongly disagree) to 5 (strongly agree) Based on the Community of Inquiry framework’s three elements: Social Presence Cognitive Presence Teaching Presence
  • 18. What would you like to further explore?
  • 19. Image sources http://www.flickr.com/photos/brockzilla/271302584/ http://www.flickr.com/photos/littledebbie11/3195586863/ http://www.flickr.com/photos/aaronjacobs/2346932630/ http://www.flickr.com/photos/shareski/3044437847/

Notas do Editor

  1. Evaluating the cooking environment / experience: organization, tools, ingredients, recipe. How do you know if it’s “good enough”? How do you know what’s possible?
  2. Summative and formative assessment are often referred to in a learning context as assessment of learning and assessment for learning respectively. Assessment of learning is generally summative in nature and intended to measure learning outcomes and report those outcomes to students, parents, and administrators. Assessment of learning generally occurs at the conclusion of a class, course, semester, or academic year. Assessment for learning is generally formative in nature and is used by teachers to consider approaches to teaching and next steps for individual learners and the class. (from Wikipedia assessment article)In reality, formative evaluation of course design potentially could subsume just about all of both of the other circles. Everything is data. But our attention to this may be limited. We need to know what we want to know.
  3. Achievement: what students know and are able to do at end of course: distinguish "enduring understandings”, "important to know and do" and "worth being familiar with”Satisfaction Retention Success Achievement External proficiencies Real-world performance
  4. Learner characteristics (demographics, prior experience, learning styles/preferences)Design (consider carefully the elements of the design you really want to examine; be sure they are documented)Learning resources (support, intervention, materials of all sorts - and how/when they are used)ContextFaculty Development