SlideShare uma empresa Scribd logo
1 de 13
Baixar para ler offline
Using Feedback
Workshops in Qualitative
Evaluation
By: Brianne Labute
For: Qualitative Research Methods
EDRD 6000
University of Guelph
March 3rd, 2015
This work is licensed under
the Creative Commons
Attribution 4.0
International License. For
more information please
visit http://
creativecommons.org/
licenses/by-nc-nd/4.0/
What is a feedback workshop?
A feedback workshop is a meeting between
evaluator(s) and stakeholders to review and
discuss the evaluation findings
Source: Brianne Labute
Who is considered a stakeholder?
•  Key program/project staff
or volunteers,
administrators, or
beneficiaries
•  Could also be external
stakeholders – not directly
involved but have a
valuable contribution –
such as community
leaders or elected officials
Source: Ridder, D . , Mostert, E . , and Wolters, H . A. (eds.) (2005), Learning Together
To Manage Together; Improving Participation in Water Management (Osnabrueck:
University of Osnabrueck, USF) , p. 11.
When are feedback workshops used
in evaluation?
•  Can be used with any type of evaluation design – especially
useful in evaluations that use qualitative methods
•  Feedback workshops can be conducted throughout the
evaluation progress (often the case in a more participatory
evaluation design); or they can be done only in the final
stages
•  A report by the Kellogg’s Foundation suggests that “early
feedback and a consultative relationship with stakeholders
and project staff leads to a greater willingness by staff to
disclose important and sensitive information to
evaluators” (W.K. Kellogg Foundation, 2004)
Why use a feedback workshop?
•  To ensure the evaluator(s) properly interpreted the data and the
values of the stakeholders are properly represented in the findings
•  This is especially important when working with qualitative
data due to its rich, thick description
•  To increase the understanding of the evaluation process among
stakeholders and the value of the findings
•  To empower stakeholders through engagement
•  To improve the accuracy of the findings
•  To create discussion about how the findings can be disseminated to
influence change
A personal experience
Source: Brianne Labute
I was working in northern Ghana on a tourism development project. When
interviewing a group of women selling yams about their experience with tourists a
women approached us and started yelling. She said “ you people come here with
your notebooks and ask all these questions. Why! We never see changes, we need
water and better houses! We are suffering!” We were able to briefly explain that we
were not coming with any funding, rather, we were there to assist the existing
tourism association. The woman seemed only slightly less agitated. Luckily, we had
already planned a community workshop later in the week to share more about our
work. We invited her and were glad when she accepted. At the workshop there were
many questions and suggestions for us from the community members. Afterwards,
the community had a much better understanding of what we were trying to achieve
and our research was enriched by their feedback. A win-win situation!
•  Invite stakeholders. If there are many, it is suggested you involve a
manageable subset of stakeholder representatives
•  Although suggestions vary depending on the context , it is
generally suggested there be no more than 15 participants at a
workshop to allow for meaningful dialogue
•  Send a workshop agenda and the draft report to participants in
advance
•  Prepare materials to present the findings and guide discussion such as
a PowerPoint presentation or handouts
Tips on how to conduct a successful
feedback workshop: Preparation
Special Note: In some international contexts these steps may not be very logical.
Rather, you should consult your community contact and find out the best way to
spread the word about the workshop and planned activities. This could be an
announcement through the local mosque, sign board, etc.
Preparation Continued
•  Determine workshop roles. Who will chair, take notes,
greet participants, etc.
•  Ensure you have a meeting space conducive for good
dialogue
•  If logistically possible, gathering over food and drinks is a
great way to create a comfortable space for those attending
•  Meeting face-to-face is highly
recommended. If this is not
possible, other methods could be
used to collect feedback such as
online surveys or video conference
calls
Source: Brianne Labute
During the workshop
•  Brief stakeholders on the evaluation
work and the findings
•  Invite stakeholders to identify
problems of ambiguity and fact in the
findings
•  Clarify any misunderstandings
•  Invite participants to discuss the next steps (ie. how should
the results of the evaluation be used to make
improvements)
•  Discuss how future evaluations can be improved
After the workshop
•  Revise the evaluation report as needed
•  Send the revisions to stakeholders
•  Adjust plans for future evaluations (if applicable)
Source: Brianne Labute
TIP!
It is always beneficial
to reflect on how the
workshop could be
better conducted next
time. The workshop
team should keep a
notebook handy to
record any ideas.
What are some benefits to using
feedback workshops?
•  Involving stakeholders helps ensure a
transparent process
•  It produces more reliable and accurate findings
Increased ownership of the recommendations
among stakeholders
•  Action on recommendations is more likely to be
taken
•  Provides opportunity to build capacity among
participants
What are some challenges when
using feedback workshops?
•  Feedback processes can be time consuming
•  Feedback can be “based on facts, observation, and
past knowledge; or almost entirely subjective, based
on emotional reactions, defensiveness, loyalty (to
family, friends, or class), cultural gaps, or distrust of
outsiders” (University of Kansas, 2014b).
•  There is potential for conflict
–  Stakeholders may want interpret findings to their
benefit
References
Gullickson, R., Stufflebeam, D. (2001). Feedback Workshop Checklist. Retrieved from
http://www.wmich.edu/evalctr/archive_checklists/feedbackworkshop.pdf
Organization for Economic Co-operation and Development. (2001). Evaluation Feedback and Effective
Learning and Accountability. Retrieved from
file:///Users/briannelabute/Desktop/Feedback%20workshops/Evaluation%20Feedback%20for
%20Effective%20Learning%20and%20Accountability.pdf
The World Bank Institute. (2013). The Art of Knowledge Exchange: A Results Focused Planning Guide for
Development Practitioners. Retrieved from
http://wbi.worldbank.org/wbi/Data/wbi/wbicms/files/drupal-acquia/wbi/KEfull.pdf
University of Kansas, Work Group for Community Health and Development. (2014a). Community Toolbox:
Participatory Evaluation. Retrieved from
http://ctb.ku.edu/en/table-of-contents/evaluate/evaluation/participatory-evaluation/main
University of Kansas, Work Group for Community Health and Development. (2014b). Community Toolbox:
Obtaining and Using Feedback from Participants. Retrieved from
http://ctb.ku.edu/en/table-of-contents/maintain/maintain-quality-performance/feedback-from-
clients/main
W.K. Kellogg Foundation. (2004). Evaluation Handbook. Retrieved from
https://www.wkkf.org/resource-directory/resource/2010/w-k-kellogg-foundation-evaluation-
handbook

Mais conteúdo relacionado

Mais procurados

Co-creating with students and colleagues to introduce a one-stop-shop; synerg...
Co-creating with students and colleagues to introduce a one-stop-shop; synerg...Co-creating with students and colleagues to introduce a one-stop-shop; synerg...
Co-creating with students and colleagues to introduce a one-stop-shop; synerg...Association of University Administrators
 
Sarah Floyd, Vicky Davies, Fiona Smart, Rachael Carkett & Mark Dransfield
Sarah Floyd, Vicky Davies, Fiona Smart, Rachael Carkett & Mark DransfieldSarah Floyd, Vicky Davies, Fiona Smart, Rachael Carkett & Mark Dransfield
Sarah Floyd, Vicky Davies, Fiona Smart, Rachael Carkett & Mark DransfieldSEDA
 
Individual contact method in Extension Education
Individual contact method in Extension EducationIndividual contact method in Extension Education
Individual contact method in Extension EducationBalaraj BL
 
Bonner Director 2016 - Strategic Planning Presentation
Bonner Director 2016 - Strategic Planning PresentationBonner Director 2016 - Strategic Planning Presentation
Bonner Director 2016 - Strategic Planning PresentationBonner Foundation
 
Breaking the Mold: Identifying and Enhancing Students’ International Experien...
Breaking the Mold: Identifying and Enhancing Students’ International Experien...Breaking the Mold: Identifying and Enhancing Students’ International Experien...
Breaking the Mold: Identifying and Enhancing Students’ International Experien...CIEE
 
How to establish and maintain a Commnunity if Practice
How to establish and maintain a Commnunity if PracticeHow to establish and maintain a Commnunity if Practice
How to establish and maintain a Commnunity if PracticeMija RABEMANANJARA
 
YSJ CPD Framework, UKPSF and Mahara ePortfolios
YSJ CPD Framework, UKPSF and Mahara ePortfoliosYSJ CPD Framework, UKPSF and Mahara ePortfolios
YSJ CPD Framework, UKPSF and Mahara ePortfoliosPhil Vincent
 
Common extension teaching methods used by DAE
Common extension teaching methods used by DAECommon extension teaching methods used by DAE
Common extension teaching methods used by DAEsaifur rahman
 
Ichc decluttering tips and tools
Ichc   decluttering tips and toolsIchc   decluttering tips and tools
Ichc decluttering tips and toolsmhasf1947
 

Mais procurados (11)

Empowering nonprofits
Empowering nonprofitsEmpowering nonprofits
Empowering nonprofits
 
Co-creating with students and colleagues to introduce a one-stop-shop; synerg...
Co-creating with students and colleagues to introduce a one-stop-shop; synerg...Co-creating with students and colleagues to introduce a one-stop-shop; synerg...
Co-creating with students and colleagues to introduce a one-stop-shop; synerg...
 
Sarah Floyd, Vicky Davies, Fiona Smart, Rachael Carkett & Mark Dransfield
Sarah Floyd, Vicky Davies, Fiona Smart, Rachael Carkett & Mark DransfieldSarah Floyd, Vicky Davies, Fiona Smart, Rachael Carkett & Mark Dransfield
Sarah Floyd, Vicky Davies, Fiona Smart, Rachael Carkett & Mark Dransfield
 
Individual contact method in Extension Education
Individual contact method in Extension EducationIndividual contact method in Extension Education
Individual contact method in Extension Education
 
Peer-to-Peer Webinar Series: Success Stories in EIDM 2018 / Webinar #3
Peer-to-Peer Webinar Series: Success Stories in EIDM 2018 / Webinar #3Peer-to-Peer Webinar Series: Success Stories in EIDM 2018 / Webinar #3
Peer-to-Peer Webinar Series: Success Stories in EIDM 2018 / Webinar #3
 
Bonner Director 2016 - Strategic Planning Presentation
Bonner Director 2016 - Strategic Planning PresentationBonner Director 2016 - Strategic Planning Presentation
Bonner Director 2016 - Strategic Planning Presentation
 
Breaking the Mold: Identifying and Enhancing Students’ International Experien...
Breaking the Mold: Identifying and Enhancing Students’ International Experien...Breaking the Mold: Identifying and Enhancing Students’ International Experien...
Breaking the Mold: Identifying and Enhancing Students’ International Experien...
 
How to establish and maintain a Commnunity if Practice
How to establish and maintain a Commnunity if PracticeHow to establish and maintain a Commnunity if Practice
How to establish and maintain a Commnunity if Practice
 
YSJ CPD Framework, UKPSF and Mahara ePortfolios
YSJ CPD Framework, UKPSF and Mahara ePortfoliosYSJ CPD Framework, UKPSF and Mahara ePortfolios
YSJ CPD Framework, UKPSF and Mahara ePortfolios
 
Common extension teaching methods used by DAE
Common extension teaching methods used by DAECommon extension teaching methods used by DAE
Common extension teaching methods used by DAE
 
Ichc decluttering tips and tools
Ichc   decluttering tips and toolsIchc   decluttering tips and tools
Ichc decluttering tips and tools
 

Destaque

Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...SAGE Publishing
 
Engaging young people in qualitative evaluation
Engaging young people in qualitative evaluationEngaging young people in qualitative evaluation
Engaging young people in qualitative evaluationbhattars
 
Grading criteria and marking schemes liz norman anzcvs 2015
Grading criteria and marking schemes liz norman anzcvs 2015Grading criteria and marking schemes liz norman anzcvs 2015
Grading criteria and marking schemes liz norman anzcvs 2015Liz Norman
 
Research Methodology - Selecting an evaluation
Research Methodology - Selecting an evaluation Research Methodology - Selecting an evaluation
Research Methodology - Selecting an evaluation Md. Shafiuzzaman Hira
 
New trends in evaluation v kamat
New trends in evaluation v kamatNew trends in evaluation v kamat
New trends in evaluation v kamatVasudha Kamat
 
Evaluation of educational technology and its current application
Evaluation of educational technology and its current applicationEvaluation of educational technology and its current application
Evaluation of educational technology and its current applicationRhoda malazarte
 

Destaque (8)

Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
Top Ten Developments in Qualitative Education over the Last Decade with Dr. P...
 
Engaging young people in qualitative evaluation
Engaging young people in qualitative evaluationEngaging young people in qualitative evaluation
Engaging young people in qualitative evaluation
 
Grading criteria and marking schemes liz norman anzcvs 2015
Grading criteria and marking schemes liz norman anzcvs 2015Grading criteria and marking schemes liz norman anzcvs 2015
Grading criteria and marking schemes liz norman anzcvs 2015
 
Research Methodology - Selecting an evaluation
Research Methodology - Selecting an evaluation Research Methodology - Selecting an evaluation
Research Methodology - Selecting an evaluation
 
Selecting an evaluation qualitative, quantitative, and
Selecting an evaluation qualitative, quantitative, andSelecting an evaluation qualitative, quantitative, and
Selecting an evaluation qualitative, quantitative, and
 
New trends in evaluation v kamat
New trends in evaluation v kamatNew trends in evaluation v kamat
New trends in evaluation v kamat
 
Evaluation of educational technology and its current application
Evaluation of educational technology and its current applicationEvaluation of educational technology and its current application
Evaluation of educational technology and its current application
 
Application of spss usha (1)
Application of spss usha (1)Application of spss usha (1)
Application of spss usha (1)
 

Semelhante a Using Feedback Workshops in Qualitative Evaluation

Fundamental of Extension Methods: Tools and Techniques of PRA
Fundamental of Extension Methods:  Tools and Techniques of PRAFundamental of Extension Methods:  Tools and Techniques of PRA
Fundamental of Extension Methods: Tools and Techniques of PRABrajendra Singh Meena
 
Virtual Communities, Real Connections
Virtual Communities, Real ConnectionsVirtual Communities, Real Connections
Virtual Communities, Real ConnectionsLance A. Simon, CVEP
 
Outcomes and Assessment for Bonner and Campus Centers
Outcomes and Assessment for Bonner and Campus CentersOutcomes and Assessment for Bonner and Campus Centers
Outcomes and Assessment for Bonner and Campus CentersBonner Foundation
 
Daphne outcome measures final
Daphne outcome measures finalDaphne outcome measures final
Daphne outcome measures finalStephen Abram
 
MEAS Course on E-learning: 3 Effective online teaching strategies
MEAS Course on E-learning: 3 Effective online teaching strategiesMEAS Course on E-learning: 3 Effective online teaching strategies
MEAS Course on E-learning: 3 Effective online teaching strategiesAndrea Bohn
 
MEAS Course on E-Learning: 3 Effective online teaching strategies
MEAS Course on E-Learning: 3 Effective online teaching strategiesMEAS Course on E-Learning: 3 Effective online teaching strategies
MEAS Course on E-Learning: 3 Effective online teaching strategiesMEAS
 
AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...
AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...
AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...Barbara O'Neill
 
Dynamic Duo: Reference and Instruction Are Better Together
Dynamic Duo: Reference and Instruction Are Better TogetherDynamic Duo: Reference and Instruction Are Better Together
Dynamic Duo: Reference and Instruction Are Better TogetherMillstein Library
 
Making Culture: Community Engagement Framework for Digital Fabrication
Making Culture: Community Engagement Framework for Digital FabricationMaking Culture: Community Engagement Framework for Digital Fabrication
Making Culture: Community Engagement Framework for Digital FabricationJasmin Cheng
 
AFCPE 2015 Paper-Empowering Information Intermediaries-11-15
AFCPE 2015 Paper-Empowering Information Intermediaries-11-15AFCPE 2015 Paper-Empowering Information Intermediaries-11-15
AFCPE 2015 Paper-Empowering Information Intermediaries-11-15Barbara O'Neill
 
Progress in gender mainstreaming in LIVES
Progress in gender mainstreaming in LIVESProgress in gender mainstreaming in LIVES
Progress in gender mainstreaming in LIVESILRI
 

Semelhante a Using Feedback Workshops in Qualitative Evaluation (20)

Fundamental of Extension Methods: Tools and Techniques of PRA
Fundamental of Extension Methods:  Tools and Techniques of PRAFundamental of Extension Methods:  Tools and Techniques of PRA
Fundamental of Extension Methods: Tools and Techniques of PRA
 
Nvf slides 4 may 16 final
Nvf slides 4 may 16 finalNvf slides 4 may 16 final
Nvf slides 4 may 16 final
 
Funders eval meeting survey newsletter v3
Funders eval meeting survey newsletter v3Funders eval meeting survey newsletter v3
Funders eval meeting survey newsletter v3
 
Virtual Communities, Real Connections
Virtual Communities, Real ConnectionsVirtual Communities, Real Connections
Virtual Communities, Real Connections
 
Outcomes and Assessment for Bonner and Campus Centers
Outcomes and Assessment for Bonner and Campus CentersOutcomes and Assessment for Bonner and Campus Centers
Outcomes and Assessment for Bonner and Campus Centers
 
Daphne outcome measures final
Daphne outcome measures finalDaphne outcome measures final
Daphne outcome measures final
 
Focus Groups
Focus GroupsFocus Groups
Focus Groups
 
Measuring Volunteer Impact
Measuring Volunteer ImpactMeasuring Volunteer Impact
Measuring Volunteer Impact
 
MEAS Course on E-learning: 3 Effective online teaching strategies
MEAS Course on E-learning: 3 Effective online teaching strategiesMEAS Course on E-learning: 3 Effective online teaching strategies
MEAS Course on E-learning: 3 Effective online teaching strategies
 
MEAS Course on E-Learning: 3 Effective online teaching strategies
MEAS Course on E-Learning: 3 Effective online teaching strategiesMEAS Course on E-Learning: 3 Effective online teaching strategies
MEAS Course on E-Learning: 3 Effective online teaching strategies
 
AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...
AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...
AFCPE 2016 Symposium workshop-Measuring & Reporting Impact of Financial Educa...
 
Dynamic Duo: Reference and Instruction Are Better Together
Dynamic Duo: Reference and Instruction Are Better TogetherDynamic Duo: Reference and Instruction Are Better Together
Dynamic Duo: Reference and Instruction Are Better Together
 
Making Culture: Community Engagement Framework for Digital Fabrication
Making Culture: Community Engagement Framework for Digital FabricationMaking Culture: Community Engagement Framework for Digital Fabrication
Making Culture: Community Engagement Framework for Digital Fabrication
 
Character ppt 2014
Character ppt 2014Character ppt 2014
Character ppt 2014
 
AFCPE 2015 Paper-Empowering Information Intermediaries-11-15
AFCPE 2015 Paper-Empowering Information Intermediaries-11-15AFCPE 2015 Paper-Empowering Information Intermediaries-11-15
AFCPE 2015 Paper-Empowering Information Intermediaries-11-15
 
Global Grants 102
Global Grants 102Global Grants 102
Global Grants 102
 
Global Grants 102
Global Grants 102Global Grants 102
Global Grants 102
 
Ellie Russell - Student Voice in Evaluation
Ellie Russell - Student Voice in EvaluationEllie Russell - Student Voice in Evaluation
Ellie Russell - Student Voice in Evaluation
 
Progress in gender mainstreaming in LIVES
Progress in gender mainstreaming in LIVESProgress in gender mainstreaming in LIVES
Progress in gender mainstreaming in LIVES
 
Interview workshop slides final
Interview workshop slides  finalInterview workshop slides  final
Interview workshop slides final
 

Último

Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...PsychoTech Services
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...fonyou31
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 

Último (20)

Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 

Using Feedback Workshops in Qualitative Evaluation

  • 1. Using Feedback Workshops in Qualitative Evaluation By: Brianne Labute For: Qualitative Research Methods EDRD 6000 University of Guelph March 3rd, 2015 This work is licensed under the Creative Commons Attribution 4.0 International License. For more information please visit http:// creativecommons.org/ licenses/by-nc-nd/4.0/
  • 2. What is a feedback workshop? A feedback workshop is a meeting between evaluator(s) and stakeholders to review and discuss the evaluation findings Source: Brianne Labute
  • 3. Who is considered a stakeholder? •  Key program/project staff or volunteers, administrators, or beneficiaries •  Could also be external stakeholders – not directly involved but have a valuable contribution – such as community leaders or elected officials Source: Ridder, D . , Mostert, E . , and Wolters, H . A. (eds.) (2005), Learning Together To Manage Together; Improving Participation in Water Management (Osnabrueck: University of Osnabrueck, USF) , p. 11.
  • 4. When are feedback workshops used in evaluation? •  Can be used with any type of evaluation design – especially useful in evaluations that use qualitative methods •  Feedback workshops can be conducted throughout the evaluation progress (often the case in a more participatory evaluation design); or they can be done only in the final stages •  A report by the Kellogg’s Foundation suggests that “early feedback and a consultative relationship with stakeholders and project staff leads to a greater willingness by staff to disclose important and sensitive information to evaluators” (W.K. Kellogg Foundation, 2004)
  • 5. Why use a feedback workshop? •  To ensure the evaluator(s) properly interpreted the data and the values of the stakeholders are properly represented in the findings •  This is especially important when working with qualitative data due to its rich, thick description •  To increase the understanding of the evaluation process among stakeholders and the value of the findings •  To empower stakeholders through engagement •  To improve the accuracy of the findings •  To create discussion about how the findings can be disseminated to influence change
  • 6. A personal experience Source: Brianne Labute I was working in northern Ghana on a tourism development project. When interviewing a group of women selling yams about their experience with tourists a women approached us and started yelling. She said “ you people come here with your notebooks and ask all these questions. Why! We never see changes, we need water and better houses! We are suffering!” We were able to briefly explain that we were not coming with any funding, rather, we were there to assist the existing tourism association. The woman seemed only slightly less agitated. Luckily, we had already planned a community workshop later in the week to share more about our work. We invited her and were glad when she accepted. At the workshop there were many questions and suggestions for us from the community members. Afterwards, the community had a much better understanding of what we were trying to achieve and our research was enriched by their feedback. A win-win situation!
  • 7. •  Invite stakeholders. If there are many, it is suggested you involve a manageable subset of stakeholder representatives •  Although suggestions vary depending on the context , it is generally suggested there be no more than 15 participants at a workshop to allow for meaningful dialogue •  Send a workshop agenda and the draft report to participants in advance •  Prepare materials to present the findings and guide discussion such as a PowerPoint presentation or handouts Tips on how to conduct a successful feedback workshop: Preparation Special Note: In some international contexts these steps may not be very logical. Rather, you should consult your community contact and find out the best way to spread the word about the workshop and planned activities. This could be an announcement through the local mosque, sign board, etc.
  • 8. Preparation Continued •  Determine workshop roles. Who will chair, take notes, greet participants, etc. •  Ensure you have a meeting space conducive for good dialogue •  If logistically possible, gathering over food and drinks is a great way to create a comfortable space for those attending •  Meeting face-to-face is highly recommended. If this is not possible, other methods could be used to collect feedback such as online surveys or video conference calls Source: Brianne Labute
  • 9. During the workshop •  Brief stakeholders on the evaluation work and the findings •  Invite stakeholders to identify problems of ambiguity and fact in the findings •  Clarify any misunderstandings •  Invite participants to discuss the next steps (ie. how should the results of the evaluation be used to make improvements) •  Discuss how future evaluations can be improved
  • 10. After the workshop •  Revise the evaluation report as needed •  Send the revisions to stakeholders •  Adjust plans for future evaluations (if applicable) Source: Brianne Labute TIP! It is always beneficial to reflect on how the workshop could be better conducted next time. The workshop team should keep a notebook handy to record any ideas.
  • 11. What are some benefits to using feedback workshops? •  Involving stakeholders helps ensure a transparent process •  It produces more reliable and accurate findings Increased ownership of the recommendations among stakeholders •  Action on recommendations is more likely to be taken •  Provides opportunity to build capacity among participants
  • 12. What are some challenges when using feedback workshops? •  Feedback processes can be time consuming •  Feedback can be “based on facts, observation, and past knowledge; or almost entirely subjective, based on emotional reactions, defensiveness, loyalty (to family, friends, or class), cultural gaps, or distrust of outsiders” (University of Kansas, 2014b). •  There is potential for conflict –  Stakeholders may want interpret findings to their benefit
  • 13. References Gullickson, R., Stufflebeam, D. (2001). Feedback Workshop Checklist. Retrieved from http://www.wmich.edu/evalctr/archive_checklists/feedbackworkshop.pdf Organization for Economic Co-operation and Development. (2001). Evaluation Feedback and Effective Learning and Accountability. Retrieved from file:///Users/briannelabute/Desktop/Feedback%20workshops/Evaluation%20Feedback%20for %20Effective%20Learning%20and%20Accountability.pdf The World Bank Institute. (2013). The Art of Knowledge Exchange: A Results Focused Planning Guide for Development Practitioners. Retrieved from http://wbi.worldbank.org/wbi/Data/wbi/wbicms/files/drupal-acquia/wbi/KEfull.pdf University of Kansas, Work Group for Community Health and Development. (2014a). Community Toolbox: Participatory Evaluation. Retrieved from http://ctb.ku.edu/en/table-of-contents/evaluate/evaluation/participatory-evaluation/main University of Kansas, Work Group for Community Health and Development. (2014b). Community Toolbox: Obtaining and Using Feedback from Participants. Retrieved from http://ctb.ku.edu/en/table-of-contents/maintain/maintain-quality-performance/feedback-from- clients/main W.K. Kellogg Foundation. (2004). Evaluation Handbook. Retrieved from https://www.wkkf.org/resource-directory/resource/2010/w-k-kellogg-foundation-evaluation- handbook