This document provides guidance on conducting a reality check of a value chain monitoring and evaluation system. It outlines a 3-step process: 1) organize existing client and contributor information, 2) fill out a reality check tool assessing if the M&E system aligns with client needs and contributor capacity, and 3) finalize the tool and revise the M&E system as needed. The reality check tool compares the M&E system to client priorities, data expectations, and format preferences as well as contributor time availability, tool alignment with resources, and incentives. Any mismatches require discussion to determine implications and overcome issues. Once agreement is reached, indicator sheets are updated to reflect the functioning M&E system.
4. MATERIALS / INPUTS
RECOMMENDED
M&E Client Information Needs
Worksheet (from Mod 1)
M&E System Resources and
Capacity Assessment Sheets
(from Mod 3)
M&E System Indicator
Information Sheet (from Mod 6)
Reality Check-box Tool (below)
3
May 22, 2012
5. STEP-BY-STEP GUIDE
• Organize your Information and
Seed the Reality Check-box Tool
1
• Fill Out the M&E Reality Check-Box
Tool
2
• Finalize the Reality Check-Box Tool
and Revise M&E System as
3 Appropriate
4
May 22, 2012
6. STEP-BY-STEP GUIDE:
STEP 1
Purpose
•Designed to provide a quick
snapshot of the M&E system’s
feasibility
•Based on decisions already made
and tools already developed
5
May 22, 2012
7. STEP-BY-STEP GUIDE:
STEP 1
COMPLETING STEP 1
• Use the Reality Check-box Tool below to list the
priority M&E clients from Mod 1
• Priority being those ranked “High Relevance, High
Power”
Reality Check-Box – Clients
Is the data plan
Is data plan Are the formats we will If “No” for any
aligned with client
aligned with client use aligned with client question, what are the
Clients expectations for
priorities (impact, expectations and implications for M&E
accuracy and
outcome, etc.)? preferences? System?
frequency?
Donor
Field staff
Project
Manager
Minister of
Agriculture
6
May 22, 2012
8. STEP-BY-STEP GUIDE:
STEP 1Completing Step 1
•Using data From the “Responsible for Data Collection”
column in the M&E System Indicator Information Sheet,
fill in the contributor column
Reality Check-Box – Contributors
Will the contributor
Are there incentives in
have enough time to Are the tools and
place to ensure that the If “No” for any question,
gather the expected processes aligned with
Contributors contributors will adequately what are the implications
data at the frequency contributor resources and
prioritize this aspect of for M&E System?
and degree of capacity?
their job?
accuracy required?
Field staff
M&E coordinator
Field coordinator
Participants
Lead firm
partners
7
Evaluation
partner
May 22, 2012
9. STEP-BY-STEP GUIDE
• Organize your Information and Seed
the Reality Check-box Tool
1
• Fill Out the M&E Reality Check-Box
Tool
2
• Finalize the Reality Check-Box Tool
and Revise M&E System as
3 Appropriate
8
May 22, 2012
10. STEP-BY-STEP GUIDE:
STEP 2
Fill in the boxes with a Yes or No:
Clients of the M&E System: Contributors to the M&E System:
Is data plan aligned with client Will the contributor have enough time
priorities (impact, outcome, etc.)? to gather the expected data at the
frequency and degree of accuracy
Is the data plan aligned with client required?
expectations for accuracy and Are the tools and processes aligned
frequency? with contributor resources and
Is the format aligned with client capacity?
expectations and preferences? Are there incentives in place to
ensure that contributors will adequately
prioritize this aspect of their job?
Any “No” response requires a discussion of how to
overcome!
9
May 22, 2012
11. STEP-BY-STEP GUIDE
• Organize your Information and Seed
the Reality Check-box Tool
1
• Fill Out the M&E Reality Check-Box
Tool
2
• Finalize the Reality Check-Box
Tool and Revise M&E System as
3 Appropriate
10
May 22, 2012
12. STEP-BY-STEP GUIDE:
STEP 3
Continue to revise and update the system
until it aligns with the resources, capacity,
incentives and interests of all M&E clients
and contributors.
Once agreement has been reached, update
the Indicator Information Sheet as
appropriate to reflect how the M&E system
will function.
11
May 22, 2012
14. Want to Learn More?
Multiple ways to continue the discussion
and continue learning:
• Initiate a monthly session on the M&E guide and
case studies from across CARE. Contact
cpennotti@care.org
• Join the Market Engagement Community of
Practice on LinkedIn.
• Join a task force to review and refine the universal
13
indicators. Contact nardi@careinternational.org
May 22, 2012