This document provides a step-by-step guide for selecting data collection tools for monitoring and evaluation. It outlines a 5-step process: 1) separate indicators into routine observation and measurement, 2) identify tools for observation indicators, 3) identify tools for measurement indicators, 4) ensure tools meet needs and resources, and 5) finalize the indicator information sheet. The guide emphasizes selecting simple, low-resource tools and engaging stakeholders to develop tools that meet diverse needs. It also warns against losing sight of all stakeholders and focusing too much on formal quantitative methods.

1. VALUE CHAIN MONITORING
AND EVALUATION GUIDE
MODULE
5
Select Data Collection
Tools

2. GETTING
STARTED
1
May 22, 2012

3. GETTING
STARTED
2
May 22, 2012

4. GETTING
STARTED
The tools we consider must be
the simplest way of meeting the
data needs of our priority M&E
clients within our resource and
capability constraints.
3
May 22, 2012

5. GETTING
STARTED
Just because you can
write it down does not
mean you can make it
happen!
4
May 22, 2012

6. MATERIALS / INPUTS
RECOMMENDED
Market Engagement Indicator
Information Sheet
Measurement tools and
processes used by other CARE
projects in the CO and/or
partner organizations
Measurement tools and
processes used by CARE
programs in the CO
Information on any donor-
required tools
Secondary information sources
5
May 22, 2012
for related indicators

7. STEP-BY-STEP GUIDE
• SEPARATE ROUTINE OBSERVATION INDICATORS
1 FROM THOSE FOR ROUTINE MEASUREMENT
• IDENTIFY TOOLS FOR ROUTINE OBSERVATION
2 INDICATORS
• IDENTIFY TOOLS FOR ROUTINE MEASUREMENT
3 INDICATORS
• ENSURE TOOLS ALIGN WITH THE NEEDS OF
4 PRIORITY CLIENTS AND RESOURCES / CAPACITY
• FINALIZE THE MARKET ENGAGEMENT INDICATOR
5 INFORMATION SHEET
6
May 22, 2012

8. STEP-BY-STEP GUIDE:
STEP 1
Purpose
•Simplifies the selection process
•Different actors will use different tools
7
May 22, 2012

9. STEP-BY-STEP GUIDE:
STEP 1
Two options to complete Step1:
1. Filter your Market Engagement Indicator
Information Sheet by indicator type
(measurement, observation)
2. Create a separate table like the one below:
Expected Observation Measurement
Change
Indicator Data Collection Tool Indicator Data Collection
Tool
8
May 22, 2012

10. STEP-BY-STEP GUIDE
• SEPARATE ROUTINE OBSERVATION INDICATORS
1 FROM THOSE FOR ROUTINE MEASUREMENT
• IDENTIFY TOOLS FOR ROUTINE OBSERVATION
2 INDICATORS
• IDENTIFY TOOLS FOR ROUTINE MEASUREMENT
3 INDICATORS
• ENSURE TOOLS ALIGN WITH THE NEEDS OF
4 PRIORITY CLIENTS AND RESOURCES / CAPACITY
• FINALIZE THE MARKET ENGAGEMENT INDICATOR
5 INFORMATION SHEET
9
May 22, 2012

11. STEP-BY-STEP GUIDE:
STEP 2
This process will require input
from field staff, project
managers, implementing
partners as well as other key
M&E clients that will actively
use this information.
10
May 22, 2012

12. STEP-BY-STEP GUIDE:
STEP 2
COMPLETING STEP 2
• Have a dedicated meeting to agree on criteria for
the tools. Consider the following:
• Tools or practices from other initiatives
• Set the expectation that field staff and implementing
partners will be helping to co-design the data collection
tools.
• Develop a participatory approach to develop field staff
and implementing partner ownership.
• Facilitate the discussions, capture the outputs and
define the process for finalizing the tools – which will
likely require several meetings!
11
May 22, 2012

13. STEP-BY-STEP GUIDE
• SEPARATE ROUTINE OBSERVATION INDICATORS
1 FROM THOSE FOR ROUTINE MEASUREMENT
• IDENTIFY TOOLS FOR ROUTINE OBSERVATION
2 INDICATORS
• IDENTIFY TOOLS FOR ROUTINE MEASUREMENT
3 INDICATORS
• ENSURE TOOLS ALIGN WITH THE NEEDS OF
4 PRIORITY CLIENTS AND RESOURCES / CAPACITY
• FINALIZE THE MARKET ENGAGEMENT INDICATOR
5 INFORMATION SHEET
12
May 22, 2012

14. STEP-BY-STEP GUIDE:
STEP 3
•This step will feel much more
familiar to M&E system
designers
•Refer to the following:
•CARE DME guidelines
•Donor standards or
guidelines
13
•CARE Program M&E System
tools
May 22, 2012

15. STEP-BY-STEP GUIDE
• SEPARATE ROUTINE OBSERVATION INDICATORS
1 FROM THOSE FOR ROUTINE MEASUREMENT
• IDENTIFY TOOLS FOR ROUTINE OBSERVATION
2 INDICATORS
• IDENTIFY TOOLS FOR ROUTINE MEASUREMENT
3 INDICATORS
• ENSURE TOOLS ALIGN WITH THE NEEDS OF
4 PRIORITY CLIENTS AND RESOURCES / CAPACITY
• FINALIZE THE MARKET ENGAGEMENT INDICATOR
5 INFORMATION SHEET
14
May 22, 2012

16. STEP-BY-STEP GUIDE:
STEP 4
Take a step back and ask the following
questions:
1. Will the combination of tools we have
identified allow us to meet the needs of
the priority clients of the M&E system?
2. Based on our resources and capabilities
assessment, can we apply and manage
all of these tools effectively?
15
May 22, 2012

17. STEP-BY-STEP GUIDE
• SEPARATE ROUTINE OBSERVATION INDICATORS
1 FROM THOSE FOR ROUTINE MEASUREMENT
• IDENTIFY TOOLS FOR ROUTINE OBSERVATION
2 INDICATORS
• IDENTIFY TOOLS FOR ROUTINE MEASUREMENT
3 INDICATORS
• ENSURE TOOLS ALIGN WITH THE NEEDS OF
4 PRIORITY CLIENTS AND RESOURCES / CAPACITY
• FINALIZE THE MARKET ENGAGEMENT INDICATOR
5 INFORMATION SHEET
16
May 22, 2012

18. STEP-BY-STEP GUIDE:
STEP 5
Capture the outcomes of your tool selection process
in your Indicator Information Sheet
Result Level Domain Key Change Indicator - Indicator - Target Data Users Data Source Collection Collection Responsible
(Wom en's Em p, (Y/N) Measurement Observation (Clients) Method / Frequency for Collection
Enterprise, Sector) Tool
Impact
Lagging
outcome
Leading
outcome
Output
17
May 22, 2012

19. COMMON
PITFALLS
•M&E system designers lose sight of the diverse needs of M&E
clients leading to tools that only meet the needs of the most
obvious or powerful interests – typically donors.
•Projects focus disproportionately on traditional information
gathering methods (periodic, formal, quantitative methods
applied to large samples) and fail to utilize ad hoc, less formal,
qualitative, and rapid assessment methods.
•M&E system designers focus on proving that our project
caused a particular change (attribution) instead of considering
whether an M&E system designed to demonstrate how we
contributed to change might be more appropriate given our
needs and our resources.
18
May 22, 2012

20. TEMPLATES AND SUPPORTING
MATERIALS
Additional resources for Routine Measurement and
Observation:
•CARE Design, Monitoring and Evaluation Guide
•CARE International Evaluation Policy
•ODI Tools for Knowledge Management and Learning:
A Guide for Development and Humanitarian
Organizations
•DCED Results Measurement Standard
19
May 22, 2012

21. QUESTIONS
?
COMMENTS
?
20
May 22, 2012

22. Want to Learn More?
Multiple ways to continue the discussion
and continue learning:
• Initiate a monthly session on the M&E guide and
case studies from across CARE. Contact
cpennotti@care.org
• Join the Market Engagement Community of
Practice on LinkedIn.
• Join a task force to review and refine the universal
21
indicators. Contact nardi@careinternational.org
May 22, 2012