The document discusses the development of a monitoring and evaluation (M&E) strategy for PRISE, a research consortium working in East Africa, West Africa, and Central/South Asia. It outlines five key monitoring areas for PRISE: 1) strategy and direction, 2) management, 3) outputs, 4) uptake and outcomes, and 5) context. For each area, it identifies key evaluation questions and discusses challenges in implementing the M&E strategy, such as defining outcomes and distributing monitoring responsibilities across partners and levels.

2. Monitoring stakeholder
engagement
The experience of developing the
M&E strategy for PRISE
Simon Hearn, Research Fellow, ODI

3. What is PRISE?

4. Country focus
East Africa
• Tanzania
• Kenya
West Africa
• Senegal
• Burkina Faso
Central / South Asia
• Pakistan
• Tajikistan

5. People benefit
Resilient economy
Stakeholders invest in and incentivise CRD
Stakeholders cooperate and coordinate
Stakeholders demonstrate understanding,
capacity and evidence to act on CRD
Research and engagement

6. Monitoring
areas
Evaluation
questions
Required data
Tools and
processes
Roles and
responsibilities
Capacity
development
M&E strategy build up

7. 1. Strategy and direction
2. Management
3. Outputs
4. Uptake and outcomes
5. Context
– are you doing the
right thing?
– are you doing what you
planned to do?
– are the outputs produced to
standard and appropriate for the audience?
– are people aware
of your work and what effect is it having?
– what is changing in your context
that you should be aware of?
Monitoring areas

8. Monitoring area Key evaluation question
1. Strategy and direction
How appropriate and relevant are PRISE strategies for
meeting the goals of the consortium?
2. Management and implementation
How well are internal systems working to implement the
strategy (to time and budget)?
3. Outputs and quality assurance
What has been the quality of outputs produced and
communicated?
4. Uptake and outcomes
What outcomes have been produced and what
contribution has PRISE made to them?
5. Context
How do the contexts within which PRISE is operating vary
over time and space?
Evaluation questions

9. 1. Ongoing data collection: outputs, uptake and outcomes
– E.g. CARIAA output monitoring tool, event assessment, uptake log, media and social media monitoring
2. Periodic data collections: uptake and outcomes
– E.g. interviews, surveys, stories of change
3. Data analysis and synthesis
– E.g. meetings, dashboards, reports, annual learning reviews
M&E processes
_____
a. at country level
b. at consortium level

10. 1. Strategy and direction
2. Management
3. Outputs
4. Uptake and outcomes
5. Context
– happens intuitively
at steering group level
– distributed within each
partner organisation
– driven by donor requirements and
systems
– emerging tools but
need support
– difficult to focus until research
areas are clear
Challenges to model

12. Impact:
Change in
economy,
Institutions,
communities
Outputs:
Research,
comms and
engagement
Outcomes:
Changes in
behavior,
relationships,
policy
Defining outcomes

13. 13
Given our understanding of the context, there are behaviours we would…
…expect to see……………….like to see………………………love to see…
Early positive
responses to the
research
Active engagement
with the research
results
Deep transformation
in behaviour

14. 1. Attitudes
2. Public opinion
3. Capacity
4. Discourse
5. Procedure/process
6. Content
7. Behaviour change
8. Networks and systems
Source: Keck and Sikkink (1998) and Steven (2007)
Defining outcomes

15. What kind of
behaviour would
we…
Expect to see? Like to see? Love to see?
Stakeholder 1 Reads reports,
asks for briefing
Talks to a group
they’ve not
engaged with
before
They develop joint
statements /
approaches
Stakeholder 2 Attends seminar A bit of a
backlash: this is
threatening to
them
Doesn’t try to up-
end the process
Defining outcomes