International Conference on Integrated Systems

1. Opportunities for higher
impact agricultural research
for development:
A systematic review (SR) on
a generic theory of change
linking multistakeholder
platforms to development
outcomes and available tools
Humidtropics
MURAT SARTAS

2. What is Systematic Review?
An approach to
• maximize relevance
– Is the review useful? What does it contribute?
– Does research question target the use identified?
• minimize bias
– a protocol published and peer reviewed before the
review; no cherry picking
– high citations and published journal does not ensure
quality

3. Why Systematic Review?
• Systems research require many multi`s so a
single literature track is not enough
• Gap on sufficient characterization of the context
• A need for tool consolidation and
taxonomy
• Knowledge gap on theory of changes linking
multistakeholder process to development outputs
and outcomes

4. How does it work?
•Level 1
–Level 2
•Level 3

5. Objectives of the SR
• Identify contextual factors influencing the
effectiveness of multistakeholder processes
• Identify theory of changes linking
multistakeholder processes to development
outcomes
• A taxonomy of the tools in studying the impact of
multistakeholder process

7. Search Query
• Search to word “stakeholder” in Web of
Knowledge (76.530) and Scopus (75.020)
– The literature is really big on stakeholders
• Text analysis of the titles and abstract of
150.000 + resources suggested 237.077 words
– The language on stakeholder research is quite
diversified
• Clearing of the words and analysis reveal that
1480 words cover 99% of the word set
– The reference set for the words in the query

8. Search Query
• Context Characterization (67)
Emergency OR area OR capital OR basin OR climate OR coastal OR context OR country OR
culture OR curriculum OR disaster OR district OR domain OR environment OR ethic OR geography
OR ground OR habitat OR historical OR history OR housing OR identity OR infrastructure OR
insurance OR international OR landscape OR language OR legal OR legislation OR location OR
mental OR moral OR national OR nations OR nature OR orient OR period OR physical OR politic
OR property OR region OR regulation OR remote OR resource OR rights OR risk OR river OR rules
OR rural OR scope OR sector OR security OR site OR situation OR socially OR society OR socio
OR stage OR status OR system OR traditional OR uncertainty OR watershed OR marine OR
ecological OR ecology OR economic
• Actor Typology (60)
investor OR tourism OR academy OR actor OR agency OR business OR child OR citizen OR client
OR company OR corporate OR customer OR director OR enterprise OR expert OR family OR
farmer OR firm OR fisher OR government OR indigenous OR industry OR informal OR institute OR
leader OR manufacturing OR marketing OR media OR medic OR member OR mining OR ministry
OR nurse OR owner OR parent OR patient OR personnel OR physician OR pilot OR practitioner OR
press OR private OR professional OR researcher OR resident OR school OR staff OR stakeholder
OR storage OR teacher OR trader OR union OR user OR vulnerable OR women OR worker OR
workforce OR young OR youth OR organization

9. Search Query
• Participation (30)
accountability OR awareness OR reliability OR advocacy OR attention OR commitment OR guide
OR communication OR authority OR conflict OR encourage OR expectation OR initiative OR
interpretation OR legitimacy OR prioritization OR reputation OR transparency OR discourse OR
incentive OR interest OR opinion OR ownership OR perception OR respect OR share OR trust OR
understand OR vision OR voluntary
• Multi-stakeholder (12)
cooperation OR agreement OR partnership OR discussion OR interaction OR consensus OR panel
OR platform OR forum OR committee OR council OR team
• Process (11)
negotiation OR representation OR adaptation OR transformation OR dialogue OR engage OR
involvement OR facilitation OR debate OR consultation OR collaborate

10. Search Query
• Intervention (40)
allocation OR allow OR analyse OR build OR combine OR conduct OR control OR coordination OR
deployment OR disclosure OR dissemination OR enhance OR ensure OR examine OR explain OR
influence OR input OR instrument OR intervention OR introduce OR logistics OR mapping OR
mitigation OR operation OR planning OR plans OR practice OR procedure OR program OR project
OR provide OR strategy OR support OR training OR treatment OR validation OR implement OR
establish OR manage OR prevent
• Development output and outcomes (56)
demonstrate OR improve OR distribution OR achieve OR adopt OR become OR biodiversity OR
chronic OR commercial OR conservation OR contribute OR deliver OR determine OR develop OR
diabetes OR disease OR electricity OR emissions OR employ OR energy OR equity OR failure OR
finding OR foster OR goal OR graduate OR growth OR health OR heritage OR impact OR
implications OR income OR irrigation OR justice OR lessons OR nutrition OR obesity OR outcome
OR overcome OR pollution OR product OR profit OR progress OR promotion OR publish OR
recovery OR reduce OR reform OR rehabilitation OR renewable OR restoration OR satisfaction OR
supply OR waste OR welfare OR wildlife
26581 Resources appear relevant in SCOPUS
Of which 2753 on agriculture

11. On Agriculture
•Title, Author
–Level 2
•Level 3

12. On Agriculture
•Title, Author
–Level 2
•Level 3

13. Validity of the Search Query
• Reference set of sources identified by the author
team and advisory council (about 30)
Cees Leeuwis
Marc Schut
Laurens Klerx
David Gough
Piet Van Asten
Linley Chiwona Karltun
Javier Mario Ekboir
Mark Lundy
John McDermott
Eric Koper
Harry Palmier
Boru Douthwaite
Kwesi Atta Krah
Mark Holderness

14. Final product: An Example

15. Final product: An Example

16. Final product: An Example

17. Final product: An Example

18. Final product: An Example

19. Murat Sartas
Innovation System Scientist
m.sartas@cgiar.org
Insert photo here