Outcome mapping as a participatory evaluation methodology for complex agricultural extension interventions

Introduction

Most extension evaluations look backward at what was delivered. Outcome mapping looks forward at what changed. This distinction matters because agricultural extension operates in complex systems where the link between activities and farmer outcomes is rarely linear [1,2] . A training workshop may be perfectly executed yet produce no lasting change in farming practice. Logframe-based evaluations struggle to capture this gap because they track predetermined indicators that miss unexpected changes [3] . Outcome mapping, developed by IDRC in 2001, takes a different approach [4] . Rather than measuring a program's direct impact on development conditions, it tracks changes in the behavior and actions of "boundary partners"the people and organizations a program works with. Progress is measured through graduated markers: changes you expect to see, would like to see, and would love to see [5] . Despite its appeal, outcome mapping remains underused in agricultural extension. Most applications come from health and governance sectors [6,7] . Critics note it is timeconsuming and difficult to aggregate [8] ; supporters counter that these costs are justified when behavioral transformation is the goal [9] . This research applied the nine-step framework to three extension interventions in The Gambia through the University of The Gambia in Brikama, testing whether outcome mapping works in a resource-constrained West African context [10,11] .

Theoretical Framework

This research drew on complexity theory as applied to development evaluation by Patton [2] and the outcome mapping methodology by Earl, Carden, and Smutylo [4] . Complexity theory holds that social interventions operate in adaptive systems where causation is non-linear and contextdependent. Traditional evaluation models assume a linear causal chain (inputs → activities → outputs → outcomes → impact) that rarely holds in practice [3,12] . Outcome mapping addresses this by shifting the unit of analysis from program outputs to boundary partner behavior, recognizing that programs cannot control outcomes but can influence the actors who produce them. Progress markers at three graduated levels acknowledge that behavioral change is incremental [5] . This combination provides both a rationale for why conventional evaluation is insufficient and a practical methodology for what to do instead.

Materials and Methods

Materials

Research materials included outcome mapping worksheets adapted from the IDRC handbook [4] , outcome journal www.extensionjournal.com templates, strategy journal templates, and performance journal templates. The worksheets were translated into Mandinka and Fula and pre-tested with two community groups in November 2021. Monitoring tools included structured observation checklists, quarterly reflection workshop protocols, and a behavior change episode recording form capturing what changed, who changed, evidence sources, contributing strategies, and progress marker levels. Ethical clearance was obtained from the University of The Gambia Research Ethics Board (Protocol UTG/AG/2021-039, approved October 2021).

Methods

The outcome mapping framework was applied to three ongoing extension interventions in The Gambia's Central River Region and Upper River Region: a rice value chain development program, a community seed systems initiative, and an integrated soil fertility management project. Six boundary partner groups were identified: farmer groups, extension agents, input suppliers, local government agricultural units, agricultural research institutes, and NGO implementing partners [10] . Implementation followed the nine-step process (Figure 2) from January 2022 to February 2023 (14 months). Outcome journals were maintained by 12 trained program staff members who recorded behavior change episodes on a rolling basis. Participatory monitoring sessions involved 72 boundary partner representatives ( 12per group) in quarterly reviews. Four reflection workshops brought together all partners to review journals, assess progress marker achievement, and adapt strategies. Quantitative data were analyzed through descriptive statistics and content classification. Qualitative data from journals and workshops were analyzed through directed content analysis using the outcome mapping categories [11,13] .

Pilot Research

A two-month pilot was conducted in November-December 2021 with the rice value chain program and two boundary partner groups in the Central River Region. The pilot tested translated worksheets, journal recording procedures, and monitoring protocols. Key adjustments included simplifying the outcome journal from 14 fields to 8, reducing partner monitoring from monthly to quarterly to avoid consultation fatigue, and adding visual progress marker charts for lowliteracy participants. The pilot also revealed that boundary partners needed a two-day orientation to understand outcome mapping concepts before meaningful participation was possible [4,14] .

Results

Over 14 months, the outcome mapping process documented 143 discrete behavior change episodes across the six boundary partner groups and three extension interventions. Supportive strategies consistently outperformed persuasive ones, with ratios ranging from 1.7:1 to 3.1:1 [5,15] . [3,16] . www.extensionjournal.com The left pie shows farmer groups dominating the behavior change record (31.4%), followed by extension agents (22.8%). The right pie reveals that most achievement occurred at the "expect to see" level (42.6%), with "love to see" changes remaining rare (8.4%), consistent with the incremental nature of behavioral transformation.

Discussion

The Gambian application confirms outcome mapping's value for complex extension evaluation while revealing its practical demands [4,6] . The 143 behavior change episodes provided far richer evidence than logframe indicators for the same interventions. The dominance of "expect to see" achievements (42.6%) over "love to see" changes (8.4%) aligns with behavioral change theory, which predicts that deep transformation takes longer than 14 months [5,17] . This graduated picture is itself informativeit tells managers where partners are in their change journeys. The finding that supportive strategies outperformed persuasive ones (2.3:1 overall) has practical implications for engagement design [9,15] . However, outcome mapping's demands are real. The methodology required trained journal keepers, facilitated quarterly workshops, and sustained attention over 14 months. The pilot modificationssimplified forms, reduced frequency, visual toolswere essential for making it workable in a resource-constrained setting [8,14] .

Limitations

References

1. Rogers EM. Diffusion of innovations. New York: Free Press; 2003. p. 1-576.
2. Patton MQ. Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford Press; 2011. p. 1-375.
3. Gasper D. Evaluating the logical framework approach-towards learning-oriented development evaluation. Public Administration and Development. 2000;20(1):17-28.
4. Earl S, Carden F, Smutylo T. Outcome mapping: Building learning and reflection into development programs. Ottawa: IDRC; 2001. p. 1-139.
5. Ambrose K, Cardey S. Adapting outcome mapping for smallholder development programs. Journal of Development Effectiveness. 2018;10(2):233-248.
6. Smutylo T. Crouching impact, hidden attribution: Overcoming threats to learning in development programs. Ottawa: IDRC Evaluation Unit Learning Paper; 2005. p. 1-18.
7. Hearn S, Buffardi AL. What is impact? London: ODI Methods Lab Publication; 2016. p. 1-32.
8. Young J, Shaxson L, Jones H, Hearn S, Datta A, Cassidy C. RAPID outcome mapping approach: A guide to policy engagement and influence. London: ODI; 2014. p. 1-40.
9. Deprez S, Huebner W, Van de Broeck L. Using outcome mapping for learning: Insights from three Flemish development organisations. Knowledge Management for Development Journal. 2012;8(1):7889.
10. NASS. National agricultural sample survey. Banjul: National Statistics Office; 2019. p. 1-124.
11. Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. Thousand Oaks (CA): Sage Publications; 2017. p. 1-492.
12. Stame N. Theory-based evaluation and types of complexity. Evaluation. 2004;10(1):58-76.
13. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qualitative Health Research. 2005;15(9):1277-1288.
14. Ortiz Aragon A. A case for surfacing theories of change for purposeful organisational capacity development. IDS Bulletin. 2010;41(3):36-46.
15. Jones H, Hearn S. Outcome mapping: A realistic alternative for planning, monitoring and evaluation. London: ODI Background Note; 2009. p. 1-4.
16. White H. Theory-based impact evaluation: Principles and practice. Journal of Development Effectiveness. 2009;1(3):271-284.
17. Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: Toward an integrative model of change. Journal of Consulting and Clinical Psychology. 1983;51(3):390-395.
18. Wholey JS, Hatry HP, Newcomer KE. Handbook of practical program evaluation. San Francisco (CA): John Wiley and Sons; 2010. p. 1-756.
19. Vogel I. Review of the use of theory of change in international development. London: DFID; 2012. p. 167.
20. IFAD. Managing for impact in rural development: A guide for project monitoring and evaluation. Rome: International Fund for Agricultural Development; 2002. p. 1-166.