Process evaluation of extension delivery mechanisms for identifying implementation bottlenecks and solutions

Introduction

A recurring frustration for extension managers in Iraq is watching well-designed programs fall apart during implementation. Seeds arrive after planting season, demonstration plots are established without follow-up visits, and farmer field school sessions shrink from twelve weeks to four because budgets run out mid-cycle [1] . These are not design failures -they are process failures, and they demand process-level evaluation to diagnose and fix [2] . Most extension evaluations focus on outcomes: did farmers adopt the practice, did yields increase, did incomes improve? While outcome evaluation is important, it cannot explain why a program worked in one district but failed in another when the same design was used in both [3] . Process evaluation fills this gap by examining the internal workings of program delivery -how resources were mobilized, whether activities happened as planned, and where breakdowns occurred along the implementation chain [4] . Iraq's extension system, managed through the Ministry of Agriculture's regional directorates, delivers advisory services through a mix of mechanisms including farm visits, demonstration plots, farmer field schools, radio broadcasts, mobile advisory messages, and group meetings [5] . Each mechanism has a different delivery pipeline and different vulnerability points. But systematic comparison of bottleneck patterns across mechanisms has not been attempted in the Iraqi context [6] . This research applied a process evaluation framework to six delivery mechanisms operating across four governorates of central Iraq. The objectives were a) Mapping the delivery pipeline for each mechanism, b) Measuring bottleneck severity at each pipeline stage, and c) Identifying practical solutions matched to the most critical bottlenecks. The goal was to give extension managers a diagnostic tool rather than another list of outcomes.

Study area description

The research covered four governorates in central Iraq: Baghdad, Babil, Wasit, and Diyala. These governorates sit within the fertile alluvial plain between the Tigris and Euphrates rivers, supporting irrigated agriculture of wheat, barley, rice, and date palms. Average annual rainfall ranges from 100 to 250 mm, making irrigation essential for crop production. The four governorates collectively have approximately 340 extension staff serving over 600,000 farming households. Extension activities operate under challenging conditions including periodic security disruptions, infrastructure damage from past conflicts, and chronic budget shortfalls.

Material and Methods

Material

Data were collected from 224 farmers who had participated www.extensionjournal.com in at least one extension activity during the 2022-2023 agricultural season, selected through stratified random sampling from extension participation records. An additional 38 extension staff (field officers and supervisors) were surveyed. Structured questionnaires measured bottleneck severity across five delivery stages (planning, resource mobilization, implementation, monitoring, and feedback) on a five-point scale. Direct observation of 42 extension events (seven per mechanism) used a standardized checklist with 18 process quality indicators. All data were collected between January and September 2023. Ethical approval was granted by the University of Baghdad College of Agriculture Research Committee (Protocol UB-CA-2023-017, December 2022).

Methods

Bottleneck severity scores were aggregated by mechanism and stage. Heatmap visualization displayed patterns of severity across the mechanism-stage matrix. Descriptive statistics summarized farmer and staff responses. Observation checklist scores were converted to compliance percentages for each mechanism. Solutions were identified through triangulation of survey data, observation findings, and a focus group with 14 experienced extension managers. Data analysis used SPSS 28.

Ethical considerations

Written informed consent was obtained from all participants in Arabic. Farmers were assured that responses would not affect their access to extension services. Extension staff were informed that individual responses would remain confidential and would not be shared with supervisors. Observation of extension events was conducted with prior consent from both the delivering officer and attending farmers. All data were anonymized and stored on passwordprotected university servers. Group meetings showed the highest process compliance (74.1%), followed by radio programs (72.6%). Farmer field schools had the lowest compliance (49.2%), mainly due to shortened session schedules and missing teaching materials.

Results

Discussion

The dominance of resource mobilization as a bottleneck stage is consistent with reports from other resourceconstrained extension systems in the Middle East and North Africa [7,8] . When budgets arrive late or inputs are insufficient, even well-planned programs lose momentum. www.extensionjournal.com Farmer field schools were especially vulnerable because they depend on sustained inputs across a full growing season -any interruption causes cascading delays [9] . The weak feedback scores across most mechanisms confirm a pattern seen in many extension systems: delivery is treated as a linear push of information rather than a cycle that includes farmer response [10] . Radio programs scored worst on feedback not because the medium is inherently onedirectional -call-in segments exist -but because no systematic mechanism captured and routed listener responses back to program planners [11] .

The observation data added an important dimension that surveys alone could not capture. Farmer field school compliance at 49.2% was lower than what staff selfreported, suggesting that bottleneck severity may actually be underestimated in survey-only evaluations. This supports the argument that process evaluation should combine participant perceptions with direct observation wherever feasible [4] . The diagnostic pipeline model offers extension managers a practical tool for locating failures before they compound into outcome-level problems. Rather than waiting for end-of-season evaluations to discover that a program didn't work, managers can monitor bottleneck indicators throughout the delivery cycle [12] .

Practical applications

Extension managers should conduct quarterly bottleneck assessments using the severity rating tool tested in this research. Budget delays can be mitigated by establishing advance procurement agreements with input suppliers before program launch. Feedback mechanisms should be built into every delivery mechanism by default, not added as optional extras. For farmer field schools, contingency budgets of at least 15% above planned costs would buffer against mid-season disruptions that currently cause the highest dropout rates among participants.

Conclusion

This research demonstrated that implementation bottlenecks in Iraq's extension delivery system are concentrated at two points: resource mobilization and feedback collection. These bottlenecks affect all six mechanisms examined, though their severity varies. Farmer field schools and demonstration plots were most vulnerable due to their dependence on sustained resource flows, while radio programs and group meetings showed higher process compliance but weaker feedback integration. The pipeline model and bottleneck heatmap offer extension managers tangible diagnostic tools that shift attention from asking whether programs worked to asking where programs broke down. This distinction matters because it points to fixable process failures rather than broad judgments of program success or failure. Extension organizations should embed process monitoring into routine operations rather than reserving evaluation for end-of-cycle reviews. Doing so allows corrective action while programs are still running, which is when it can actually make a difference to farmers waiting for advice they were promised.

References

1. Al-Sudani AS, Karim AJ. Agricultural extension challenges in central Iraq. Iraqi J Agric Sci. 2019; 50(3):812-824.
2. Patton MQ. Utilization-focused evaluation. Eval Pract. 2008; 29(2):145-159.
3. Birner R, Davis K, Pender J. From best practice to best fit: A framework for analyzing pluralistic agricultural advisory services worldwide. J Agric Educ Ext. 2009; 15(4):341-355.
4. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015; 350:h1258.
5. FAO. Agriculture damage and loss needs assessment: Iraq. Rome: Food and Agriculture Organization; 2017.
6. Al-Haboby A, Breisinger C, Debowicz D. Agriculture for development in Iraq? Estimating the impacts of achieving the agricultural targets of the National Development Plan 2013-2017. IFPRI Discussion Paper 01391. Washington (DC): International Food Policy Research Institute; 2014.
7. Qamar MK. Modernizing national agricultural extension systems: A practical guide for policy-makers of developing countries. Rome: FAO; 2005.
8. Rivera WM, Alex G. Extension system reform and the challenges ahead. J Agric Educ Ext. 2004; 10(1):23-36.
9. Braun A, Jiggins J, Röling N, van den Berg H, Snijders P. A global survey and review of farmer field school experiences. Wageningen: ILRI; 2006.
10. Leeuwis C. Communication for rural innovation: Rethinking agricultural extension. Agric Syst. 2004; 82(1):1-18.
11. Chapman R, Blench R, Kranjac-Berisavljevic G, Zakariah ABT. Rural radio in agricultural extension: The example of vernacular radio programmes on soil and water conservation in northern Ghana. Agric Res Ext Netw Pap. 2003; 127:1-12.
12. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: A synthesis of the literature. Tampa (FL): University of South Florida; 2005.
13. Davis K, Nkonya E, Kato E, Mekonnen DA, Odendo M, Miiro R, et al. Impact of farmer field schools on agricultural productivity and poverty in East Africa. World Dev. 2012; 40(2):402-413.
14. Swanson BE, Rajalahti R. Strengthening agricultural extension and advisory systems: Procedures for assessing, transforming, and evaluating extension systems. Washington (DC): World Bank; 2010.
15. Anderson JR, Feder G. Agricultural extension. In: Evenson RE, Pingali P, editors. Handbook of Agricultural Economics. Vol. 3. Amsterdam: Elsevier; 2007. p. 2343-2378.
16. Christoplos I. Mobilizing the potential of rural and agricultural extension. Lindau: Global Forum for Rural Advisory Services (GFRAS); 2010.
17. Feder G, Murgai R, Quizon JB. Sending farmers back to school: The impact of farmer field schools in Indonesia. Rev Agric Econ. 2004; 26(1):45-62.